Disk Space

rebel9
rebel9
Joined: 21 May 05
Posts: 2
Credit: 26371849
RAC: 1071
Topic 195313

Hi Guys,

According to BOINC Manager my E@H is using 587 MB. I have a couple of questions:

1) Why is it so?
2) What can I do about it?

and I might add

3) Is that normal?

That's an awful lot of space.

Many thanks.

tullio
tullio
Joined: 22 Jan 05
Posts: 2118
Credit: 61407735
RAC: 0

Disk Space

On my Linux box CPDN is taking 517 MB, Einstein 467 MB, QMC 163 MB, the other 3 (4 with LHC) very little.
Tullio

Mike Hewson
Mike Hewson
Moderator
Joined: 1 Dec 05
Posts: 6534
Credit: 284713501
RAC: 106859

RE: Hi Guys, According to

Quote:

Hi Guys,

According to BOINC Manager my E@H is using 587 MB. I have a couple of questions:

1) Why is it so?
2) What can I do about it?

and I might add

3) Is that normal?

That's an awful lot of space.

Many thanks.


You seemed to have re-joined our efforts recently, so thanks and welcome! :-)

It's not unusual. The files are of several types : administrative, data and executable. Because of a feature of BOINC that E@H uses, called 'locality scheduling' that reduces on average the overall download burden, then your computer will be keeping many files that will be useful for some time. That means your first download will likely be the biggest for quite a while, by setting up a 'framework' for your computation efforts. Like slicing ( and eating! ) a loaf of bread, the crunching will gradually consume .... so you won't be downloading anything near a half Gig per week. My machines each have about 600 - 700 MB used for E@H, but it's possible they need a purge of old files. Normally BOINC will instruct your computer to delete files no longer needed, so it's best to let it manage that. Is this causing an overall disk space problem for you? Or are you simply worried about where will it end?

Cheers, Mike.

I have made this letter longer than usual because I lack the time to make it shorter ...

... and my other CPU is a Ryzen 5950X :-) Blaise Pascal

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1364
Credit: 3562358667
RAC: 1580

That's normal. Einstein is

That's normal. Einstein is processing large data files. My i7 boxes are both slightly over 1GB of data, and my laptops are at 500 and 800GB.

The other half of why disk usage is high is that the data files are used for a number of WU's not just one so the scheduler doesn't send delete commands back until all the WU's using a data file are complete (ie none failed to validate or weren't returned).

You could try disabling ABP2 work units in your settings page, but I'm not sure what fraction of the data is ABP2 vs S5GCE and as the main science app latter can't be disabled. Otherwise if it's that serious of a problem, your only option would be to switch from Einstein to a different project.

Jord
Joined: 26 Jan 05
Posts: 2952
Credit: 5779100
RAC: 0

RE: and my laptops are at

Message 99578 in response to message 99577

Quote:
and my laptops are at 500 and 800GB.


I hope you meant megabytes, not gigabytes...

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1364
Credit: 3562358667
RAC: 1580

RE: RE: and my laptops

Message 99579 in response to message 99578

Quote:
Quote:
and my laptops are at 500 and 800GB.

I hope you meant megabytes, not gigabytes...

ooops...

Jord
Joined: 26 Jan 05
Posts: 2952
Credit: 5779100
RAC: 0

With the 1 and 1.5 terabyte

Message 99580 in response to message 99579

With the 1 and 1.5 terabyte drives available, it would be feasible. I just think you'll be downloading work for longer than it takes to reach Einstein's deadline. ;-)

rebel9
rebel9
Joined: 21 May 05
Posts: 2
Credit: 26371849
RAC: 1071

Hi Mike, RE: RE:

Message 99581 in response to message 99576

Hi Mike,

Quote:

Quote:

Hi Guys,

According to BOINC Manager my E@H is using 587 MB. I have a couple of questions:

1) Why is it so?
2) What can I do about it?

and I might add

3) Is that normal?

That's an awful lot of space.

Many thanks.


You seemed to have re-joined our efforts recently, so thanks and welcome! :-)

No, I've been crunching here for years but you're welcome anyway. I just don't say much. :-)
My computer died for a month and a half recently. Ouch!

Quote:


It's not unusual. The files are of several types : administrative, data and executable. Because of a feature of BOINC that E@H uses, called 'locality scheduling' that reduces on average the overall download burden, then your computer will be keeping many files that will be useful for some time. That means your first download will likely be the biggest for quite a while, by setting up a 'framework' for your computation efforts. Like slicing ( and eating! ) a loaf of bread, the crunching will gradually consume .... so you won't be downloading anything near a half Gig per week. My machines each have about 600 - 700 MB used for E@H, but it's possible they need a purge of old files. Normally BOINC will instruct your computer to delete files no longer needed, so it's best to let it manage that. Is this causing an overall disk space problem for you? Or are you simply worried about where will it end?

Cheers, Mike.

OK, that's fine. I was just checking. No, the space is OK I just wanted to avoid have space consumed unnecessarily.

Cheers.

Mike Hewson
Mike Hewson
Moderator
Joined: 1 Dec 05
Posts: 6534
Credit: 284713501
RAC: 106859

RE: No, I've been crunching

Message 99582 in response to message 99581

Quote:
No, I've been crunching here for years but you're welcome anyway. I just don't say much. :-)
My computer died for a month and a half recently. Ouch!


Well, thanks for hanging in there then. :-)

Quote:

OK, that's fine. I was just checking. No, the space is OK I just wanted to avoid have space consumed unnecessarily.

Cheers.


The other point is that doing both GW's and ABP's means more client-side data storage too. I'm not aware of any files ( beyond BOINC admin use ) common to both schemes.

Cheers, Mike.

I have made this letter longer than usual because I lack the time to make it shorter ...

... and my other CPU is a Ryzen 5950X :-) Blaise Pascal

Speedy
Speedy
Joined: 11 Aug 05
Posts: 39
Credit: 22006889
RAC: 521

I rejoined on 18th New

I rejoined on 18th New Zealand date with my i7 3.33Ghz & the size of my e@h folder in boinc directory is 3.53Gig. I have 38 S5GC1 tasks lined up ready to go. As the files were been downloaded I never thought they were going end. Just letting you know. no complaints here.

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1364
Credit: 3562358667
RAC: 1580

RE: I rejoined on 18th New

Message 99584 in response to message 99583

Quote:
I rejoined on 18th New Zealand date with my i7 3.33Ghz & the size of my e@h folder in boinc directory is 3.53Gig. I have 38 S5GC1 tasks lined up ready to go. As the files were been downloaded I never thought they were going end. Just letting you know. no complaints here.

I've got 2 machines in that class; both're only holding about a gig of data though. What I think happened in your case is that the current science run is nearly over, so when you joined the scheduler ended up giving you lots of odds and ends each needing a unique set of data instead of a single pile of several dozen tasks all using the same files.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.