Uploads disabled

aad
aad
Joined: 24 Dec 05
Posts: 13
Credit: 603,127,905
RAC: 449,269

RE: (update: fs repair

Quote:
(update: fs repair done, fragmentation check running, we might restart parts of the project soon)


Soooooo..how about a coffee break?

Just kidding!
Thanks for doing this in the weekend...!

Hapsburg
Hapsburg
Joined: 22 Sep 14
Posts: 1
Credit: 30,419,034
RAC: 0

I'm wondering, is it possible

I'm wondering, is it possible to let us keep downloading new work units to process, meanwhile holding all the completed results on our own hard disk, and waiting for the upload system to get repaired ??? I suppose most computers that are attached to BOINC are equiped with lots of free disk space, and it would be good if we can keep contributing our computing resource to this project without being blocked out in the down time of the upload system. Since we all know that the reparation is going to take a while, isn't it ?

Jesse Viviano
Jesse Viviano
Joined: 8 Jun 05
Posts: 31
Credit: 66,039,676
RAC: 0

That might not be a good

That might not be a good idea. This would prolong the recovery of the upload server because there would be more files to upload once uploads turn on. Since letting the file system get too full caused the problem, issuing more work might generate the conditions to cause the file system to fill up and become too slow again.

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 877
Credit: 25,165,115
RAC: 0

We're thinking about it and

We're thinking about it and might in fact do that, but:

- modern clients will stop requesting more work when too many pending uploads pile up
- the more uploads do pile up out there the higher the burden will be for the upload server when it's online again

We'll keep you posted,
Oliver

 

Einstein@Home Project

Sunny129
Sunny129
Joined: 5 Dec 05
Posts: 162
Credit: 160,342,159
RAC: 0

RE: Remember you have to

Quote:
Remember you have to get it done in half the time you say if you are going to be Scotty...


He's giving her all she's got Captain!

robl
robl
Joined: 2 Jan 13
Posts: 1,671
Credit: 1,194,812,910
RAC: 977,521

When this upload issue is

When this upload issue is resolved will E@H be staying with the XFS filesystem or is there another option?

In the meantime I am using this downtime to update patches/fixes and shutting down units that are out of work. I will return them when we have a resolution. Sometimes you are just going to "have days like this".

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 877
Credit: 25,165,115
RAC: 0

RE: We have a number of

Quote:

We have a number of options and we'll weigh them carefully. Please understand though that we won't rush things - analyze, think, plan, act.

Thanks for your patience,
Oliver


 

Einstein@Home Project

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 1,961
Credit: 338,770,944
RAC: 924,918

RE: - modern clients will

Quote:
- modern clients will stop requesting more work when too many pending uploads pile up


Depends how you define 'modern' - that's been in the code source for at least six years.

The worst case, as far as the filesystem is concerned, will be the Arecibo GPU tasks which need 16 separate files to be slotted into the storage index: they at least will be inhibited by "too many uploads" (though I think the count is of tasks in the uploading state, not individual upload files). It would be relatively benign to allow new allocations of Perseus Arm tasks, with a much higher ratio of compute time per file generated - and you can work out the rest for yourselves.

merle van osdol
merle van osdol
Joined: 1 Mar 05
Posts: 513
Credit: 60,724,446
RAC: 0

RE: RE: - modern clients

Quote:
Quote:
- modern clients will stop requesting more work when too many pending uploads pile up

Depends how you define 'modern' - that's been in the code source for at least six years.

The worst case, as far as the filesystem is concerned, will be the Arecibo GPU tasks which need 16 separate files to be slotted into the storage index: they at least will be inhibited by "too many uploads" (though I think the count is of tasks in the uploading state, not individual upload files). It would be relatively benign to allow new allocations of Perseus Arm tasks, with a much higher ratio of compute time per file generated - and you can work out the rest for yourselves.

Yeah, I vote Yes for Perseus Arm tasks!!

merle

What is freedom of expression? Without the freedom to offend, it ceases to exist.

— Salman Rushdie

Oliver Behnke
Oliver Behnke
Moderator
Administrator
Joined: 4 Sep 07
Posts: 877
Credit: 25,165,115
RAC: 0

Update: we enabled the

Update: we enabled the uploads again - for testing purposes - but we couldn't yet really improve the performance. We may try a few other things but any major alternative setup like moving the entire dataset will have to wait until Monday, I'm afraid.

Best,
Oliver

 

Einstein@Home Project

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.