Stopping project

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4,305
Credit: 248,664,033
RAC: 30,688
Topic 231163

The transitioner is not running as it should. I'm stopping the project until I can find the cause and fix it. Might not be before Monday.

BM

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6,245
Credit: 8,865,713,595
RAC: 9,439,272

May this NOT ruin your

May this NOT ruin your weekend by following you home from work!

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

astro-marwil
astro-marwil
Joined: 28 May 05
Posts: 527
Credit: 588,496,543
RAC: 1,103,064

Hallo! The Server Status

Hallo!

The Server Status Page is sticking too, and I don't get fresh tasks from BRP7.

Kind regards and happy crunching

Martin

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5,870
Credit: 115,696,570,042
RAC: 34,702,831

astro-marwil wrote:... and I

astro-marwil wrote:
... and I don't get fresh tasks from BRP7.

As the opening post says, the whole project has been stopped, not just one individual search.  If it only applied to O3AS, the message would have been posted in that particular thread.

At the moment, I have a number of hosts with completed BRP7 tasks (and more to be finished over the weekend) that will be past deadline by Monday afternoon.  I'm not sure sure how these will be treated when the system eventually comes back on line.

Cheers,
Gary.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4,305
Credit: 248,664,033
RAC: 30,688

Slowly starting the project

Slowly starting the project again. No problems visisble so far.

Some process (that I still couldn't find out) had locked the workunit table in the DB, so other parts of the system (like the transitioner) couldn't write to it. At night I couldn't find out which process it was and couldn't release the lock, but it currently looks like the pause has done the project and DB good. I still don't know exactly what it was, but so far it's not coming back.

Let's hope that it stays that way at least over the weekend.

BM

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5,870
Credit: 115,696,570,042
RAC: 34,702,831

Thanks!   I had discovered

Thanks!   I had discovered that forcing an update around 20 mins ago got completed tasks returned and I've also been able to get new BRP7 tasks.

Cheers,
Gary.

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5,870
Credit: 115,696,570,042
RAC: 34,702,831

With BRP7 under control

With BRP7 under control (tasks reported, new work downloaded), I've just now reduced the work cache size to near zero on all O3AS hosts to prevent them from all asking simultaneously for lots of new work.  They currently seem to be running the old tasks and returning them without being able to get new work anyway.

Are you intending to try to start new O3AS work any time soon?  If you are, do you have any idea when?

The reason I ask is that I've written scripts to cache and deploy data files and skygrids so I'd like to use one machine to download and deploy to the others.  At the moment, all my GW hosts have old work still to complete that will last until late Sunday (UTC+10)  so if you were intending to restart GW work before Monday, it would be good to know roughly when that might be.

Cheers,
Gary.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4,305
Credit: 248,664,033
RAC: 30,688

Gary Roberts wrote: Are you

Gary Roberts wrote:

Are you intending to try to start new O3AS work any time soon?  If you are, do you have any idea when?

Yes, on Monday latest.

BM

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5,870
Credit: 115,696,570,042
RAC: 34,702,831

OK, thanks.

OK, thanks.

Cheers,
Gary.

San-Fernando-Valley
San-Fernando-Valley
Joined: 16 Mar 16
Posts: 343
Credit: 9,097,773,455
RAC: 13,135,933

Bernd Machenschalk

Bernd Machenschalk wrote:

Gary Roberts wrote:

Are you intending to try to start new O3AS work any time soon?  If you are, do you have any idea when?

Yes, on Monday latest.

As already said in the original opening post ...

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.