Possible conflict between pref settings for "Run test Apps" and "Run selected Apps"

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5872
Credit: 117675759298
RAC: 35140180
Topic 198406

Maybe the behaviour I observe is intended - I hope not! :-).

I have "Run test apps" enabled because I'm willing to try out new versions. I use the "Run selected apps" to choose which particular Science runs I participate in. Until FGRPB1 appeared, the only selected runs were BRP6 and FGRP4. FGRPB1 was auto-selected when added to the list and I'm fine with that. I expected that.

I got 10 tasks all told from the very first batch of 100 FGRPB1. They were announced as beta test tasks. At that point, I wanted to see how this first lot went before allowing more so I removed the selection for FGRPB1 on all 4 venues, thinking that would prevent any further tasks. There has been a further, somewhat larger release of tasks. I presume they are a continuation of the beta test. I was surprised to see a further 90 tasks arrive even though I had deselected the run.

I don't really have a problem with this (since nothing bad happened) but I was hoping to be able to better control the take up of the first (test) tesks in a new run without risking the whole fleet if something goes wrong :-). I thought I'd done rather well by having only about 5 machines running the first batch. I've now got a very much larger number of hosts crunching away :-).

For future reference, I'd like to know if 'allowing test apps' applies to any science run (selected or not) or should I be able to restrict it by 'turning off' the selection of a particular run? Perhaps I stuffed up in some way in how I deselected FGRPB1. My project pref settings still show that box as clear (no tick mark). I expected the removal of the tick (which was well before the 2nd bigger release) would have prevented any more than the original 10 tasks.

Cheers,
Gary.

archae86
archae86
Joined: 6 Dec 05
Posts: 3157
Credit: 7225334931
RAC: 1042955

Possible conflict between pref settings for "Run test Apps" and

How about the timing of your change to the preference, vs. host updates?

I think when this system is working as intended, a revised task selection preference does not take effect until after the next host update, which leaves a window of opportunity for a work request by your host to get filled under the old rules before the revision takes effect.

You have a large fleet, and perhaps as an efficiency minded guy you have your communication settings at values which discourage excessively frequent updates. Could it be that all the hosts that got this work got it on their very next update communication?

If that is not it, then it sounds to me as though there is a bug somewhere.

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5872
Credit: 117675759298
RAC: 35140180

RE: ... a revised task

Quote:
... a revised task selection preference does not take effect until after the next host update ...


You might be correct but I thought that since the change was made on the website, the scheduler would have immediate access to the changed settings. Subsequently, a client making a work request communicates with the server and the scheduler sees a request for X amount of CPU work. The scheduler presumably consults the preferences to see which type of CPU work it is allowed to send. Because of what gets transmitted with a work request, it is effectively an 'update' anyway.

Quote:
... Could it be that all the hosts that got this work got it on their very next update communication?


I don't think so. Under script management, every host gets it's work cache settings temporarily increased and then returned to normal every ~3.5 hours. Most often this triggers a project communication for work fetch. My recollection is that the FGRPB1 run was turned off more than 12 hours before the second release of FGRPB1 tasks was made - plenty of time for individual hosts to have been forced into a project communication.

Quote:
If that is not it, then it sounds to me as though there is a bug somewhere.


Or it's intended that agreeing to beta test work means that you could get such tasks from any science run, irrespective of whether or not you have selected a particular run. I don't mind if this is the case. I'd just like to be aware of it for future reference.

Cheers,
Gary.

Christian Beer
Christian Beer
Joined: 9 Feb 05
Posts: 595
Credit: 188494547
RAC: 223126

Gary: I'm not sure how this

Gary: I'm not sure how this works right now. I have to look in the Code or ask Bernd on Monday. My personal hunch would be that if you select Beta apps and there is a Beta app, than the app selection preference is ignored. Just like you experienced.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4312
Credit: 250563602
RAC: 34327

RE: Gary: I'm not sure how

Quote:
Gary: I'm not sure how this works right now. I have to look in the Code or ask Bernd on Monday. My personal hunch would be that if you select Beta apps and there is a Beta app, than the app selection preference is ignored. Just like you experienced.

My recollection of the code - at least the one currently running on Einstein - is the same: When checking that a given app can be send to a client and the app is a Beta app, it is only checked whether the owner of the client as agreed to receive "Beta" work, and not further whether is is in the list of allowed apps.

Good or bad, that's how the code currently works.

BM

BM

Richard Haselgrove
Richard Haselgrove
Joined: 10 Dec 05
Posts: 2143
Credit: 2958886193
RAC: 711948

RE: ... but I thought that

Quote:
... but I thought that since the change was made on the website, the scheduler would have immediate access to the changed settings. ...


Sorry, I saw this this morning and meant to reply, but as always real life intervened.

Strangely, the same question came up at SETI a week ago, and I tried to answer it in SETI message 1760307. Perhaps it would be helpful to repeat it here - you'll need to translate application names, but the rest should be applicable.

Quote:

There are lots of preferences available in the venue settings, but let's just talk about two groups.

Hardware: CPU / ATI / NVidia / intel
Software: SaH_v7 / AP / SaH_v8 / other apps

I think they work in different ways.

The 'software' group seem to work directly on the server - they take effect immediately after you update the website.

The 'hardware' group work by sending a message back to your computer, which only takes effect for the next work request. That's because requesting work, and sending messages about preferences, use the same 'update' mechanism. The 'click update' suggested on the website for activating new preferences:

Quote:
Your preferences have been updated, and will take effect when your computer communicates with SETI@home or you issue the Update command from the BOINC Manager.

can also be a work request, and will use the old hardware preferences (because the message about the change hasn't been received yet).

The strange thing (and this is perhaps one for Jord to look into) is that I seem to remember that when this mechanism was introduced, it was stated that the 'hardware' group changes would be acted on by the server too: even if the client requested work for CPU, it wouldn't be sent if that option had been deselected in preferences.

It's that inconsistency which causes confusion such as this thread. It's easy to work round - just issue a single 'update' with No New Tasks set to transfer the settings, and then go back to normal - but it's an extra thing to remember, and seems unnecessary.


So, my understanding is that if you have long-standing preferences that exclude particular hardware types, you should never get an unexpected work allocation for an application which uses that hardware - because your client will have requested zero seconds of work.

But if you allow work for the hardware, and you allow Beta applications, you may sometimes be surprised by work for a new Beta application you hadn't specifically selected.

The SETI thread meandered on a bit further, but ended with this rhetorical exchange:

Quote:
Quote:
It's as Richard said it would be, first need to have the reply from the server back in before the next work request will follow the preferences you set.

Which raises the question: why does the server have to wait until the client tells it back again what the server already knows?

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.