Preparing S5R4 - No new Apps for S5R3

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4,023
Credit: 213,950,003
RAC: 41,593
Topic 193710

Hi!

The S5R3 Apps have become much faster and more reliable and we even gained some more computing power from more and newer machines in past months. The Workunit Generator where the overall run progress on the server status page is derived from doesn't know about that and its predictions still average over the whole run, so are slightly off. According to internal statistics the last Workunits of S5R3 will be generated in the first days of August.

Therefore the Einstein@home development team has begun to prepare the next run "S5R4", which will include the remaining data from S5 that wasn't available when we started the previous S5 searches (that much we know yet - the data that will actually be used will be chosen from the whole S5 data in the next few weeks).

In particular this means that the development of the Einstein@home Applications will now focus on what is needed for S5R4, there will probably be no more new Apps for S5R3.

Some details for the techs: The "Fstat" engine will stay the same, with all optimizations achieved so far. In the "Hough" code we'll probably switch on the "weights", which might need some adaption of the optimizations done to the "weightless" code. Some more columns with additional (statistical) information about the "candidates" will be added to the result file. This will probably slightly increase the size of the files sent back to the server, and that of the checkpoint files, too. We're discussing measurements to average out the runtime differences visible in the current workunits in the workunits themselves by splitting the sky among them differently from the way we do it now.

BM

BM

th3
th3
Joined: 24 Aug 06
Posts: 208
Credit: 2,208,434
RAC: 0

Preparing S5R4 - No new Apps for S5R3

Great news, i been waiting for the next run a long time already, R3 is already old an boring anyway =)

I guess im not the only one who want to know this: When will the first S5R4 WUs reach our computers?

[AF>Futura Sciences]click
[AF>Futura Scie...
Joined: 12 Apr 05
Posts: 34
Credit: 1,923,040
RAC: 0

Hi ! RE: I guess im

Message 82080 in response to message 82079

Hi !

Quote:

I guess im not the only one who want to know this: When will the first S5R4 WUs reach our computers?

Maybe a clue here =>

Quote:

According to internal statistics the last Workunits of S5R3 will be generated in the first days of August.

Quite safe to assume S5R4 crunching will start around the same date, i think.

Quote:

In particular this means that the development of the Einstein@home Applications will now focus on what is needed for S5R4, there will probably be no more new Apps for S5R3.

Fair enough ! :D

Quote:

We're discussing measurements to average out the runtime differences visible in the current workunits in the workunits by splitting the sky among them differently from the way we do it now.

Good news and ...bad news :D

Good news for those complaining about credits, for the scheduler seeing an increase in WUs "abort by user"...

Bad news for all those who had fun with it ;)
Richard, Archae, Astro, Peanut... data mining tons of logs, Bikeman slicing an orange while scratching his head (trust me, i tried, quite tricky to do :D ), Gary and Bikeman writing sweet scripts to log data's, Mike writing awesome tools
...

But I'm sure we'll find a way to have fun with the new "sky slicing" anyway !
Even old child's enjoys new toys.

Cheers,
Alex.

God created a few good looking guys.. and for the rest he put hairs on top..

th3
th3
Joined: 24 Aug 06
Posts: 208
Credit: 2,208,434
RAC: 0

Thats fair enough [AF>Futura,

Thats fair enough [AF>Futura, but... My concern was more for the word "generated", "sent out" could be very different. And then there is overlap, R4 could start before the majority of remaining R3 WUs are sent out.

Mats Nilsson
Mats Nilsson
Joined: 10 Dec 05
Posts: 94
Credit: 15,011,147
RAC: 0

Is there a chance that the

Is there a chance that the latest beta for windows will become official.It would certanly increase computing speed to take use of all SSE capable mashine that still runs stock app.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4,023
Credit: 213,950,003
RAC: 41,593

RE: I guess im not the only

Message 82083 in response to message 82079

Quote:
I guess im not the only one who want to know this: When will the first S5R4 WUs reach our computers?


Planned is a smooth transition as we did before, i.e. the first new WUs should be delivered before we run out of old ones.

Quote:
Is there a chance that the latest beta for windows will become official.It would certanly increase computing speed to take use of all SSE capable mashine that still runs stock app.


Good point. I'll take a look at the results & statistics of this App once I find the time.

Bad thing is that with the current old server-side code even publishing "APIv6" Apps (and some other maintenance) has become really tricky, and a complete upgrade - which has been on my todo list for quite a while - apparently will get delayed even further due to the work on S5R4.

BM

BM

Rapture
Rapture
Joined: 25 Jun 07
Posts: 22
Credit: 4,895,883
RAC: 4,570

RE: The S5R3 Apps have

Quote:


The S5R3 Apps have become much faster and more reliable and we even gained some more computing power from more and newer machines in past months. The Workunit Generator where the overall run progress on the server status page is derived from doesn't know about that and its predictions still average over the whole run, so are slightly off. According to internal statistics the last Workunits of S5R3 will be generated in the first days of August.

Therefore the Einstein@home development team has begun to prepare the next run "S5R4", which will include the remaining data from S5 that wasn't available when we started the previous S5 searches (that much we know yet - the data that will actually be used will be chosen from the whole S5 data in the next few weeks).

In particular this means that the development of the Einstein@home Applications will now focus on what is needed for S5R4, there will probably be no more new Apps for S5R3.

Some details for the techs: The "Fstat" engine will stay the same, with all optimizations achieved so far. In the "Hough" code we'll probably switch on the "weights", which might need some adaption of the optimizations done to the "weightless" code. Some more columns with additional (statistical) information about the "candidates" will be added to the result file. This will probably slightly increase the size of the files sent back to the server, and that of the checkpoint files, too. We're discussing measurements to average out the runtime differences visible in the current workunits in the workunits by splitting the sky among them differently from the way we do it now.

That is great news! I did notice recently that the estimated completion date for this current run is ahead of schedule. It was originally thought to be done by the end of this year.

Are there any news regarding the physical upgrade of the instruments?

Mike Hewson
Mike Hewson
Moderator
Joined: 1 Dec 05
Posts: 6,204
Credit: 134,962,579
RAC: 37,182

RE: Bad news for all those

Message 82085 in response to message 82080

Quote:
Bad news for all those who had fun with it ;)
Richard, Archae, Astro, Peanut... data mining tons of logs, Bikeman slicing an orange while scratching his head (trust me, i tried, quite tricky to do :D ), Gary and Bikeman writing sweet scripts to log data's, Mike writing awesome tools
...

Won't stop me writing tools! I have a 'cradle' for development now anyway, and have learnt alot to boot. :-)

Won't stop anyone else either, I dare say .... if the 'cyclic' behaviour is lost/diminished/whatever, we'll find something else to focus on! :-)

Might I add - for any current or potential users - that the pleasant dynamic that exists at E@H between the project management/developers and the user base here is superb and represents an 'emergent' trend likely not originally predicted. Keep it up! :-)

Cheers, Mike.

I have made this letter longer than usual because I lack the time to make it shorter. Blaise Pascal

ExtraTerrestrial Apes
ExtraTerrestria...
Joined: 10 Nov 04
Posts: 769
Credit: 292,525,151
RAC: 411,560

Hi Bernd, thanks for keeping

Hi Bernd, thanks for keeping us informed and thanks for the good work, by the way ;)

Regards, MrS

Scanning for our furry friends since Jan 2002

archae86
archae86
Joined: 6 Dec 05
Posts: 3,001
Credit: 4,769,765,197
RAC: 3,605,672

RE: RE: We're

Message 82087 in response to message 82080

Quote:
Quote:

We're discussing measurements to average out the runtime differences visible in the current workunits in the workunits by splitting the sky among them differently from the way we do it now.

Good news and ...bad news :D

Good news for those complaining about credits, for the scheduler seeing an increase in WUs "abort by user"...

Bad news for all those who had fun with it ;)
Richard, Archae, Astro, Peanut... data mining tons of logs, Bikeman slicing an orange while scratching his head (trust me, i tried, quite tricky to do :D ), Gary and Bikeman writing sweet scripts to log data's, Mike writing awesome tools.

This point is good news from my point of view, no bad. The runtime differences have been a real obstacle to some potentially important comparisons--we've had a continuing stream of posts by people making inappropriate comparisons of aps and platforms, and often broadcasting wrong conclusions. I'm not sure how much actual harm that caused, but at the least it was a substantial noise factor.

For those who pay attention to credits, the considerable variation in "pay equity" over appreciable periods of time has been a distraction as well.

While playing with data can be fun, I'm really only interested when there are potential beneficial consequences. Here, specifically, I hoped that my bit--some contribution to empirical curve-fitting models, and lots of graphs--might in the short term reduce noise in posted comparisons, and perhaps therefore help a few people make better ap choices. In the medium term my highest hope was that the project might iron out much of the credit vs. actual work done variation.

That they are intending to do so is good, whether or not my posts nudged them along in any way.

[AF>Futura Sciences]click
[AF>Futura Scie...
Joined: 12 Apr 05
Posts: 34
Credit: 1,923,040
RAC: 0

RE: Won't stop me writing

Message 82088 in response to message 82087

Quote:

Won't stop me writing tools! I have a 'cradle' for development now anyway, and have learnt alot to boot. :-)

Hehe.
And you did really good !
I'm sure we are many to wait for your next release of RR.
But don't hurry if you have other priorities, this is a long shot.
We have data logs to play wth, even if the release is after S5R3 end.

Quote:

Won't stop anyone else either, I dare say .... if the 'cyclic' behaviour is lost/diminished/whatever, we'll find something else to focus on! :-)

At least we will try to find some :D
The fun is in searching, not only in having results.

Quote:

Might I add - for any current or potential users - that the pleasant dynamic that exists at E@H between the project management/developers and the user base here is superb and represents an 'emergent' trend likely not originally predicted. Keep it up! :-)

Surely, EAH is somehow apart in the BOINC world.
A lot of interesting people here, and a nice relationship with devs and science.

Quote:

This point is good news from my point of view, no bad. The runtime differences have been a real obstacle to some potentially important comparisons--we've had a continuing stream of posts by people making inappropriate comparisons of aps and platforms, and often broadcasting wrong conclusions. I'm not sure how much actual harm that caused, but at the least it was a substantial noise factor.

For those who pay attention to credits, the considerable variation in "pay equity" over appreciable periods of time has been a distraction as well.

While playing with data can be fun, I'm really only interested when there are potential beneficial consequences. Here, specifically, I hoped that my bit--some contribution to empirical curve-fitting models, and lots of graphs--might in the short term reduce noise in posted comparisons, and perhaps therefore help a few people make better ap choices. In the medium term my highest hope was that the project might iron out much of the credit vs. actual work done variation.

That they are intending to do so is good, whether or not my posts nudged them along in any way.

It was not aim to be taken seriously.
Off course it will be a nice improvement ;)
I just hope it won't make the science run analysis more difficult for the team, for example to compare one run to another.
Of course they now what they are doing, and they have the bigger picture.

And be sure my concern match yours. All that matters here is science.
Your analysis from R3 run, enlighten for sure a side effect of the initial sky splitting. And the project might benefit from it.

With the recent ref-app BernD issued, it was not crucial as it could have been for testing new apps, but no-doubt it's an improvement ! ;)

Cheers,
Alex.

God created a few good looking guys.. and for the rest he put hairs on top..

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.