S5R2

ForumsCruncher's Corner

Bernd Machenschalk
Bernd Machenschalk
Joined: 15 Oct 04
Posts: 3620
Credit: 130182337
RAC: 63938
Topic 192598

Hi!

We're near the end of the intermediate S5RI run and thus about to start the long-awaited S5R2. Some properties of S5R2 still change faster than I can type and would be hopelessly outdated when you read them, but I'd like to give you some impression of what's more or less fixed now.

The "science run #5" of the LIGO instruments, or S5 for short, gives us not only the most sensitive data, but also the largest amount of data we ever had. This is very good in terms of science, as the sensitivity of the search for continuous signals increases with "observation time", i.e. the length of the data available.

However, with our present analysis tool, the computation time needed grows to the power of six over the amount of data. It's obvious that we need something more clever to deal with a larger amount of data, so we developed a new program which we call "Hierarchical Search". The basic idea is to first scan the parameter space with a coarse "grid" and then only take a closer look at the areas that have been detected as interesting, in a "follow-up stage". The current code is designed to do only the first stage, it had not been decided yet if we will do a follow-up stage on Einstein@Home as well or e.g. on LSC clusters.

The application we'll use for this run is all new and has never been used before. The algorithm used in the old App is still a part of the new one, and other parts have also been used before, but they have never been used in the present combination, and in particular not in a distributed computing project of that scale. We expect some problems to arise from this.

One of the issues we are still working on is some "overhead", i.e. calculations that are performed for technical reasons, but don't actually contribute to the result, thus wasting computing power.

We therefore will set up S5R2 as a short, experimental run that limits the search to parts of the parameter space where the overhead is well under control. During this short run we will improve the Application in various aspects. The results will also help us tuning the parameters for the next, larger run (probably named S5R3).

With the amount of data to be analyzed, however, also grows the amount of data to be downloaded to your machines. To save bandwidth both on your and on our side, we developed a new scheme for data files. They are split into small files of about 3MB in size (that are somewhat re-combined in the App). When there is no more work available for the data files you already have on your machine, the scheduler will try to assign work to your host that minimizes the number of files you have to download, so you should in most cases get away with a new download of only two files (~6MB).

However, a complete set of files (that will be used for many tasks you get) can consist of up to 10 files, so the initial download can be more than 40MB (including the Application and other data files that need to be downloaded only once per run). This might be not suitable for dial-up / modem users anymore.

We are running out of S5RI work, and thus as usual your clients will have to download a new data file for only a few workunits anyway, so modem users: beware.

We expect to issue the first hundrets of S5R2 Workunits some time tomorrow.

At the beginning Apps will be available only for our major platforms (Windows-x86, Linux-x86, MacOS-PPC and MacOS-x86); other platforms will follow with time. I hope to get the Apps finished before the last results of S5RI are sent out.

BM

BM

B-Roy
B-Roy
Joined: 22 Jan 05
Posts: 16
Credit: 89623
RAC: 0

S5R2

This sounds all very well to me, except that one part confuses me:
"At the beginning Apps will be available only for our major platforms (Windows-x86, Linux-x86, MacOS PPC and Intel); other platforms will follow with time."
Does this mean that AMD won't be supported from the beginning, that it won't be optimised for AMD, or is it something completely different you meant? Sorry if I am totally confused - I just woke up from a small nap to be honest.

Bernd Machenschalk
Bernd Machenschalk
Joined: 15 Oct 04
Posts: 3620
Credit: 130182337
RAC: 63938

RE: This sounds all very

Message 62071 in response to message 62070

Quote:
This sounds all very well to me, except that one part confuses me:
"At the beginning Apps will be available only for our major platforms (Windows-x86, Linux-x86, MacOS PPC and Intel); other platforms will follow with time."
Does this mean that AMD won't be supported from the beginning, that it won't be optimised for AMD, or is it something completely different you meant? Sorry if I am totally confused - I just woke up from a small nap to be honest.


Sorry, should read as edited ... MacOS-PPC and MacOS-x86. The "Intel" belonged to MacOS only.

BM

BM

Constantinos
Constantinos
Joined: 16 May 05
Posts: 39
Credit: 938201
RAC: 0

Thank you for the

Thank you for the information. Can't wait to get new work from S5R2!

regards

Constantinos

Gravity increases significantly in Autumn, because apples fall in large numbers during that time!

Svenie25
Svenie25
Joined: 21 Mar 05
Posts: 139
Credit: 2436862
RAC: 0

RE: We therefore will set

Quote:

We therefore will set up S5R2 as a short, experimental run that limits the search to parts of the parameter space where the overhead is well under control. During this short run we will improve the Application in various aspects. The results will also help us tuning the parameters for the next, larger run (probably named S5R3).

Tahnks a lot for these informations Bernd. Sounds very interesting and I waiting for the first new WUs.
But one question is left for me. Will S5R2 be as short as the actual run or even shorter?

MfG
Sven S. aus G.

Alinator
Alinator
Joined: 8 May 05
Posts: 927
Credit: 9352143
RAC: 0

Thanks for the update

Thanks for the update Bernd.

All I can say is line them up, we'll knock them back down the church steps for you. ;-)

Also, it probably won't be quite so dead in the forums now, for a change. :-)

Alinator

Bernd Machenschalk
Bernd Machenschalk
Joined: 15 Oct 04
Posts: 3620
Credit: 130182337
RAC: 63938

RE: But one question is

Message 62075 in response to message 62073

Quote:
But one question is left for me. Will S5R2 be as short as the actual run or even shorter?


I'm not sure I get the question right, but anyway: It's hard to tell right now. Currently we think of S5R2 being in the same ballpark as the finishing S5RI run (few months), and S5R3 will probably be designed for about the same length as S5R1 (6-12 months). But we're still playing with some parameters, and though we expect to speed up the Application during the run it's hard to predict when and to which extend we'll achieve this, which will have a large impact on the run time.

BM

BM

Haos.PL
Haos.PL
Joined: 17 Feb 05
Posts: 16
Credit: 24505
RAC: 0

Well, me i`m ready:) Bring

Well, me i`m ready:) Bring `em on.

BTw one question: is any action necessary to switch for S5R2? Or will the transition happen automaticly?

Boinc_Master_4
Boinc_Master_4
Joined: 15 Apr 07
Posts: 60
Credit: 2130
RAC: 0

RE: Also, it probably

Message 62077 in response to message 62074

Quote:


Also, it probably won't be quite so dead in the forums now, for a change. :-)

Alinator

Well, our BT Retired Club is on the way to swopping over to Einstein.

We'll chat if you will!

Mrs Miggins - A lady of uncommon refinement

Annika_2
Annika
Joined: 8 Aug 06
Posts: 720
Credit: 494410
RAC: 0

This sounds very interesting,

This sounds very interesting, I can hardly wait for the new run, either. I hope the new app will be a bit nicer to Intel boxes ;-) since I got myself such a nice dual core. As for the chatting: Sounds good!

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1119
Credit: 197640600
RAC: 272127

should happen automatically

should happen automatically unless you've installed a beta app and have an app_info.xml file. This can only happen deliberately so if you don't know what I'm talking about you're safe.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.