upcoming GW run S6Bucket (was S6GC1)

DanNeely
DanNeely
Joined: 4 Sep 05
Posts: 1,323
Credit: 1,797,042,066
RAC: 821,411

RE: * Also under

Quote:
* Also under investigation is whether and how to possibly add a "vetoing" already in the application that could filter out e.g. known instrumental artifacts. Currently this is done later in post processing. As a limiting factor on the sensitivity of the search is the number of candidates we can send back from the clients, eliminating candidates before sending them back might therefore increase the sensitivity of the search, too. One unwanted side-effect of this vetoing would be that the run-time of a given task becomes data-dependent and less predicable.

How many of the 10k results returned are typically rejected as instrument noise on the server?

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 3,956
Credit: 203,596,974
RAC: 29,940

RE: How many of the 10k

Quote:
How many of the 10k results returned are typically rejected as instrument noise on the server?

In principle after the tasks were processed by Einstein@home all candidates are thrown into larger pools of frequency bands, then these pools are filtered by various criteria.

Instrumental lines that are known at the time of data preparation (i.e. when the data files for E@H processing are produced) are already removed from the data at that time, but usually a couple of noise sources and processing artifacts are discovered later by processing the detector data in various pipelines.

It's pretty hard to break this down to individual tasks. I'd guess the overall "reject rate" due to instrumental noise might be 1 in 10.000, which would mean one per task on average. But don't count on my rough guess, read the paper when it's published (this may take a while, though).

BM

BM

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 3,956
Credit: 203,596,974
RAC: 29,940

RE: Would you like to the

Quote:
Would you like to the uninitiated simply explain what this new application, thank you!?

Sorry, could you rephrase your question?

BM

BM

[AF>EDLS] Polynesia
[AF>EDLS] Polynesia
Joined: 1 Apr 09
Posts: 24
Credit: 2,273,003
RAC: 0

RE: RE: Would you like to

Quote:
Quote:
Would you like to the uninitiated simply explain what this new application, thank you!?

Sorry, could you rephrase your question?

BM


I ask if you can explain what this new application of a simple, thank you

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 3,956
Credit: 203,596,974
RAC: 29,940

The "S6Bucket" application is

The "S6Bucket" application is essentially the same as what we were using since S5GCE. The main difference is not in the application, but in the data that we search for gravitational waves. Previously we used data from the fifth science run of the LIGO instruments (hence the "S5" at the beginning). For S6Bucket we are using data from the sixth science run.

The usable data from S6 is way fewer than what we could use from S5. So searching S6 data lowers the requirements for download volume, disk space and application memory compared to previous runs.

A slight change that you might also notice is some delay at the end of a task. The application will keep running for a few minutes after it reached the 100% mark. During this time we are doing some smaller calculations ("LineVeto") that we may use in a future run to increase the sensitivity. Currently this is experimental and only done for verification of the algorithm.

Another, even more technical issue is that the "incoherent" part of the application code has been sped up a lot (roughly by a factor of four) due to vectorization that Bikeman did for us. Due to the setup of the new workunits, the overall runtime of a S6Bucket task should still be roughly the same as what you are used to from S5GC1HF. But if you would calculate a S5GC1HF task with the S6Bucket application, you would notice quite a speedup.

Does this answer your question?

BM

BM

G CRUZILLE
G CRUZILLE
Joined: 15 Jun 11
Posts: 2
Credit: 102,038
RAC: 0

I wonder how are used the

I wonder how are used the calculated data of my computer.
My quad-core CPU turns in 100% with the GPU..24h/24h. Every 4 tasks are calculated in 18 hours
I would like to know if discoveries were made

I do not use my PC, but it warms the house And the ventirad shouts in the scandal
i hope it is usefull ...

Best regards

robertmiles
robertmiles
Joined: 8 Oct 09
Posts: 125
Credit: 6,345,436
RAC: 0

RE: A slight change that

Quote:

A slight change that you might also notice is some delay at the end of a task. The application will keep running for a few minutes after it reached the 100% mark. During this time we are doing some smaller calculations ("LineVeto") that we may use in a future run to increase the sensitivity. Currently this is experimental and only done for verification of the algorithm.

BM

An idea to consider: Calculate the average percentage of the work done before the LineVeto section starts. Then have the main section of the application reach only a progress corresponding to this percentage, and write a final checkpoint before the LineVeto section starts. The LineVeto section can then jump to 100% progress when it finishes, if it does not have checkpoints.

G CRUZILLE
G CRUZILLE
Joined: 15 Jun 11
Posts: 2
Credit: 102,038
RAC: 0

when i suspends the works,

when i suspends the works, those who are ready to validate are not sent

Why ?

thanks

Grutte Pier [Wa Oars]~GP500
Grutte Pier [Wa...
Joined: 18 May 09
Posts: 39
Credit: 5,805,678
RAC: 712

I noticed the s6bucket use

I noticed the s6bucket use allot less memmory, that's nice.
Also the write to disk feels less.

This is rlly an issue with dual triple quadcore , because you double triple quadruple the memmory then.

Ps: we hear some discoveries with the binary project, not with this project witch is to understand.
But how about some technical updates

robertmiles
robertmiles
Joined: 8 Oct 09
Posts: 125
Credit: 6,345,436
RAC: 0

RE: when i suspends the

Quote:

when i suspends the works, those who are ready to validate are not sent

Why ?

thanks

It may be waiting for you to click on the Update button, or simply wait for the normal time to return the more slowly completed workunits.

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.