Progress metric

ForumsScience

cIclops
cIclops
Joined: 19 Feb 05
Posts: 26
Credit: 450
RAC: 0
Topic 187900

What would be the best metric to measure the project's progress towards the goal of detecting a pulsar signature in the LSC data?

--
searching for gravitational waves since 2005

cIclops
cIclops
Joined: 19 Feb 05
Posts: 26
Credit: 450
RAC: 0

Progress metric

> What would be the best metric to measure the project's progress towards the
> goal of detecting a pulsar signature in the LSC data?
>

As nobody has responded to this perhaps the question needs clarification.

Given that the aim of the Einstein@Home project is to detect a pulsar signature in the LSC data, how can the progress towards this be made visible?

My best guess is to display the percentage analysis complete of the total data set(s) and the number of detected candidate signals.

--
searching for gravitational waves since 2005

S_NL - Marleen
S@NL - Marleen
Joined: 18 Jan 05
Posts: 25
Credit: 802075
RAC: 379

You mean something like Seti

You mean something like Seti Classic has on its Current progress summary page?
Of course it will need to be adjusted, eg the "Check data integrity" step is not needed because BOINC already takes care of that.

But it would be nice to have something like:
1. Amount of data gathered (eg x hours of LIGO data) and number of WU's that can be generated from this
2. Number of WU's finished (validated WU's)
3. Number of candidate signals found

Of course there could be other and/or extra steps, that depends on how the data analysis is done.

debugas
debugas
Joined: 11 Nov 04
Posts: 170
Credit: 77331
RAC: 0

This thread more belongs to

Message 4334 in response to message 4333

This thread more belongs to Wish List section and not here to Science :)

As to the project progress - imagine that you gather sound signals from all over but leave to analyse it to someone else later. How can you estimate the progress ? Only formally by counting your WUs processed or the percentage of sky listened during given period of time

Iron Sun 254
Iron Sun 254
Joined: 25 Feb 05
Posts: 38
Credit: 55455
RAC: 0

While it may be possible to

While it may be possible to print out a list of potential pulsars found, I'm sure it's going to be a while before those signals can be verified through other means. It will probably be a while before any true numbers are available.

------------------------------------
There's a thin line between Genius and Insanity. That's where I live, baby!

THE SPACEPORT - The Other Side of Space

epros
epros
Joined: 21 Jun 05
Posts: 10
Credit: 23438
RAC: 0

Having read this thread, I

Having read this thread, I thought that the metric of progress would be really useful thing if its definition were sensible - not just about "how much hours wasted".

AFAIK the project tries to answer some question about the gravity waves. ANY definite answer ("yes" or "no") would be the project result. Presumably, we'l never get definite answer. But it's possible to estimate, how much credits we need to get 90% proof. It would be the real basis to measure current progress. Wouldn't it?

Ben Owen
Ben Owen
Joined: 21 Dec 04
Posts: 117
Credit: 6953163
RAC: 10794

Folks, and those on other

Folks, and those on other threads asking similar questions:

There has been a bit of silence on this for a while for several reasons.

(1) The labor shortage behind the scenes is getting more intense.

(2) There have been several scientific conferences lately, and many people are living in airports.

(3) Most importantly, we are trying to figure out various progress metrics for various audiences and timescales. The best sign of progress will be a technical paper for scientists accompanied by press releases for the public, but that's a while off. A shorter-term thing would be the "End of May" report, which will be like an informal conference paper; and you've probably figured out from the name that it's more work than we thought. Things like the "percentage of data analyzed" are trickier than they look - apparently the "Server Status" numbers that I pointed out in another thread don't necessarily translate to that, because due to server constraints a lot of things are done on the fly.

I don't really have a good answer yet, but I wanted to say that we haven't forgotten about this and we are paying attention to your suggestions. Can't promise on any of them because what is doable does not always map onto what is desirable, but more things are coming.

Hope this helps,
Ben

Czar Brent
Czar Brent
Joined: 20 Feb 05
Posts: 26
Credit: 860674
RAC: 0

RE: (1) The labor shortage

Message 4338 in response to message 4337

Quote:


(1) The labor shortage behind the scenes is getting more intense.

Things like the "percentage of data analyzed" are trickier than they look - apparently the "Server Status" numbers that I pointed out in another thread don't necessarily translate to that, because due to server constraints a lot of things are done on the fly.


If you need processor time to create the results I think I can spare some :)

WARNING! DiHydrogen MonOxide kills!

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.