Size of Workunit?

Ed1934158
Ed1934158
Joined: 10 Nov 04
Posts: 62
Credit: 14481483
RAC: 0
Topic 193559

What is the size of one workunit and what's the size of returning data?

Gary Roberts
Gary Roberts
Moderator
Joined: 9 Feb 05
Posts: 5887
Credit: 119418278948
RAC: 25904181

Size of Workunit?

Quote:
What is the size of one workunit and what's the size of returning data?

Sorry for the belated response but I've only just noticed your questions. If you ask technical or operational questions in "Cruncher's Corner" you are much more likely to have them noticed and answered in a timely manner.

The short answer to your first question is, "It depends what you mean ...". :-).

A "workunit" for this project is the combination of two identical "tasks" that are sent to the two separate computers that make up a quorum. Each task is extremely small. It's just a set of parameters that are fed to the science app when crunching starts.

Perhaps, rather than "workunit" you really mean "large data files", ie the data that the science app actually works on, according to the parameters specified in each task. Large data files are around 3MB each and they represent the actual data from the LIGOs (those whose filename starts with "h" come from the Hanford observatory and those starting with "l" come from Livingston. When you first start crunching, you receive a number of these files in adjacent frequency bands which are then used for hundreds of tasks until they are exhausted. In normal circumstances, your computer may be working on the one set of large data files for many weeks or months. Once they are exhausted, they will be automatically deleted and replacements from different frequency bands will be received.

As to your second question, the results from the calculation of a task are zipped up into a single file whose size is less than 100KB from the ones I've observed. Each time a task completes these results are sent back to the servers.

Cheers,
Gary.

Ed1934158
Ed1934158
Joined: 10 Nov 04
Posts: 62
Credit: 14481483
RAC: 0

RE: RE: What is the size

Message 79988 in response to message 79987

Quote:
Quote:
What is the size of one workunit and what's the size of returning data?

Sorry for the belated response but I've only just noticed your questions. If you ask technical or operational questions in "Cruncher's Corner" you are much more likely to have them noticed and answered in a timely manner.

The short answer to your first question is, "It depends what you mean ...". :-).

A "workunit" for this project is the combination of two identical "tasks" that are sent to the two separate computers that make up a quorum. Each task is extremely small. It's just a set of parameters that are fed to the science app when crunching starts.

Perhaps, rather than "workunit" you really mean "large data files", ie the data that the science app actually works on, according to the parameters specified in each task. Large data files are around 3MB each and they represent the actual data from the LIGOs (those whose filename starts with "h" come from the Hanford observatory and those starting with "l" come from Livingston. When you first start crunching, you receive a number of these files in adjacent frequency bands which are then used for hundreds of tasks until they are exhausted. In normal circumstances, your computer may be working on the one set of large data files for many weeks or months. Once they are exhausted, they will be automatically deleted and replacements from different frequency bands will be received.

As to your second question, the results from the calculation of a task are zipped up into a single file whose size is less than 100KB from the ones I've observed. Each time a task completes these results are sent back to the servers.


Thank you for your answer. I should have posted it in "Cruncher's Corner" but for some reason that I can't remember I posted it here. :)

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.