HELP Requested for another project...
27 Apr 2012 11:49:11 UTC
Topic 196296
(moderation:
HOWDY Einstein Developers!!! I am asking HELP from you on hehalf of another NEW Alpha project.
I've always noticed Einstein downloads 8 files per machine WU and they seem to run serially... Those 8 *.bin4 files and a .zap file.
Another project has a problem with throughput because they have WU's that require from 2.2 to 8Gig memory each to run. However, these task run on a CPU and take from 1.9 to 11 minutes.
The Question I ask is: Can you show them how you bundle and run 8 files serially into one WU? In their case, they could benefit by running 10 or 20 tasks serially as one WU.
The project name is Neurona@Home
Thanks!
8-)
HELP Requested for another project...
)
This is not a general BOINC feature, it requires modifications of basically all project-specific components.
- Make the workunit generator produce such "bundled" workunits, e.g. by grabbing a group of input files at a time from a pool
- Add an "outer loop" to the application that allows to process n input files, one after the other, producing n output files
- Return these n output files as n files of a single result. This involves constructing a "result template" for the transitioner with the correct number of result files.
- Make the validator check / compare the results by pairwise checking / comparing all result files, probably by also adding a loop over all files of the results
- In our case we modified our assimilator to rename the result files to look like these had been processed as individual workunits. Depending on what the assimilator is supposed to do and what is further done with the results on that project, this might not be necessary there.
I don't think that thers is more general advice to give, it really depends on their project-specific code.
BM
BM
Thank you! 8-)
)
Thank you!
8-)