All-Sky Gravitational Wave Search on O3 data (O3ASHF1)

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3956
Credit: 46875872642
RAC: 64468822

tasks are flowing again

tasks are flowing again

_________________________________________________________________________

Colin Haig
Colin Haig
Joined: 7 Mar 05
Posts: 7
Credit: 584528697
RAC: 2325697

Quick Question: O3ASHF1 -

Quick Question: O3ASHF1 - does it use more than 1 CPU (core, multithreaded, or hyperthreaded) ?

I'm trying to understand utilization, and am sometimes seeing utilitization implying it may be peaking at 3 cpus in use. I've optimized the GPU side, but am seeing run time vs cpu time that is not what I expect, and think I may have resource contention.

Bernd Machenschalk
Bernd Machenschalk
Moderator
Administrator
Joined: 15 Oct 04
Posts: 4312
Credit: 250502173
RAC: 34572

The app is technically

The app is technically multithreaded, but the second thread is just there to handle the communication with the BOINC client, it shouldn't use any noticeable CPU time. All scientific processing is done in a single (CPU) thread.

BM

pututu
pututu
Joined: 6 Apr 17
Posts: 63
Credit: 653417392
RAC: 7

Colin Haig wrote:Quick

Colin Haig wrote:

Quick Question: O3ASHF1 - does it use more than 1 CPU (core, multithreaded, or hyperthreaded) ?

I'm trying to understand utilization, and am sometimes seeing utilitization implying it may be peaking at 3 cpus in use. I've optimized the GPU side, but am seeing run time vs cpu time that is not what I expect, and think I may have resource contention.

 

Since you have a fast cpu (13900K), the cpu calculation portion is taking longer than what I'm expecting. See my old post here for linux system with AMD card but it should also be applicable for window system with Nvidia card. Are you running any other cpu projects also? I found that when I run cpu boinc projects with O3AS at almost 100% cpu utilization, I notice the cpu portion run time started to increase significantly. Suggest trying with less cpu total utilization and see how it goes first. Note if you set your cpu at default stock and only run O3AS in your system the cpu core clock may turbo boost to higher frequency when few cores are running, so may see a slight bump in speed vs running more cores.

 

One of your tasks such as this that you ran, the cpu calculation time took almost 13 mins (from 04:32:03 to 04:45:14). That's pretty long for 13900K.
 

2024-07-08 04:32:03.3487 (13400) [normal]: Finished main analysis.
2024-07-08 04:32:03.3487 (13400) [normal]: Recalculating statistics for the final toplist(s)...
2024-07-08 04:45:14.3890 (13400) [normal]: Finished recalculating toplist statistics.
2024-07-08 04:45:14.3890 (13400) [normal]: Finished in 1385.58 s with peak RAM usage: -1.0 MB on CPU '13th Gen Intel(R) Core(TM) i9-13900K'

Note: you can try to stagger each task when running multiple tasks per gpu but at some point in time, a few tasks will lose their stagger. Not sure in windows but on my linux system, I run 6 tasks per gpu and most of the time  I lose stagger on 2 or 3 tasks only.

Colin Haig
Colin Haig
Joined: 7 Mar 05
Posts: 7
Credit: 584528697
RAC: 2325697

pututu wrote: Since you have

pututu wrote:

Since you have a fast cpu (13900K), the cpu calculation portion is taking longer than what I'm expecting. See my old post here for linux system with AMD card but it should also be applicable for window system with Nvidia card.

Yes, I agree, CPU calc is taking quite a long time.  Thanks for the suggestions. I'm going to play with the load and the tasks processing to free up CPU and see what is actually going on.  Am wondering if cache is getting used up by one of the non-GPU tasks running.  I'll dial back CPU avaialbility and try to eliminate CPU-only tasks and see what happens.

pututu wrote:

Note: you can try to stagger each task when running multiple tasks per gpu but at some point in time, a few tasks will lose their stagger. Not sure in windows but on my linux system, I run 6 tasks per gpu and most of the time  I lose stagger on 2 or 3 tasks only.

Yeah, I found the same thing, after a while things sync'd up and so lost the advantage.

astro-marwil
astro-marwil
Joined: 28 May 05
Posts: 532
Credit: 646686543
RAC: 1115454

Hallo! For O3ASHF1d there

Hallo!

For O3ASHF1d there is work for 13 days only. That's pretty soon. Does it go on in any way?

Kind regards and happy crunching

Martin

GWGeorge007
GWGeorge007
Joined: 8 Jan 18
Posts: 3062
Credit: 4967817686
RAC: 1414659

astro-marwil

astro-marwil wrote:

Hallo!

For O3ASHF1d there is work for 13 days only. That's pretty soon. Does it go on in any way?

Kind regards and happy crunching

Martin

Like I said in your other post (Einstein@home >> Forums >>  about similar tasks, BRP4G and FGRP5, this is really no different.

As you can see, this shows a time period of one month where O3AS is dropping to virtually zero tasks, rarely actually zero, and then rebounds up to another fulfillment.

Again, I hope this helps.

George

Proud member of the Old Farts Association

GWGeorge007
GWGeorge007
Joined: 8 Jan 18
Posts: 3062
Credit: 4967817686
RAC: 1414659

astro-marwil

EDIT: Duplicate post deleted.

George

Proud member of the Old Farts Association

pututu
pututu
Joined: 6 Apr 17
Posts: 63
Credit: 653417392
RAC: 7

astro-marwil

astro-marwil wrote:

Hallo!

For O3ASHF1d there is work for 13 days only. That's pretty soon. Does it go on in any way?

Kind regards and happy crunching

Martin

Short term: as explained by GWGeorge007. 

Long term: This specific O3AS batch will continue until the frequency reaches 2000Hz. From what I can find the latest task issued is currently 1570.00Hz, so there is still a long way to go for this batch to reach its goal. We started at 1500.Hz back in late May, so in about 3 months or so, we have progressed by 70Hz. 

Filipe
Filipe
Joined: 10 Mar 05
Posts: 186
Credit: 406300184
RAC: 370728

Quote:Quote: Long term: This

Quote:
Quote:

Long term: This specific O3AS batch will continue until the frequency reaches 2000Hz. From what I can find the latest task issued is currently 1570.00Hz, so there is still a long way to go for this batch to reach its goal. We started at 1500.Hz back in late May, so in about 3 months or so, we have progressed by 70Hz. 

 

We are not even half way there yet...

If only one of the big GPU's cluster from Elon could help... :)

 

 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.