Generic CPU discussion

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726764130
RAC: 2382801

George wrote:I'm not sure

George wrote:

I'm not sure how much 'paging' I'm doing, but I have my preferences for paging set at 75%.

How do you check for paging?

George,

I was inferring about the paging rate.

After you first start up windows 10 there is a period of very high disk activity that is usually associated with whatever anti-virus you are running.  You can see that in the task view tab.

Then things quiet down.

When I start up boinc mgr and watch the memory usage go up to 99% and then notice the disk activity go up and stay up. This happens reliably when I allow more than 15 E@H Gravity Wave tasks to run. I infer that I have paging activity.

I also see a system task that is using the HD a lot, and it not the anti-virus program, doing that HD activity.

There are probably more granular reporting solutions but this is good enough for Windows :)

Tom M

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

GWGeorge007
GWGeorge007
Joined: 8 Jan 18
Posts: 2816
Credit: 4613898868
RAC: 3494099

Tom M wrote: George

Tom M wrote:

George wrote:

I'm not sure how much 'paging' I'm doing, but I have my preferences for paging set at 75%.

How do you check for paging?

George,

I was inferring about the paging rate.

After you first start up windows 10 there is a period of very high disk activity that is usually associated with whatever anti-virus you are running.  You can see that in the task view tab.

Then things quiet down.

When I start up boinc mgr and watch the memory usage go up to 99% and then notice the disk activity go up and stay up. This happens reliably when I allow more than 15 E@H Gravity Wave tasks to run. I infer that I have paging activity.

I also see a system task that is using the HD a lot, and it not the anti-virus program, doing that HD activity.

There are probably more granular reporting solutions but this is good enough for Windows :)

Tom M

Tom,

Do you often start up your Windows computer?  I leave mine on 24/7 unless I make any changes in the BIOS/UEFI or letting Windows 10 update itself.

George

Proud member of the Old Farts Association

tullio
tullio
Joined: 22 Jan 05
Posts: 2118
Credit: 61407735
RAC: 0

I am running Rosetta@home on

I am running Rosetta@home on a Windows 10 PC with 24 GB RAM and have no problem. I am alternating it with WorldCommunityGrid tasks which are OpenPandemics, Mapping Cancer Markers, Africa Rainfall and others. I am getting many badges, up to Emerald, on WCG. They promised us a GPU version of OpenPandemics but so far I haven't got any. On the same PC I am running a Linux Virtual Machine with SuSE Tumbleweed, a development version, with kernel 5.11.2, frequently updated. This is enlisted in Science United, the only one I have left in Science United.

Tullio

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726764130
RAC: 2382801

George wrote:Tom, Do you

George wrote:

Tom,

Do you often start up your Windows computer?  I leave mine on 24/7 unless I make any changes in the BIOS/UEFI or letting Windows 10 update itself.

Infrequently.  The reason I mentioned the Anti-virus using the disk right after start up is to make clear that was NOT paging.

I have triggered high rates of paging/HD activity after I changed the maximum available tasks for GW by changing the "maxium_tasks" in the app_config.xml file.

And stopped them by dropping those tasks back to 15.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726764130
RAC: 2382801

tullio wrote: I am running

tullio wrote:

I am running Rosetta@home on a Windows 10 PC with 24 GB RAM and have no problem. I am alternating it with WorldCommunityGrid tasks which are OpenPandemics, Mapping Cancer Markers, Africa Rainfall and others. I am getting many badges, up to Emerald, on WCG. They promised us a GPU version of OpenPandemics but so far I haven't got any. On the same PC I am running a Linux Virtual Machine with SuSE Tumbleweed, a development version, with kernel 5.11.2, frequently updated. This is enlisted in Science United, the only one I have left in Science United.

Tullio

Hi,

I ended up with some Beta Openpandemics tasks from a "custom profile" in WCG because I had the "use gpu" if available listed on my custom profile for "work?".

I expect if you switched over to Gravity Waves on your CPU(s) you still would not run out of memory because you have 6-8 CPU's available.  I am running out of memory because I have 16 CPUs and 32 threads available.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

tullio
tullio
Joined: 22 Jan 05
Posts: 2118
Credit: 61407735
RAC: 0

I have no problem with

I have no problem with Einstein@home on this PC with its Intel i5 9400F CPU and a nVidia GTX 1650. I had problems with an nVidia GTX 1060 because it had only 3 GB Video RAM when GW GPU tasks required more than 3 GB Video RAM. The GTX 1650 has 4 GB Video RAM. I have watched the video on GW searches. I believe the first person to speak is Maria Alessandra Papa, but the video does not identify her.

Tullio

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726767463
RAC: 2383090

Tom M wrote: Keith Myers

Tom M wrote:

Keith Myers wrote:

Yes, the memory overcommitment at Rosetta when I first joined is what prompted me to upgrade from 16GB to 32GB.

But that still didn't solve the issue of overflowing into paging and virtual memory usage which ground the system to a complete halt being unresponsive.  Had to power reset the host to gain it back.

I stopped Rosetta on the PC's after that. Only running on the SBC now.

Looks like I can sustain 18 CPU tasks and 2 gpu tasks without getting the paging file too active.

I ended up down at 14-15 Gravity Wave CPU tasks.

This morning I installed the 64GB 4 stick memory kit.  It is a 3200Mhz kit specifically for Amd's but all the timing # are a little higher than the 32GB ram was.

26 CPU threads caused the utilization of the CPU to run between 98%-100% with too many times spent at 100%. Dropped it to 25 CPU threads and now everything seems to be chugging along.

So far it is using 78% (50GB) of available memory.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726767463
RAC: 2383090

Tom M wrote:This morning I

Tom M wrote:

This morning I installed the 64GB 4 stick memory kit.  It is a 3200Mhz kit specifically for Amd's but all the timing # are a little higher than the 32GB ram was.

26 CPU threads caused the utilization of the CPU to run between 98%-100% with too many times spent at 100%. Dropped it to 25 CPU threads and now everything seems to be chugging along.

So far it is using 78% (50GB) of available memory.

The CPU processing has slowed significantly from under 5 hours to more than 10 hours.  I have lowered the CPU processing to 23 threads which provides a little more room at 93% utilization.

I may have to try to manually "tune" the ram to push the upper limits of its parameters beyond basic XMP.

Or revert to the "faster" (also 3200MHz) 32GB ram "kit".

Tom M

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726767463
RAC: 2383090

Tom M wrote: Tom M

Tom M wrote:

Tom M wrote:

This morning I installed the 64GB 4 stick memory kit.  It is a 3200Mhz kit specifically for Amd's but all the timing # are a little higher than the 32GB ram was.

26 CPU threads caused the utilization of the CPU to run between 98%-100% with too many times spent at 100%. Dropped it to 25 CPU threads and now everything seems to be chugging along.

So far it is using 78% (50GB) of available memory.

The CPU processing has slowed significantly from under 5 hours to more than 10 hours.  I have lowered the CPU processing to 23 threads which provides a little more room at 93% utilization.

I may have to try to manually "tune" the ram to push the upper limits of its parameters beyond basic XMP.

Or revert to the "faster" (also 3200MHz) 32GB ram "kit".

"The results" are "in".  If I reduce the processing to 15 cpu tasks again, the speed of the processing resumes running under 5 hours.  

That sounds like a cache limit issue?  The processing uses memory so heavily that you can't exceed the amounts kept in the cpu cache without slowing down the processing.

I will start walking the cpu thread count up.  I hope to be able to process more than 15 cpu tasks in a sub-5 hours range.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 5644
Credit: 7726767463
RAC: 2383090

Tom M wrote: "The results"

Tom M wrote:

"The results" are "in".  If I reduce the processing to 15 cpu tasks again, the speed of the processing resumes running under 5 hours.  

That sounds like a cache limit issue?  The processing uses memory so heavily that you can't exceed the amounts kept in the cpu cache without slowing down the processing.

I will start walking the cpu thread count up.  I hope to be able to process more than 15 cpu tasks in a sub-5 hours range.

I discovered that the "Open Resource Monitor" is reporting each GW cpu task is using 3 cpu threads.

I am able to run 10 Gravity Wave cpu tasks and a mix of 8 World Community Grid tasks without slowing down the Gravity Wave tasks.  The GW tasks have resumed running at sub 5 hour ranges.

I guess the next step is to see how many WCG CPU threads can I run while keeping CPU utilization below 93% and not slowing the GW processing down.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.