All things Nvidia GPU

GWGeorge007
GWGeorge007
Joined: 8 Jan 18
Posts: 2997
Credit: 4926044438
RAC: 129282

Tom M

This is why I normally re-paste my GPU's in 2-3 yrs.

George

Proud member of the Old Farts Association

David Crick
David Crick
Joined: 8 Aug 24
Posts: 7
Credit: 2620053
RAC: 10738

Just a note to say that the

Just a note to say that the rpmfusion packaged Nvidia rpms for Fedora Linux release distros have been upgraded to the latest 560.35.03 version (from the previously available 555.58.02).  No improvement in run time, but it's nice to be on the latest drivers.

Compared to the Linux driver available directly from Nvidia's web site, rpmfusion takes care of additional installation tasks such as disabling the nouveau driver, and indeed Nvidia themselves note: "many Linux distributions provide their own packages of the NVIDIA Linux Graphics Driver in the distribution's native package management format. This may interact better with the rest of your distribution's framework, and you may want to use this rather than NVIDIA's official package."  Install guide here: https://rpmfusion.org/Howto/NVIDIA

On my 2080 Super I can solo crunch 4 O3AS WUs in an hour compared to 3 an hour in Windows, so it's worth having a Linux installation - even a scratch one on a USB stick.  Linux also seems to handle running CPU tasks at the same time as GPU tasks better than Windows - a GPU O3AS WU completed in around half the time for me in Linux with all CPU cores also running CPU tasks compared to in Windows.

I've NOT seen the 1.14 (gpu-recalc) application used for any of my WUs - only 1.15 (cuda, cpu re-calc).  There is a slight improvement in run-time with 1.15 CUDA over the 1.07 opencl application.  In order to get 1.15 you need to allow beta/test applications in your E@H web account: Preferences -> Project -> Run test applications? YES.

 

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6258
Credit: 8922053658
RAC: 10425619

Thank you for the info.

Thank you for the info.

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6258
Credit: 8922053658
RAC: 10425619

I am getting the impression

I am getting the impression that these really high performance AI oriented GPU's are not quite so hot in the type of crunching we do?

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3913
Credit: 43790129309
RAC: 63463836

Tom M wrote: I am getting

Tom M wrote:

I am getting the impression that these really high performance AI oriented GPU's are not quite so hot in the type of crunching we do?



"It depends", as always. sometimes yes, sometimes no. really depends which GPU you're referring to.

_________________________________________________________________________

Boca Raton Community HS
Boca Raton Comm...
Joined: 4 Nov 15
Posts: 233
Credit: 9525518920
RAC: 23315398

Tom M wrote:I am getting

Tom M wrote:

I am getting the impression that these really high performance AI oriented GPU's are not quite so hot in the type of crunching we do?

 

Those really expensive accelerators (H100, A100, Bx00) focus more on low precision computation since that is the direction AI and machine learning went/is going. That being said, they would still be AMAZING at fp32 work here but that is not where they "shine". 

I still want one (or eight) though...

 

Edit: some of them are GREAT at fp64, but none of the work here is fp64 that I am aware of. 

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3913
Credit: 43790129309
RAC: 63463836

Boca Raton Community HS

Boca Raton Community HS wrote:

Edit: some of them are GREAT at fp64, but none of the work here is fp64 that I am aware of. 



there are some FP64 calculations in both the BRP7 and O3AS apps. but it's not a huge percentage of the overall computation so you don't really see any gains scale from better FP64 alone.

 

you see most gains here from better GPU memory speed/bandwidth and better FP32 performance. and in the case of the CPU-recalc O3AS apps (1.07/1.08/1.15) also significant gains from faster CPU performance (mostly in core clock speed)

_________________________________________________________________________

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6258
Credit: 8922053658
RAC: 10425619

I am very interested in

I am very interested in finding 2 slot (strickly) GPU's with active cooling with power plugs off of the back.

I know that M4000 and P4000 have this. And I suspect the P100 does.

Any ideas?

I have heard of adapters to switch the top to the back but they would need to be very thin.

I am looking at a GPU space with very constrainted top spacing.

Thank you.

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Boca Raton Community HS
Boca Raton Comm...
Joined: 4 Nov 15
Posts: 233
Credit: 9525518920
RAC: 23315398

Tom M wrote: I am very

Tom M wrote:

I am very interested in finding 2 slot (strickly) GPU's with active cooling with power plugs off of the back.

I know that M4000 and P4000 have this. And I suspect the P100 does.

Any ideas?

I have heard of adapters to switch the top to the back but they would need to be very thin.

I am looking at a GPU space with very constrainted top spacing.

Thank you.

 

 

You would want the GP100 (not the P100- it is passive). You would also need an odd connector- it is not standard. We like the P100 GPUs we have for FP64 work (only). They are not good for FP32 work. 

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3913
Credit: 43790129309
RAC: 63463836

He’s basically wanting

He’s basically wanting something analogous to the Titan V but with active cooling and front facing power connector. 

GP100 fits the bill, at significantly worse performance  

GV100 is pretty much the only option that matches all the specs and capabilities, but there’s no free lunch and they’re all still like $1000+ each  

 

_________________________________________________________________________

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.