Perseus Arm Survey - very low performance with new nvidia drivers

BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246,736,656
RAC: 0
Topic 197093

Hello guys,

I have two PCs one with Gentoo amd64 (AMD PhenomII 1090T @ 3.2GHz, nvidia GTX-650) and another with Debian amd64 stable (AMD Athlon X2 @ 2.7GHz, nvidia GT-440).
In both PCs I am running einstein@home with CUDA.

Two months ago I noticed that the performance of the cuda client application of the einstein@home at the PC with Gentoo was very poor compared to the PC with Debian and that the PC with Gentoo was producing computational errors running the cuda client app.
Several days ago I switch the PC with Gentoo to Windows and I noticed a performance boost in cuda client of almost 900% !!!

Today I test several nvidia-drivers in PC with Gentoo and I noticed that for versions 304.88, 310.51 and 313.30 the performance of cuda app is similar to that in windows.
For versions 319.32 and 325.08 the performance of cuda app is 900% worse (4days to complete a wu with errors)!!!

I run some of the cuda-sdk sample applications and some custom matlab code which uses cuda functions and the performance is similar for the several versions of nvidia drivers.

Is anyone notice this performance gap with nvidia-drivers >= 319.32 ???

ExtraTerrestrial Apes
ExtraTerrestria...
Joined: 10 Nov 04
Posts: 770
Credit: 579,286,862
RAC: 197,574

Perseus Arm Survey - very low performance with new nvidia driver

At GPU-Grid the linux drivers since 319 are also extemly slow, so people are staying with 310 and 314's.

MrS

Scanning for our furry friends since Jan 2002

BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246,736,656
RAC: 0

RE: At GPU-Grid the linux

Quote:

At GPU-Grid the linux drivers since 319 are also extemly slow, so people are staying with 310 and 314's.

MrS

So, this is a problem/bug of the nvidia-drivers (>319) and not a problem of the e@h cuda client combined with these drivers.
I will search the nvidia forums for any similar threads...

Thanks,

Khangollo
Khangollo
Joined: 17 Feb 11
Posts: 42
Credit: 928,047,659
RAC: 0

I'm running 319.32 normally

I'm running 319.32 normally on two computers and two different kernels/distributions. I did not notice any slowdown after upgrading.
Must be something else?

MaU38.gif

KWSN - Baron Von Crunchenstein
KWSN - Baron Vo...
Joined: 1 Jun 13
Posts: 7
Credit: 874,365
RAC: 0

Not sure if this helps but

Not sure if this helps but I've recently run 2 Binary Radio Pulsar Search (Perseus Arm Survey) v1.33 (BRP4cuda32nv301)using my Nvidia GeForce 540M and 320.49 driver. The advertised run time was 10+ hours for each. Actual run time was ~ 6 hours for each and 3,333 credits for each.

KWSN - Baron Von Crunchenstein
KWSN - Baron Vo...
Joined: 1 Jun 13
Posts: 7
Credit: 874,365
RAC: 0

Running Windows 7.

Running Windows 7.

Bikeman (Heinz-Bernd Eggenstein)
Bikeman (Heinz-...
Moderator
Joined: 28 Aug 06
Posts: 3,522
Credit: 735,008,502
RAC: 1,292,335

RE: Running Windows 7. I

Quote:
Running Windows 7.

I think so far the problem of serious "under performance" with newer NVIDIA drivers seems to be restricted to Linux systems, am I getting this right??

So I guess one would want to focus on things like :

-nvidia driver version
-Kernel version, Linux distribution
-gfx card model
-gfx card max supported PCIe speed
-chipset/CPU max supported PCIe speed
-actually selected PCIe speed (e.g. from nvidia-settings tool)

and try to find a pattern, as some people are seeing this and others don't

Cheers
HB

ExtraTerrestrial Apes
ExtraTerrestria...
Joined: 10 Nov 04
Posts: 770
Credit: 579,286,862
RAC: 197,574

RE: I think so far the

Quote:
I think so far the problem of serious "under performance" with newer NVIDIA drivers seems to be restricted to Linux systems, am I getting this right??


Yes.

MrS

Scanning for our furry friends since Jan 2002

MAGIC Quantum Mechanic
MAGIC Quantum M...
Joined: 18 Jan 05
Posts: 1,892
Credit: 1,415,687,760
RAC: 1,159,202

Were you running all 4


Were you running all 4 applications before the driver update?

Binary Radio Pulsar Search (Arecibo) | Gamma-ray pulsar search #2 | Binary Radio Pulsar Search (Perseus Arm Survey) | Gravitational Wave S6 Directed Search (CasA)

You have the 6 processors on both of the ones running GT 650's and the 2 I have are GTX 650 Ti and mine are only quad and 3-core with that GPU card.

But I only run the BRP5's (PAS) and I know running all 4 or the different tasks at the same time do have an effect when you are running all of your CPU's

You can take a look at mine if you like but I also don't use linux

One is still XP Pro and the other is Win7 (and I have a couple 550Ti's and a 660Ti and all OC'd)

BackGroundMAN
BackGroundMAN
Joined: 25 Feb 05
Posts: 58
Credit: 246,736,656
RAC: 0

RE: Were you running all 4

Quote:


Were you running all 4 applications before the driver update?

Binary Radio Pulsar Search (Arecibo) | Gamma-ray pulsar search #2 | Binary Radio Pulsar Search (Perseus Arm Survey) | Gravitational Wave S6 Directed Search (CasA)

You have the 6 processors on both of the ones running GT 650's and the 2 I have are GTX 650 Ti and mine are only quad and 3-core with that GPU card.

But I only run the BRP5's (PAS) and I know running all 4 or the different tasks at the same time do have an effect when you are running all of your CPU's

You can take a look at mine if you like but I also don't use linux

One is still XP Pro and the other is Win7 (and I have a couple 550Ti's and a 660Ti and all OC'd)

Yes, I was running all 4 applications before the update of the nvidia drivers.
I also try to run apps only in 5 of the 6 cores (GTX-650) but there is no effect in the performance with the 319.32 drivers.

The latest statistics for this PC are:
1. 313.30 nvidia drivers & 100% cpu utilization (6 of 6 cores)-> ~19-20h/wu
2. 304.88 nvidia drivers & 100% cpu utilization (6 of 6 cores -> ~19-20h/wu
2. 313.30 nvidia drivers & 85% cpu utilization (5 of 6 cores) -> ~16-17h/wu
3. Windows 7 (same PC) & 100% cpu utilization (6 of 6 cores) -> ~12-13h/wu

There is a big performance gap between linux and windows !!
Also the cpu utilization seems to be affect the gpu performance.
I will try to minimize the cpu utilization to see if the linux performance will match the performance of windows...

ExtraTerrestrial Apes
ExtraTerrestria...
Joined: 10 Nov 04
Posts: 770
Credit: 579,286,862
RAC: 197,574

Magic, this problem only

Magic, this problem only applies to Linux!

MrS

Scanning for our furry friends since Jan 2002

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.