Motherboard and System Reviews

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

https://www.columbiamissouria

https://www.columbiamissourian.com/news/higher_education/mus-new-hellbender-takes-a-byte-out-of-supercomputing/article_d44fe256-6d36-11ee-96b5-f309e0253a04.html

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

mikey
mikey
Joined: 22 Jan 05
Posts: 12522
Credit: 1838566330
RAC: 3768

Tom M

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

I was trolling eBay for "GPU

I was trolling eBay for "GPU servers" and ran across up to 10 pcie slot servers (all Intel).

The prices are not completely too high (in some cases).

Some of the descriptions listed potential GPUs you could install.  Apparently 2 slot GPUs.

One listing even mentioned a gtx 1080 ti?

I am presuming the majority of these "real" 2 slot gpus have no internal cooling.  Which is how they can get a lot of them in there.

Therefor they are using (noisy) case fans?

Mumble...

Tom M

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3897
Credit: 43190132644
RAC: 61659737

yes, they are server chassis

yes, they are server chassis and will be audible from your neighbors house.

_________________________________________________________________________

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

ONDA B250-D8P-D4 Mining

ONDA B250-D8P-D4 Mining MB

https://einsteinathome.org/host/13166221

This is an 8 slot MB with 4 additional 1x slots that can used for mining expansion kits.

I bought this system in a case with fans, dual 220 volt PSUs, CPU and a micro SSD. For $50 plus $129 shipping off eBay. The seller was closing these out.

The most important technical feature is all the interfaces are standard. Unlike some of the latest mining MB's which seem to need PSU's that don't have 24 pin power up requirements.

Since it uses standard 6th/7th gen Intel CPUs you are not locked into a soldiered on CPU.

Pros:

It has 8 usable PCIe slots on the MB which can be plugged in directly.

This avoids mining expansion kits and ribbon cables.

If you use strict 2 slot rtx 3080 ti's that are about 10" long you really can put 8 GPU's on the system. And add 4 more GPU's via the Mining expansion kits.

With 4 rtx 3080 ti's installed it is using about 40 percent of the available ram an just under half the CPU resources.  The current CPU has two cores.

Cons:

Limited CPU expansion. The maximum this Intel socket version takes is 4c/8t.

This means if a GPU tasks needs heavy CPU processing it may not be runnable on this system.

Limited CPU memory. You have one slot. The 8 mbyte sodium ddr3 ram is commonly available. I am still uncertain if there is a 16 mbyte version.

PCIe speeds are gen1 and 1x with 1 slot exception.

This means any GPU tasks that are bandwidth sensitive will not run very fast on this system.

Examples include gpugrid tasks.

Using 2 standard EVGA 1600 watt PSU's you are limited to 6 - 9 GPU's (3 vga 8 pins or 2 vga 8 pins per GPU) by the 9 vga 8 pins plugins on the PSU. This assumes you don't use both plugs on the PSU power cables.

I was unable to get either MB I had to go into bios/setup mode. I was able to install a new operating system using the bottom USB port under the RJ 47 (Lan) jack if the micro-sata-ssd had no bootable OS. And on to sata HDD's.

The case fans are very loud server fans that howl!

Would I buy this system new? No. However the massive convenience of plugging GPU's directly into the MB should not be ignored.

Respectfully.

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Boca Raton Community HS
Boca Raton Comm...
Joined: 4 Nov 15
Posts: 231
Credit: 9296188934
RAC: 21167202

Tom M wrote: ONDA

Tom M wrote:

ONDA B250-D8P-D4 Mining MB

https://einsteinathome.org/host/13166221

This is an 8 slot MB with 4 additional 1x slots that can used for mining expansion kits.

I bought this system in a case with fans, dual 220 volt PSUs, CPU and a micro SSD. For $50 plus $129 shipping off eBay. The seller was closing these out.

The most important technical feature is all the interfaces are standard. Unlike some of the latest mining MB's which seem to need PSU's that don't have 24 pin power up requirements.

Since it uses standard 6th/7th gen Intel CPUs you are not locked into a soldiered on CPU.

Pros:

It has 8 usable PCIe slots on the MB which can be plugged in directly.

This avoids mining expansion kits and ribbon cables.

If you use strict 2 slot rtx 3080 ti's that are about 10" long you really can put 8 GPU's on the system. And add 4 more GPU's via the Mining expansion kits.

With 4 rtx 3080 ti's installed it is using about 40 percent of the available ram an just under half the CPU resources.  The current CPU has two cores.

Cons:

Limited CPU expansion. The maximum this Intel socket version takes is 4c/8t.

This means if a GPU tasks needs heavy CPU processing it may not be runnable on this system.

Limited CPU memory. You have one slot. The 8 mbyte sodium ddr3 ram is commonly available. I am still uncertain if there is a 16 mbyte version.

PCIe speeds are gen1 and 1x with 1 slot exception.

This means any GPU tasks that are bandwidth sensitive will not run very fast on this system.

Examples include gpugrid tasks.

Using 2 standard EVGA 1600 watt PSU's you are limited to 6 - 9 GPU's (3 vga 8 pins or 2 vga 8 pins per GPU) by the 9 vga 8 pins plugins on the PSU. This assumes you don't use both plugs on the PSU power cables.

I was unable to get either MB I had to go into bios/setup mode. I was able to install a new operating system using the bottom USB port under the RJ 47 (Lan) jack if the micro-sata-ssd had no bootable OS. And on to sata HDD's.

The case fans are very loud server fans that howl!

Would I buy this system new? No. However the massive convenience of plugging GPU's directly into the MB should not be ignored.

Respectfully.

 

Wouldn't running PCIe speeds at 1x even impact E@H work? Someone else will have to chime in here but that is not a fast interface. 

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

So far my co-team members

So far my co-team members seem to think not really.

Apparently not brp7 tasks. Might have effected the grp#1 tasks some.

I still need to test the Allsky GPU tasks. I think the bottleneck there will be the two core CPU.

Respectfully.

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3897
Credit: 43190132644
RAC: 61659737

it will matter if you want to

it will matter if you want to use CUDA MPS (running 3x tasks with MPS uses about 20% PCIe 3.0 x16 link), but natively running the standard tasks or the custom app without MPS the PCIe use is pretty low.

I'm not sure which PCIe gen speed that Tom is running on that board whether it's 3.0 or 2.0 or 1.0, but my *guess* is that 2.0+ x1 should be fine.

_________________________________________________________________________

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

Ian&Steve C. wrote: it will

Ian&Steve C. wrote:

it will matter if you want to use CUDA MPS (running 3x tasks with MPS uses about 20% PCIe 3.0 x16 link), but natively running the standard tasks or the custom app without MPS the PCIe use is pretty low.

I'm not sure which PCIe gen speed that Tom is running on that board whether it's 3.0 or 2.0 or 1.0, but my *guess* is that 2.0+ x1 should be fine.

As far as I can tell I am running all Gen1 with 1x.

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6234
Credit: 8818352022
RAC: 9018427

I was reading about Blade

I was reading about Blade Servers today. One of my former bosses was involved with one at KU. He was very proud of his data analysis using SQL with it.

The bottom line is they have a strong resemblance to a Raspberry Pi cluster. Which basically means while each individual blade could not reach the heights of a 256 thread server they would be great  at volume at the aggregate individual user level (top user report).

https://en.m.wikipedia.org/wiki/Blade_server

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.