Motherboard and System Reviews

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493
Topic 225279

Do you have a Motherboard you love OR hate?

Write about it here.  I have some "history" with "several" motherboards.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Keith Myers
Keith Myers
Joined: 11 Feb 11
Posts: 4963
Credit: 18710439656
RAC: 6344634

"Love" my ASUS Crosshair VII

"Love" my ASUS Crosshair VII Hero motherboards.  I have four.

Really like my inexpensive Asrock Rack EPYCD8 server motherboard.

 

Jim1348
Jim1348
Joined: 19 Jan 06
Posts: 463
Credit: 257957147
RAC: 0

I build Ryzen machines these

I build Ryzen machines these days.  And they are dedicated to crunching, so I don't need full-length boards.  And I don't overclock, so I don't need extra-heavy duty power.  But I do want stable power, with well-cooled and reliable voltage regulators.

 

The ASRock B550M PRO4 are now my all-time favorites.  I have several of them.

https://www.newegg.com/asrock-b550m-pro4/p/N82E16813157939

 

I don't know if the BIOS they are shipping now supports the Ryzen 5000 series or not.  You might have to upgrade using a Ryzen 3000.

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

I have "several" ongoing

I have "several" ongoing Motherboard experiments/tests etc.  I am going to focus on the MSI X470 Gaming Plus Max to begin with.

I bought this MB for a prospective upgrade to 3 gpus on my Amd 3950x which only has 2 long slots.  I have since discovered there is some kind of bug in the 370/470 chip sets that means the 3rd long slot will not work without some Linux kernel command line tinkering in Grub.

The first problem is there was not enough clearance in my largest case to utilize the 3rd slot for a gpu inside the case.

The second problem is I have an out sized air-cooler on the AMD 3950x which causes clearance headaches on the mining racks I currently own.

I addressed the problems in two ways.  1) I didn't use the AMD 3950x for testing.  I used a Amd 2700x.  2) I bought an "Open Air" computer case that basically would not have a clearance issue for either the 3rd slot or a "too tall" cpu cooler.

Assembling the "Open Air" computer case turned out to be an "erector set" project.  Complete with multiple partial disassembles to get everything where it was "supposed" to be.

The "goal" of the above setup was to get an XFX Rx 5700 and 2 XFX Rx 580's mounted directly on the Motherboard and processing E@H Gamma Ray tasks.

The good news is after dinking around and researching with everyone's favorite tool Google I actually got that far.

The bad news is when I have ANY Rx 580 or Rx 5700 video card in the 3rd slot the video card in the first slot slows down massively.

The XFX Rx 5700 I have will run 1 Gamma Ray task in less than 5 minutes if it is the only card installed on the motherboard (in slot 1).  If I install an Rx 580 in the 3rd slot both cards slow down and the system gets a little laggy.

It is currently running with the Rx 5700 in slot 1 and an Rx 580 in slot 4 (counting from the cpu). The 3rd long slot is the 6th slot counting from the cpu.  And the system is not laggy. 

However both cards are still running slow.  I am going to reset the bios to mostly defaults and see if that helps.  And then remove the additions to the GRUB command line and see if that helps.

I will post the error messages and details of the Grub command lines that seem to get you past the errors in another message.

BRB.

Tom M

 

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

Notes on getting 3 gpu cards

Notes on getting 3 gpu cards to run on an MSI X470 Gaming Plus Max Motherboard.

If you are seeing an error that looks something like this

iommu ivho: AMD - Vi: Event logged (IOTLM_INV_TIMEOUT device=25.00.0 address=0x42cd9e430

the following should help you get past it.  When I get that error the system stops the booting cycle (it may take many console lines of output before it stops).

  1. Updated Bios to most current available (beta at this time).
  2. Added the following to the GRUB command line: iommu=pt pci=noaer

A How To for the people who don't want to "Grub" around looking for.

Open a terminal session in Linux.  (Term in Ubuntu).

Menu paste this: sudo nano /etc/default/grub

Hit enter.  Put in sudo password.

Locate: GRUB_CMDLINE_LINUX_DEFAULT

This often has "splash" as part of the command line.

Add the iommu=pt pci=noaer inside the quotes with a space between each keyword=parameter pair.

I have to use the menu paste to get it inserted.

Cntl-O -> Enter to write out the file.

Cntl-X to quit nano.

Run this command next to update GRUB so it will apply the changes during the next boot.

sudo update-grub

Re-boot system.

You should now be able to install and boot with a gpu card in the "3rd long slot".

 

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

Tom M wrote:However both

Tom M wrote:

However both cards are still running slow.  I am going to reset the bios to mostly defaults and see if that helps.  And then remove the additions to the GRUB command line and see if that helps.

No luck both cards are still running slowly.

Incase it isn't obvious this MB is clearly "not suitable to task" for running three video cards on the MB.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

Tom M wrote: Do you have a

Tom M wrote:

Do you have a Motherboard you love OR hate?

Write about it here.  I have some "history" with "several" motherboards.

I also have the agenda of trying to run more than 2 video cards on a BOINC system.

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

Keith Myers wrote: "Love" my

Keith Myers wrote:

"Love" my ASUS Crosshair VII Hero motherboards.  I have four.

Really like my inexpensive Asrock Rack EPYCD8 server motherboard.

I may look at a Crosshair VII for a 3 gpu rig.

How much did the MB, Cpu, Ram (and anything else necessary) cost?

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3945
Credit: 46708922642
RAC: 64250765

Seconded Keith on the EPYCD8,

Seconded Keith on the EPYCD8, really nice for multi-GPU setups. I have 3 of these boards.

 

Asrock Rack EPYCD8

Quote:

Pros:

  • Standard ATX form factor
  • 7x PCIe 3.0 slots ([4]x16, [3]x8), all lanes direct from CPU for max bandwidth
  • PCIe slots can be bifurcated to run multiple GPUs from a single slot (with proper riser) at x8/x4
  • supplemental power input for VGA (6-pin PCIe) to support high number of GPUs on board
  • Support for EPYC Rome processors up to 64c/128t
  • Supports 3200MHz DDR4 RDIMMs
  • IPMI for remote management (power control, KVM redirection, BIOS flashes, hardware monitoring, etc)
  • available in -2T variant with dual 10GBase-T ethernet (but not necessary for BOINC loads)
  • priced very reasonably for this combination of features (~$400)

Cons:

  • latest BIOS has a bug for PWM fan control. fan seems locked at 50% (non-issue for water cooling, or remove PWM pin for full speed), a beta BIOS exists to solve this.
  • No BIOS update to support EPYC Milan (need ROMED8-2T ($600) for Milan support)
  • CPUs and memory are a bit expensive depending on hardware chosen

Supermicro H11DSi-NT rev2.0

Quote:

Pros:

  • Dual socket EPYC motherboard
  • Standard E-ATX form factor (only a handful of E-ATX dual socket EPYC out there, most are proprietary)
  • PCIe slots can be bifurcated to run multiple GPUs from a single slot (with proper riser) at x8/x4
  • Support for 2x EPYC Rome processors up to 64c/128t each (Rome support on rev 2.0 only)
  • Supports 3200MHz DDR4 RDIMMs
  • IPMI for remote management (power control, KVM redirection, BIOS flashes, hardware monitoring, etc)
  • dual 10GBase-T ethernet (available in non-NT with 1GbE, but I got a deal on this board)

Cons:

  • Only 5 PCIe slots
  • no supplemental VGA power
  • Nvme slot is only PCIe x2 (not x4 like normal, but doesnt matter for BOINC)
  • No BIOS update to support EPYC Milan (need H12DSi for Milan support)
  • CPUs and memory are a bit expensive depending on hardware chosen

Both of these boards being Server/Enterprise level products are incredibly stable.

Some other boards I've used in the last few years...

Supermicro X9DRX+-F

Quote:

Pros:

  • 11x PCIe x8 slots ([10] 3.0x8, [1] 2.0x4)
  • uses dual Xeon E5-2600v2 CPUs (up to 12c/24t each) and DDR3 ECC RDIMM memory, which are very cheap
  • X10 variant exists for v3/v4 CPUs and DDR4 ECC RDIMMs
  • IPMI for remote management (power control, KVM redirection, BIOS flashes, hardware monitoring, etc)

Cons:

  • proprietary non-ATX form factor. wont fit in any consumer chassis
  • higher CPU power consumption vs performance
  • x8 slots are closed ended, requires an adapter/riser or motherboard modification to install any x16 (most) GPUs
  • no dedicated VGA power input

ASUS P9X79-E WS

Quote:

Pros:

  • Standard ATX format (some might list it as EATX since it's a bit wider than ATX, but it doesn't reach all the way out to, or require, the EATX screw holes)
  • x79 chipset, so it'll work with Xeon E5-1600v2 or E5-2600v2, which are pretty cheap
  • has DDR3 ECC memory support (UDIMM only, no RDIMM)
  • 7x PCIe 3.0 x16 slots ([3]x16, 4[x8]) using on-board PLX switches to expand CPU lanes
  • dedicated VGA power input for multi-GPU

Cons:

  • UDIMM memory is more expensive than RDIMM
  • the PLX switch setup, while it works to expand PCIe/GPU bandwidth, can be a little unstable when heavily loaded with 7 GPUs
  • the board in general has high power consumption due to the PLX chips.
  • no Nvme support
  • no IPMI
  • still quite expensive for such old tech, even used (~$250+)

 

If you want multi-GPU on a cheaper board, and don't care about reduced PCIe bandwidth (Einstein doesn't need much, but I planned my builds around supporting GPUGRID which DOES need the extra bandwidth), then I would HIGHLY recommend an intel platform. anything from X270/B250 and newer. As Tom has found out, the consumer AMD-based platform in general doesn't play as nice as Intel with regard to multi-GPU beyond 3 or 4 GPUs. whereas I've had no problem running even 9-10 GPUs on most intel platforms without much trouble (provided I had enough PCIe/m.2 slots to use).

also just be cognizant about how many GPUs you have and how many cores/threads you have. this is a bit more important on Nvidia GPUs than AMD GPUs as Nvidia applications usually require a full CPU thread to support the GPU task, and if you over commit, you will see task slow downs. AMD GPU applications seem to use about 0.25-0.33 CPU per GPU so you could get away with more there.

_________________________________________________________________________

Ian&Steve C.
Ian&Steve C.
Joined: 19 Jan 20
Posts: 3945
Credit: 46708922642
RAC: 64250765

Jim1348 wrote: I build Ryzen

Jim1348 wrote:

I build Ryzen machines these days.  And they are dedicated to crunching, so I don't need full-length boards.  And I don't overclock, so I don't need extra-heavy duty power.  But I do want stable power, with well-cooled and reliable voltage regulators.

 

The ASRock B550M PRO4 are now my all-time favorites.  I have several of them.

https://www.newegg.com/asrock-b550m-pro4/p/N82E16813157939

 

I don't know if the BIOS they are shipping now supports the Ryzen 5000 series or not.  You might have to upgrade using a Ryzen 3000.

I use the X570 version of this board, paired with a R9 5950X and a single RTX2080ti (both watercooled) as my main desktop system. The board is what I would call "adequate" or good "bang for the buck". the VRM cooling is only *just* good enough and the huge chunky aluminum heatsink really isnt the best for cooling. But I realize I'm really pushing it with a 4.45GHz 16-core all-core overclock. I could probably squeeze some more performance and stability out of it with a better board but I'm content with it at the moment. still waffling on if I should replace it with an EPYC-based setup.

 

_________________________________________________________________________

Tom M
Tom M
Joined: 2 Feb 06
Posts: 6435
Credit: 9564692455
RAC: 8961493

Ian&Steve C. wrote:Seconded

Ian&Steve C. wrote:

Seconded Keith on the EPYCD8, really nice for multi-GPU setups. I have 3 of these boards.

Thank you Ian.

I also found the Intel Servers to be robust.  And have had "variable" results with some of the Intel mining MB's.

I may have to break down and get a B250 model and be done with it.

==edit==

Just found the EPYCD8 MB for under $500.

===edit====

Tom M

A Proud member of the O.F.A.  (Old Farts Association).  Be well, do good work, and keep in touch.® (Garrison Keillor)  I want some more patience. RIGHT NOW!

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.