Memory Subsystem: Bandwidth

As more memory channels complicate motherboard design and can be a problem for dense servers, the Xeon-D, Xeon E3 and Atom C2000 only have two memory channels. This makes quad channel operation a good way to differentiate up to the Xeon E5.  The Xeon E3 and Atom are limited to DDR3-1600 as per JEDEC specifications, whereas the Xeon D should be able to command more bandwidth due to the use of DDR4-2133 DIMMs. 

We measured the memory bandwidth in Linux. The binary was compiled with the Open64 compiler 5.0 (Opencc). It is a multi-threaded, OpenMP based, 64-bit binary. The following compiler switches were used:

-Ofast -mp -ipa

To keep things simple, we only report the Triad sub-benchmark of our OpenMP enabled Stream benchmark.

Stream Triad

Using DIMMs with a 33% higher clock, the Xeon D gets a 25-38% boost in bandwidth compared to the Xeon E3. Basically, every percent increase in clock speed is translated in higher bandwidth. The Xeon E5 has almost twice as much bandwidth for only 50% more cores and should as result do better in some bandwidth intensive applications (mostly HPC). 

Benchmark configuration Memory Subsystem: Latency
Comments Locked

90 Comments

View All Comments

  • Flunk - Tuesday, June 23, 2015 - link

    Yes, but it's still bad marketing. -D is associated with inferior, overly hot, bad performing Intel chips.
  • IanHagen - Tuesday, June 23, 2015 - link

    Certainly. From a marketing standpoint it's a pretty poor choice. I agree with wussupi, E4 would haven been a far better name.
  • karpodiem - Tuesday, June 23, 2015 - link

    does anyone know where to buy these online? I'm looking for just the board/processor, model # 'X10SDV-TLN4F'

    All these random/small Supermicro resellers are selling it now, based on some Google searches. They're marking it up in price by at least a hundred bucks, because availability is limited. Anyone know when Newegg might get it in stock?

    Looking to do a FreeNAS build - this board + IBM M1015 card in an ATX motherboard (6x4TB drives in RAIDZ2).
  • ats - Tuesday, June 23, 2015 - link

    The TLN4F is the one in most demand and almost no place is able to keep it in stock. There are multiple places that will order it for you for ~1K but wait times can be anywhere from 1 week to 1 month.
  • Jon Tseng - Tuesday, June 23, 2015 - link

    > And the reality is that the current SoCs with an ARM ISA do not deliver the necessary per core
    > performance: they are still micro server SoCs, at best competing with the Atom C2750. So
    > currently, there is no ARM SoC competition in the scale out market until something better than
    > the A57 hits the market for these big players.

    Dude... You really want to have a look at the latest ThunderX parts or the X-Gene 16nm shrinks before you start making unwise statements like that. These aren't waiting around for A57 they are custom ARM architecture designs. Per core performance might not be as hot as Xeon but once you start to throw 48 cores on a die I wouldn't quite call that "at best competing with Avaton".
  • smoohta - Tuesday, June 23, 2015 - link

    Link to reviews?
  • ats - Tuesday, June 23, 2015 - link

    X-Gene is in the article, any further shrinks are still entirely vapor. ThunderX isn't currently available is is likely to have significantly worse per core performance than Atom C2k series and worse than A57. All the cores in the world don't do jack if the ST isn't there. And ST performance IS a barrier even in scale out. For general scale out, C2750 was found fairly wanting because of the ST performance, and neither X-Gene nor ThunderX even compete with C2750 in ST performance... QED.
  • mczak - Tuesday, June 23, 2015 - link

    He said "currently". The X-Gene 16nm cores might offer some competition who knows - but those are X-Gene 3 whereas you can't even buy anything with X-Gene 2 28nm ones right now... Likewise, ThunderX servers have been announced, but I haven't seen any reviews yet.
  • name99 - Tuesday, June 23, 2015 - link

    Look at the ThunderX parts HOW? Cavium releases fsck-all information about them. No-one knows if they are even OoO, how wide they are, etc.
    Yes, there are 48 cores on a SoC; and presumably they will do well for tasks like memcached that like lots of low-performance parallelism. But right now, we have ZERO evidence that a ThunderX part is a better single-threaded core than A57, let alone that it's comparable to Broadwell.
  • der - Tuesday, June 23, 2015 - link

    NOICE FAM!

Log in

Don't have an account? Sign up now