The Intel Xeon D Review: Performance Per Watt Server SoC Champion?
by Johan De Gelas on June 23, 2015 8:35 AM EST- Posted in
- CPUs
- Intel
- Xeon-D
- Broadwell-DE
Benchmark Configuration
All tests were done on Ubuntu Server 14.04 LTS (soon to be upgraded to 15.04). Aside from the SuperMicro Xeon-D system, we also have the ASRock Rack C2750D4I (eight core Silvermont), a Xeon E3-1200 v3 system, a Xeon E3-1200 v2 system, a 1P Xeon E5-2600L v3 and a HP Moonshot cartridge based system. We tested the HP Moonshot cartridges remotely.
Supermicro's 5028D-TN4T
| CPU | Xeon D-1540 2.0 GHz |
| RAM | 4x16GB DDR4-2133 |
| Internal Disks | Samsung 850 Pro 128 GB |
| Motherboard | SuperMicro X10SLD-F |
| PSU | FSP250-50LC (250 W, 80+ Bronze) |
Below you can find most of the CPU settings in the BIOS:
ASRock's C2750D4I
| CPU | Intel Atom C2750 2.4 GHz |
| RAM | 4x8GB DDR3-1600 |
| Internal Disks | Samsung 850 Pro 128 GB |
| Motherboard | ASRock C2750D4I |
| PSU | Supermicro PWS-502 (80+) |
The Xeon D is not a replacement for the Atom C2000. Although the Xeon D is also a SoC, the Atom C2000 remains Intel low power options for microservers. Of course, we want to know how much power you save, and how large the performance trade-off is.
Intel's Xeon E3-1200 v3 – ASUS P9D-MH
| CPU | Intel Xeon processor E3-1240 v3 3.4 GHz Intel Xeon processor E3-1230L v3 1.8 GHz |
| RAM | 4x8GB DDR3-1600 |
| Internal Disks | 1x Samsung 850 Pro 128 GB |
| Motherboard | ASUS P9D-MH |
| PSU | Supermicro PWS-502 (80+) |
As the Xeon D is limited to 2 GHz (2.6 GHz turboboost), higher clocked Xeon E3s might still make sense where single threaded performance is a major concern. The Xeon E3-1230L was included as a low power alternative, although we wonder it still make sense, considering that the Xeon E3 needs a separate 1-4W chipset (C220).
Intel's Xeon E3-1200 v2
| CPU | Intel Xeon processor E3-1265L v2 |
| RAM | 4x8GB DDR3-1600 |
| Internal Disks | 1x Intel MLC SSD710 200GB |
| Motherboard | Intel S1200BTL |
| PSU | Supermicro PWS-502 (80+) |
The previous generation low power Xeon E3.
Intel's Xeon E5 Server – "Wildcat Pass" (2U Chassis)
| CPU | One Intel Xeon processor E5-2650L v3 (1.8GHz, 12c, 30MB L3, 65W) |
| RAM | 128GB (8x16GB) Samsung M393A2G40DB0 (RDIMM) |
| Internal Disks | 2x Intel MLC SSD710 200GB |
| Motherboard | Intel Server Board Wildcat Pass |
| PSU | Delta Electronics 750W DPS-750XB A (80+ Platinum) |
Although our E5 server is not comparable to the other systems, it important to gauge where a low power E5 model would land. We like to understand when it make sense to invest more money in an Xeon E5 system, and here we only use one Xeon. Note that this system also requires power from a separate PCH.
HP Moonshot
More info about this configuration can be found in our previous article about micro server SoCs.
We tested two different cartridges: the m400 and the m300. Below you can find the specs of the m400:
| CPU/SoC | AppliedMicro X-Gene 2.4 |
| RAM | 8x 8GB DDR3 @ 1600 |
| Internal Disks | M.2 2280 Solid State 120GB |
| Cartridge | m400 |
And the m300:
| CPU/SoC | Atom C2750 2.4 |
| RAM | 8x 8GB DDR3 @ 1600 |
| Internal Disks | M.2 2280 Solid State 120GB |
| Cartridge | m300 |
Other Notes
Both servers are fed by a standard European 230V (16 Amps max.) power line. The room temperature is monitored and kept at 23°C by our Airwell CRACs. We use the Racktivity ES1008 Energy Switch PDU to measure power consumption in our lab. We used the HP Moonshot ILO to measure the power consumption of the cartridges.
Facebook
Twitter
RSS
90 Comments
View All Comments
extide - Tuesday, June 23, 2015 - link
That's ECC Registered, -- not sure if it will take that, but probably, although you dont need registered, or ECC.nils_ - Wednesday, June 24, 2015 - link
If you want transcoding, you might want to look at the Xeon E3 v4 series instead, which come with Iris Pro graphics. Should be a lot more efficient.bernstein - Thursday, June 25, 2015 - link
for using ECC UDIMMs, a cheaper option would be an i3 in a xeon e3 board.psurge - Tuesday, June 23, 2015 - link
Has Intel discussed their Xeon-D roadmap at all? I'm wondering in particular if 2x25GbE is coming, whether we can expect a SOC with higher clock-speed or more cores (at a higher TDP), and what the timeframe is for Skylake based cores.nils_ - Tuesday, June 23, 2015 - link
Is 25GbE even a standard? I've heard about 40GbE and even 56GbE (matching infiniband), but not 25.psurge - Tuesday, June 23, 2015 - link
It's supposed be a more cost effective speed upgrade to 10GbE than 40GbE (it uses a single 25Gb/s serdes lane, as used in 100GbE, vs 4 10Gb/s lanes), and IIRC is being pushed by large datacenter shops like Google and Microsoft. There's more info at http://25gethernet.org/. I'm not sure where things are in the standardization process.nils_ - Wednesday, June 24, 2015 - link
It also has an interesting property when it comes to using a breakout cable of sorts, you could connect 4 servers to 1 100GbE port (this is already possible with 40GbE which can be split into 4x10GbE).JohanAnandtech - Wednesday, June 24, 2015 - link
Considering that the Xeon D must find a home in low power high density servers, I think dual 10 Gbit will be standard for a while. Any idea what 25/40 Gbit PHY would consume? Those 10 Gbit PHYs already need 3 Watt in idle, probably around 6-8W at full speed. That is a large chunk of the power budget in a micro/scale out server.psurge - Wednesday, June 24, 2015 - link
No I don't, sorry. But, I thought SFP+ with SR optics (10GBASE-SR) was < 1W per port, and that SFP+ direct attach (10GBASE-CR) was not far behind? 10GBASE-T is a power hog...pjkenned - Tuesday, June 23, 2015 - link
Hey Johan - just re-read. A few quick thoughts:First off - great piece. You do awesome work. (This is Patrick @ ServeTheHome.com btw)
Second - one thing should probably be a bit clearer - you were not using a Xeon D-1540. It was a ES Broadwell-DE version at 2.0GHz. The shipping product has 100MHz higher clocks on both base and max turbo. I did see a 5% or so performance bump from the first ES version we tested to the shipping parts. The 2.0GHz parts are really close to shipping spec though. One both of my pre-release Xeon D and all of the post-release Xeon D systems was nearly identical.
Those will not change your conclusions but does make the actual Intel Xeon D-1540 a bit better than the one you tested. LMK if you want me to set aside some time on a full speed version on a Xeon D-1540 system for you.