Benchmark Configuration

Unfortunately, the Intel R2208GZ4GSSPP is a 2U server, which makes it hard to compare it with the 1U Opteron "Interlagos" and 1U "Westmere EP" servers we have tested in the past. We will be showing you a few power consumption numbers, but since a direct comparison isn't possible, please take them with a grain of salt.

Intel's Xeon E5 server R2208GZ4GSSPP (2U Chassis)

CPU

Intel Xeon processor E5-2690 (2.9 GHz, 8c, 20MB L3, 135W)
Intel Xeon processor E5-2660 (2.2 GHz, 8c, 20MB L3, 95W)

RAM 64 GB (8x8GB) DDR-1600 Samsung M393B1K70DH0-CK0
Motherboard Intel Server Board S2600GZ "Grizzly Pass"
Chipset Intel C600
BIOS version SE5C600.86B (01/06/2012)
PSU Intel 750W DPS-750XB A (80+ Platinum)

The Xeon E5 CPUs have four memory channels per CPU and support DDR3-1600, and thus our dual CPU configuration gets eight DIMMs for maximum bandwidth. The typical BIOS settings can be found below.

Not being show is that all prefetchers were enabled in all tests.

Supermicro A+ Opteron server 1022G-URG (1U Chassis)

CPU Two AMD Opteron "Bulldozer" 6276 at 2.3GHz
Two AMD Opteron "Magny-Cours" 6174 at 2.2GHz
RAM 64GB (8x8GB) DDR3-1600 Samsung M393B1K70DH0-CK0
Motherboard SuperMicro H8DGU-F
Internal Disks 2 x Intel SLC X25-E 32GB or
1 x Intel MLC SSD510 120GB
Chipset AMD Chipset SR5670 + SP5100
BIOS version v2.81 (10/28/2011)
PSU SuperMicro PWS-704P-1R 750Watt

The same is true for the latest AMD Opterons: eight DDR3-1600 DIMMs for maximum bandwidth. You can find the BIOS settings of our Opteron machine here. C6 was enabled.

Asus RS700-E6/RS4 1U Server

CPU Two Intel Xeon X5670 at 2.93GHz - 6 cores
Two Intel Xeon X5650 at 2.66GHz - 6 cores
RAM 48GB (12x4GB) Kingston DDR3-1333 FB372D3D4P13C9ED1
Motherboard Asus Z8PS-D12-1U
Chipset Intel 5520
BIOS version 1102 (08/25/2011)
PSU 770W Delta Electronics DPS-770AB

To speed up testing, we tested the Intel Xeon and AMD Opteron system in parallel. As we didn't have more than eight 8GB DIMMs, we used our 4GB DDR3-1333 DIMMs. The Xeon system only gets 48GB, but this isn't a disadvantage as our highest memory footprint benchmark (vApus FOS, 5 tiles) uses no more than 40GB of RAM.

Finally, we measured the difference between 12x4GB and 8x8GB of RAM and recalculated the power consumption for our power measurements (note that the differences were very small). There is no alternative as our Xeon has three memory channels and cannot be outfitted with the same amount of RAM as our Opteron system (four channels).

Common Storage System

For the virtualization tests, each server gets an Adaptec 5085 PCIe x8 card (driver aacraid v1.1-5.1[2459] b 469512) connected to six Cheetah 300GB 15000 RPM SAS disks (RAID-0) inside a Promise JBOD J300. The virtualization testing requires more storage IOPs than our standard Promise JBOD with six SAS drives can provide. To counter this, we added internal SSDs:

  • We installed the Oracle Swingbench VMs (vApus Mark II) on two internal X25-E SSDs (no RAID). The Oracle database is only 6GB big. We test with two tiles. On each SSD, each OLTP VM accesses its own database data. All other VMs (web, SQL Server OLAP) are stored on the Promise JBOD (see above).
  • With vApus FOS, Zimbra is the I/O intensive VM. We spread the Zimbra data over the two Intel X25-E SSDs (no RAID). All other VMs (web, MySQL OLAP) get their data from the Promise JBOD (see above).

We monitored disk activity and measured the phyiscal disk adapter latency (as reported by VMware vSphere) at between 0.5 and 2.5 ms.

Software Configuration

All vApus testing was done one ESXi vSphere 5--VMware ESXi 5.0.0 (b 469512 - VMkernel SMP build-348481 Jan-12-2011 x86_64) to be more specific. All vmdks use thick provisioning, independent, and persistent. The power policy is "Balanced Power" unless indicated otherwise. All other testing was done on Windows 2008 Enterprise R2 SP1. Unless noted otherwise, we used the "High Performance setting" on Windows 2008 R2 SP1.

Other Notes

Both servers were fed by a standard European 230V (16 Amps max.) powerline. The room temperature was monitored and kept at 23°C by our Airwell CRACs.

We used the Racktivity ES1008 Energy Switch PDU to measure power consumption. Using a PDU for accurate power measurements might seem pretty insane, but this is not your average PDU. Measurement circuits of most PDUs assume that the incoming AC is a perfect sine wave, but it never is. However, the Rackitivity PDU measures true RMS current and voltage at a very high sample rate: up to 20,000 measurements per second for the complete PDU.

New Supermicro Twin: SYS-6027TR-D71FRF 2U Chassis Virtualization Performance: Linux VMs on ESXi
Comments Locked

81 Comments

View All Comments

  • silverblue - Thursday, March 8, 2012 - link

    You've put that Interlagos has 4x2MB L2, but that would only be true for Valencia; Interlagos is 8x2MB.
  • aranyagag - Thursday, March 8, 2012 - link

    you forgot the E5-2687W with a 150w tdp and higher speeds
  • colonelclaw - Friday, March 9, 2012 - link

    Hi There,
    Thanks for an excellent article. With regards to the rendering benchmarks, would you consider using VRay as a rendering engine? It's fast becoming industry standard, is compatible with all the big hitters (Max, Maya, Softimage etc), is cross platform, and I believe, is incredibly well coded to scale with cores.
    It's also incredibly popular, not something you could say about iRay right now.
  • Slik - Saturday, March 10, 2012 - link

    Would be nice if some game benchmark was included as well.
  • colonelclaw - Wednesday, March 14, 2012 - link

    Bloody hell those chips look good, and don't Intel know it; those prices make me wince.
    Having waited what seems like forever, I was thrilled to see the Xeon E5s finally available, right up until I did some quick maths and figured out that for my business to buy a new 2U Twin squared rendernode with 16/32 cores per node will cost us around £10,000. Still the thing is, now that those chips are available, next time we buy kit we can't afford not to choose them.
  • Skouperd - Tuesday, March 20, 2012 - link

    Great article... but can it run crysis?

    Seriously, what will happen if you plug in some high end graphics card in that machine, how will that compare from a gaming perspeective to say an LGA2011 cpu?

    ;-)
  • fudd101 - Wednesday, April 4, 2012 - link

    From the 'article' .....

    'The Opteron might also have a role in the low end, price sensitive HPC market, where it still performs very well. It won't have much of chance in the high end clustered one as Intel has the faster and more power efficient PCIe interface'

    Well, if that's the case, why exactly would AMD be scoring so many design wins with Interlagos. Including this one ...

    http://www.pcmag.com/article2/0,2817,2394515,00.as...

    http://www.eweek.com/c/a/IT-Infrastructure/Cray-Ti...

    U think those guys at Cray were going for low performance ? In fact, seems like AMD has being rather cleaning up in the HPC market since the arrival of Interlagos. And the markets have picked up on it, AMD stock is thru the roof since the start of the year. Or just see how many Intel processors occupy the the top 10 supercomputers on the planet. Nuff said ...
  • jaskhoo - Wednesday, July 11, 2012 - link

    Hi, abit blur here and would like to know if there's anyone who could enlighten abit.
    I'm looking to purchase a new server to work with an SQL 2012 4 core, the initial ppreference was for an E5620 which is now an outdated model but I can't go for higher E5-xxx models as all are 6 core and will affect the 4 core SQL licensing. I'm not running a huge databse but would like to know if there are any serious performance difference between the two processor. Appreciate it.
  • famalosa - Tuesday, April 26, 2016 - link

    Les deux platines ci-dessus commençons par lance Gobelins ou la bombe tour/Canon au début de la bataille lorsque la barre de l'élixir obtient autour de 10. Je vais tout d'abord si l'ennemi a au compteur et ils ont habitude de laisser tomber tout d'abord une grosse carte ou utilisez les flèches. Puis jouer à votre avantage avec le coût de l'élixir, troupes pour la défense et une attaque forte. Déposer le Canon ou la tour au milieu de rerouter les agresseurs et pour la défense.
    <a href="http://clashroyalhack.fr/">CR hack</a>
  • famalosa - Tuesday, April 26, 2016 - link

    Le pont sur la gauche est une mise en page « plus grand risque de mieux récompenser », tandis que celui de droite est un jeu plus lent que prendra de temps et patience pour gagner. Tous deux sont extrêmement compétents et me laisser pousser à Arena 7.
    http://clashroyalhack.fr/

Log in

Don't have an account? Sign up now