vApusMark II Response Time

Each tile in vApusMark II demands 18 virtual CPUs: four for the Oracle OLTP test, eight for the MS SQL Server OLAP test, and six for the three web application VMs (two CPUs each). Therefore, a four tile test will require 72 virtual CPUs. A quad Xeon E7-4870 contains 40 cores and 80 threads with Hyper-Threading enabled. With a test that puts 72 virtual CPUs to work, you cannot measure the total throughput of the quad Xeon E7. In fact, some of those 72 virtual CPUs are not working at 100% all of the time. For example, the CPU load caused by the web VMs shows a lot of spikes. Thus, we can not interprete the throughput numbers without a look at the response times.

vApus Mark II Response time

Back to our benchmark or throughput scores. Ideally, we should measure throughput at exactly the same response times. But with our current stress testing software, trying to keep response time the same would be an extremely time consuming process.

vApus Mark II score revisited

Since the quad Opteron shows a 40% increase in response time from 4 to 5 tiles (or from 20 to 25 VMs), we believe that the four tile score (149) is more representative of the "real performance". The extra throughput that the five tile test delivers comes at a response time price that is too high.

The response time of the Quad Xeon 7560 increases 9% when we try to load it with five extra VMs. In this case, the "real and fair" throughput score is a little bit harder to determine. It is somewhere between the score of 4 tiles and 5 tiles, probably around 180 or so.

In case of the Quad Xeon E7, however, things are crystal clear. Running 20 or 25 VMs does not make any difference: the response times stay in the same league. In this case we take the highest score to be the real one.

So if we take response times into account, the quad E7-4870 is about 35% faster than its predecessor (243 vs 180) and about 63% faster than the AMD system in our test (243 vs 149). AMD's fastest processor is the 2.5GHz 6180SE now. This CPU is clocked around 13% higher and should thus be able to reach a score of around 168. That means the Xeon E7-4870 should still have a 44% (or more) advantage over its nearest but much cheaper competitor in this particular workload.

Virtual Performance on vSphere 4 Power Extremes
Comments Locked

62 Comments

View All Comments

  • Soulnibbler - Thursday, May 26, 2011 - link

    Hey I'm thinking of building up a multicore box for raw processing. I'm wondering if you could benchmark bibble on these supercore systems.
    Preferably with an A900 or a 5dmkII
    Also using the wavelet denoise and wavelet sharpening plugins as these are what I use most often.
    I'm wondering about import and preview speed and also speed to export as jpg.
    Let me know if its possible to do these benchmarks, also if you need source files and config sets I have some 8-16gig sets.
  • JohanAnandtech - Thursday, May 26, 2011 - link

    Questions: are you sure bibble can handle enough threads? And can you provide me with a benchmarkable scenario? mail me at Johan AT anandtech

Log in

Don't have an account? Sign up now