Java Server Performance

The SPECjbb 2013 benchmark has "a usage model based on a world-wide supermarket company with an IT infrastructure that handles a mix of point-of-sale requests, online purchases, and data-mining operations." It uses the latest Java 7 features and makes use of XML, compressed communication, and messaging with security.

Benchmark architecture diagram

We tested with four groups of transaction injectors and back-ends. We applied relatively basic tuning to mimic real-world use. We used this JVM configuration setting for the systems limited to 32 GB (all Xeon E3):

"-server -Xmx4G -Xms4G -Xmn2G -XX:+AlwaysPreTouch -XX:+UseLargePages"

With these settings, the benchmark takes about 20-27GB of RAM. For the servers that could address 64 GB or more (Atom, Xeon D and Xeon E5), we used a slightly beefier setting:

"-server -Xmx8G -Xms8G -Xmn4G -XX:+AlwaysPreTouch -XX:+UseLargePages"

With these settings, the benchmark takes about 43-57GB of RAM. The first metric is basically maximum throughput.

SPECJBB 2013-Multi max-jOPS

As long as you run enough JVMs on top your server, the Xeon D and Xeon E5 will not dissapoint. The Xeon D is at least 37% faster than the previous Xeon E3 generation, the Xeon E5 delivers 50% more. 

The Critical-jOPS metric is a throughput metric under response time constraint.

SPECJBB 2013-Multi Critical-jOPS

The Xeon D seems to be slightly hindered by the lack of memory bandwidth in the max throughput benchmark, but less than in our HPC benchmark. It is important to understand that maximum throughput is very important in a HPC benchmark, but for a Java based back-end server, the critical benchmark matters much more than the maximum one. The reason is simple: the critical benchmark tells you what your customers will experience on a daily basis, the maximum throughput benchmark descibes what you will get in the worst case scenario when your server is pushed to its limits. 

In the critical benchmark, the Xeon D is at least 65% faster than any Xeon E3. The Broadwell core is a minor improvement over the Haswell core when you look at performance only (single threaded integer performance), but once it is integrated in a chip like the Xeon D, it is astonishing how much performance per watt you get. A 60-70% increase in performance per watt is a rare thing indeed. 

SPECJBB®2013 is a registered trademark of the Standard Performance Evaluation Corporation (SPEC).
HPC: Fluid Dynamics Web Server Performance
Comments Locked

90 Comments

View All Comments

  • Kjella - Tuesday, June 23, 2015 - link

    Server on a chip? It's not intended for use with a display, it does all it's "supposed to" do for the hyperscale market without any display.
  • close - Tuesday, June 23, 2015 - link

    "Intel was able to combine 8 of them together with dual 10 Gbit, 4 USB 3.0 controllers, 6 SATA 3 controller and quite a bit more".
    This ^^ makes it a SoC. Ok, a video output would be nice but that certainly doesn't disqualify it.
  • ats - Tuesday, June 23, 2015 - link

    cause video isn't required or even wanted in this market segment. It is a SoC, which simply means system on a chip and doesn't have some ironclad definition. Hell, most "SoC" chips aren't really systems on a chip anyways and require significant supporting logic (this is true for just about any cell phone SoC on the market too).
  • bill.rookard - Tuesday, June 23, 2015 - link

    Exactly, you would tend to use remote management over the network to admin this type of a unit. I have several rackmounted servers in my basement (I do some home-serving of websites over a business class connection) and while I do have them actually hooked up to a display, I can hardly remember the last time I looked at them as 99.9% of the time I SSH into everything for administration.

    About the only time you'd ever really use a display is if you were doing multiple VMs of assorted types. Beyond that, it's wattage wasted.
  • ats - Tuesday, June 23, 2015 - link

    Yeah honestly, having several SM boards with their ILM system, the only time I'd ever hook up a display is if the network was down. The SM ILM will fully proxy pretty much anything you want and give you a 1200p display that works for just about anything. And you can remotely hook up CDs, DVDs, BRs, USB, etc through it along with the stand console and keyboard/mouse functions. Its a very nice solution.
  • nightbringer57 - Tuesday, June 23, 2015 - link

    Basically, you don't need video output.
    Even if you do, mainboard manufacturers usually include a third-party chip with dedicated functions that, along other things, provide a VGA port usable for a server use.
    In this case, the AST2400 chip offers some basic GPU functions with a VGA port along with many remote control-related stuff.
    Adding all those functions to the Intel SoC would be awfully expensive. The chip only requires a simple PCIe x1 connection from the SoC, but provides hundreds of additional pins. Not only would those functions probably be hard to implement on a relatively recent 14nm process, but it would require at least 300 new pins on the SoC to add all the 3rd party chip's functions on it, which is almost impossible to do.
  • Th-z - Tuesday, June 23, 2015 - link

    There doesn't seem to have a concrete definition for the term SoC, but it's ridiculous now with the term SoC bandwagon. Everything seems to be called "SoC" these days as long as a chip has more than one functions integrated. One of examples is people even called current console's integrated CPU and GPU chip as SoC, which doesn't even have networking and other peripheral units in it. When a system has so many "SoCs" inside, the term really has lost its meaning and significance.
  • redzo - Tuesday, June 23, 2015 - link

    I'm thinking this is a bad name for a product like this. It reminds of the infamous Celeron D and Pentium D line.
  • nandnandnand - Tuesday, June 23, 2015 - link

    Anyone who can figure out Xeon D exists can probably tell the difference
  • wussupi83 - Tuesday, June 23, 2015 - link

    I agree with redzo, I think anyone who can figure out a 'Xeon D' exists AND remembers that Pentium & Celeron D's existed would initially assume this is a budget Xeon - which it's clearly not. E4 sounds pretty logical. But sure lets just put D...

Log in

Don't have an account? Sign up now