Scale-Out Big Data Benchmark: ElasticSearch

ElasticSearch is an open source, full text search engine that can be run on a cluster relatively easy. It's basically like an open source version of Google Search that can be deployed in an enterprise. It should be one of the poster children of scale-out software and is one of the representatives of the so called "Big Data" technologies. Thanks to Kirth Lammens, one of the talented researchers at my lab, we have developed a benchmark that searches through all the Wikipedia content (+/- 40GB). Elasticsearch is – like many Big Data technologies – built on Java (we use the 64-bit server version 1.7.0).

Elastic Search

The term "Big data" almost immediately suggests that you need massive machines, more like the new Xeon E7 which supports up to 6 TB. In reality, many big data analyses are running on top of very humble machines in a cluster. ElasticSearch is such an an application: the underlying Java technology does not work well with a larger than 32 GB heap. A total of 64 GB RAM is considered as the sweet spot, to leave some RAM space for filesystem caching. 

The result of the Xeon D is stunning. The Xeon D is no less than 70% faster than the fastest Xeon E3s. Better performance is possible with the Xeon E5, but the price tag of those servers is not comparable to the Xeon D servers. The Xeon D-1540 (and as a result the SYS-5028D-TN4T) is the performance per dollar champ here. 

Web Server Performance Idle Power
Comments Locked

90 Comments

View All Comments

  • AkulaClass - Tuesday, June 23, 2015 - link

    Nice stuff. Realy good to see them bringing power consumption down pr. Performance.
  • WorldWithoutMadness - Tuesday, June 23, 2015 - link

    Nice way to confuse people. Codename Yosemite
  • retrospooty - Tuesday, June 23, 2015 - link

    Who would this confuse? Apple fans because of the OS witht he same codename?

    LOL. Believe me they don't know, or care... Most of them aren't even aware of what a "server" chip is, or even what a "server" is used for.
  • IanHagen - Tuesday, June 23, 2015 - link

    Rails developer checking in to remind you that a great chunk of the Rails community develop using OS X to deploy on Linux and hence is aware of "server chips". Even though you said that "most" Apple users don't know what a server chip is and that's accurate, the same could be said about Windows or even Linux common users. Stop patronizing.

    All being said, I agree with you. Who could possibly confound the Xeon D's codename coincides with OS X's 10.10 name?
  • WinterCharm - Tuesday, June 23, 2015 - link

    First of all, your implication that apple fans don't know jack shit about servers is a broad generalization, and a stupid one at that.

    Second of all, anyone who knows enough to even consider buying a Xeon and a motherboard that supports it and the ECC memory, probably knows enough to not get confused. And plenty of mac users know what server chips are and what they're used for.

    Nice trolling though.
  • adithyay328 - Tuesday, August 25, 2015 - link

    That's not entirely true, but I will agree that people a lot of the people who use Apples( No discrimination intended) only continue to use Apple due to their lack of tech knowledge( like knowing Android is the king :) . And, yes, they probably won;t know what servers even are.
  • jeffsci - Monday, June 29, 2015 - link

    Geographic code names are the norm in the computing industry (I think because they cannot be copyrighted) and they end up being reused. For example, Intel Seattle is/was a motherboard and AMD Seattle is/was an ARM64 processor. See https://en.wikipedia.org/wiki/List_of_Intel_codena... https://en.wikipedia.org/wiki/List_of_Microsoft_co... etc. if you would like to look for more examples :-)
  • RaiderJ - Tuesday, June 23, 2015 - link

    Any places in the US that the motherboard is available for purchase? Quick checks looks like it's mostly sold out or otherwise unavailable?
  • ats - Tuesday, June 23, 2015 - link

    Availability comes and goes. Xeon D has been a big hit in the large scale deployment markets and they've been soaking up a lot of demand for it, both bare and combined on motherboards like the supermicro offerings severely limiting retail availability. But it is available in retail but quantities are limited. Quite a number of people over at servethehome have gotten their hands on them. If you want one, you'll likely have to keep checking the major sites like newegg, amazon, et al for them to come back in stock. Retail boards are generally in the $800-1000 range atm (basically going for full list but then again bare motherboards with 10gbe tend to go for 600+ so its still a good buy and simple new 10gbe cards tend to go for $300-500).
  • ToTTenTranz - Tuesday, June 23, 2015 - link

    How come they call this a SoC if there's no integrated module to drive even a simple display, and they apparently need a discrete PCIe graphics card for that D-SUB output?

Log in

Don't have an account? Sign up now