The Next Generation Open Compute Hardware: Tried and Tested
by Johan De Gelas & Wannes De Smet on April 28, 2015 12:00 PM ESTBenchmark Results
Though the systems are equipped with similar components, some notable observations can be made. Each benchmark was executed three times to verify the accuracy of our results. All ratios are calculated using the Dell R730 as baseline (=100%).
| OLAP | 95pct Response Time (Lower is better) |
Power (Lower is better) |
Throughput (Higher is better) |
|||
| Concurrency | Facebook Leopard |
Intel Decathlete v2 |
Facebook Leopard |
Intel Decathlete v2 |
Facebook Leopard |
Intel Decathlete v2 |
| 5 | 114% | 111% | 99% | 99% | 94% | 117% |
| 10 | 108% | 105% | 99% | 98% | 96% | 109% |
| 25 | 96% | 94% | 100% | 101% | 100% | 116% |
| 50 | 98% | 56% | 103% | 110% | 101% | 112% |
| 100 | 96% | 49% | 110% | 149% | 103% | 119% |
| 250 | 98% | 67% | 105% | 144% | 103% | 120% |
| 250 | 95% | 67% | 106% | 144% | 103% | 120% |
| 250 | 95% | 67% | 105% | 143% | 102% | 120% |
| 250 | 90% | 62% | 106% | 143% | 103% | 121% |
An interesting result: the Dell outperforms both Open Compute servers when it comes to energy efficiency. It is good to remember that the PSU used for the Facebook server is not optimal (it should get its power from a power shelf). Leopard is very close, and gets a slightly better performance mark, while Decathlete is a respectable 20% faster, but uses 40% more power in the process.
Next, we tested with our real-world Elasticsearch benchmark. Due to ES's internal queuing algorithm, the throughput and response time can vary wildly when it drops a 'heavy' request to allow it to pass many smaller ones, and we've seen the inverse happen as well. These tests were executed five times to confirm ensure the consistency of most results.
| ElasticSearch | 95pct Response Time (Lower is better) |
Power (Lower is better) |
Throughput (Higher is better) |
|||
| Concurrency | Leopard | Decathlete v2 | Leopard | Decathlete v2 | Leopard | Decathlete v2 |
| 5 | 115% | 73% | 107% | 106% | 96% | 104% |
| 10 | 88% | 88% | 75% | 94% | 101% | 101% |
| 25 | 74% | 26% | 90% | 98% | 118% | 165% |
| 50 | 96% | 41% | 95% | 104% | 100% | 153% |
| 100 | 97% | 74% | 98% | 108% | 107% | 124% |
| 200 | 103% | 85% | 97% | 112% | 108% | 129% |
| 200 | 96% | 75% | 100% | 110% | 108% | 130% |
| 200 | 89% | 66% | 95% | 112% | 110% | 137% |
| 200 | 96% | 80% | 95% | 108% | 113% | 128% |
| 250 | 92% | 70% | 97% | 113% | 101% | 121% |
Whereas the Dell and Leopard performed comparably in the OLAP test, ElasticSearch tests results are in favor of the Leopard. The throughput and response times are slightly better and Leopard uses slightly less power resulting in a tangibly better performance/watt with a sub optimal power supply. The Decathlete system gets the best scores on the board again, but this time the power usage increase is relatively modest: 8 to 13 percent.
Facebook
Twitter
RSS
26 Comments
View All Comments
SuperVeloce - Wednesday, April 29, 2015 - link
From Mass storage: "Compared to hard disks optical media touts greater reliability, with Blu-ray discs having a life expectancy of 50 years and some discs could even be able to live on for a century."Yeah sure. Like my expensive gold color cd's from different vendors, baked on different high quality writers, now mostly not working anymore after some 15-20 years. Despite being held in almost perfect environment all these years
Uplink10 - Wednesday, April 29, 2015 - link
Someday they are going to figure out that:-SAS HDDs are costlier but if you are using RAID it does not matter, they should use consumer drives and not overpriced enterprise drives
-I calculated sometimes back if Bluray cold storage is cheaper than HDDs but it is not and more so you cannot change the data once you write it, it is better to go with HDDs
toyotabedzrock - Wednesday, April 29, 2015 - link
You have to wonder what these networking chip vendors are hiding in the firmware that makes them so resistant to open sourcing the code.Casper42 - Monday, May 4, 2015 - link
Johan, some of the HP info at the end was interesting, but incomplete.If you (or anyone reading this) plan to talk to HP, they will also talk about their relatively new CloudLine "CL" type machines as well.
They come in standard 1RU/2RU designs as well as OpenRack designs coming soon.
And the SL line is all being morphed over to Project Apollo which uses the XL prefix.
Apollo 2500 is now live, 4X00 will replace SL4500, 6000 has already replaced S6500, and the 8000 was a net-new add for Gen9 focused on big HPC farms.
So anything SL is, or soon will be, a dead platform. (The SLs you mention could be an exception since they are not widely commercially available)
Netpower - Tuesday, June 2, 2015 - link
One general problem with this design is how to take care of power line disturbances entering the power shelves via the 277V AC lines. The 48V DC is filtered via the 48V battery but you must add a filter/power line conditioner somewhere to make sure that transients and sags doesn't kill your power shelves. The 380V DC approach by (http://www.emergealliance.org) is much more reliable and still have all the advantages with higher efficiency, lower cable losses etc.Astana - Wednesday, September 16, 2020 - link
It is believed that the nicotine addiction of a smoker prevents you from quitting. But modern research has shown that the quitting process is complicated by psychological addiction. That's why many people can't cope with the habit of smoking. But there are results with https://heroindetoxeurope.com/ drvorobjev hospital they're all successful.The problem of smoking is not only the problem of men, but also increasingly - women. Many women are wondering: "How can you quit smoking and not get better? Psychologists have proven that when a woman quits smoking, she subconsciously tries to replace, to compensate for the process of smoking with food. This feeling is also familiar to men who quit smoking, but they do not attach much importance to it. As a result, very soon an extra 3-4 kg or more will appear.