Benchmarking Performance: CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

SunSpider 1.0.2

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Sunspider goes after peak frequency most of the time, althoguh there is some variation as it moves into basically becoming a legacy test.

Mozilla Kraken 1.1

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Kraken is more of an intense attack on JS, and still regularly sorts by IPC and frequency.

Google Octane 2.0

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

Octane seems to be an optimization target, and with the new Skylake-X it shows.

WebXPRT 2015

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

264 Comments

View All Comments

  • FreckledTrout - Tuesday, June 20, 2017 - link

    If the 16 core Threadripper ends up being higher perfomant, cheaper, and using less power then it this argument wont matter. Im not sure it will win all three but it could.
  • Lolimaster - Tuesday, June 20, 2017 - link

    <$1000 for 16 core Zen, spent your money there, worth the extra over the 8 core Ryzen.
  • Flunk - Tuesday, June 20, 2017 - link

    No, it isn't. In a professional setting it's better to have more, less expensive systems rendering/serving/anything that just needs more processor time. For an additional $1000, I can double my performance rather than getting 20-30% more.
  • FMinus - Thursday, June 22, 2017 - link

    Frankly I was looking at an upcoming 12 core CPU from either AMD or Intel for my render machine, with the EPYC prices announced, I could see myself going with two AMD Threadrippers 12 cores if they keep them under $800. I got most parts, just need motherboards and the chips, and if they really do keep the price under $800 for 12 core TR, I will get two systems for a bit more as just the 12 core CPU from Intel will cost. Granted since I got most other parts I spent that ahead, but still, two systems easily. And of course the power consumption will be higher, but still.
  • someonesomewherelse - Saturday, October 14, 2017 - link

    What about a single processor 24 core (or even 32 core) epyc? Slightly lower clocks but the 32 core's extra cores should make up for it and it's cheaper than 2 12 core threadrippers especially once you factor in the motherboards/ram/... and ease of use.
  • someonesomewherelse - Saturday, October 14, 2017 - link

    With TR being so cheaper you can have two computers rendering which will be almost twice as fast.
  • barleyguy - Saturday, June 24, 2017 - link

    The 1600x has a 4.1 GHz XFR frequency, which requires good cooling but seems to kick in more than other Ryzen processors, likely because of two less cores. So on lightly threaded tasks without manual overclocking, the 1600x is a great choice.

    Manual overclocking changes the picture a bit though. In that case the 1600 and 1700 move up in bang for the buck, as does the i7 7700k.
  • chrysrobyn - Monday, June 19, 2017 - link

    Zen isn't winning anything here, but they're showing up to the party. It's hard to ignore their prices, which are always lower than the Intel chips in the neighborhood (summed up in the conclusion with "Play it cheaper but competitive"), and their power -- 1/3rd less power than the Intel chips nearby -- which I didn't even see addressed?
  • Ian Cutress - Monday, June 19, 2017 - link

    I made the graph, forgot to write about it. Doing so now...

    (I always end up writing through the launch time :D)
  • Ian Cutress - Monday, June 19, 2017 - link

    OK sorry, done. I'm currently in another briefing for something else...

Log in

Don't have an account? Sign up now