Benchmarking Performance: CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

All of our benchmark results can also be found in our benchmark engine, Bench.

SunSpider 1.0.2: link

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Mozilla Kraken 1.1: link

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Google Octane 2.0: link

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

WebXPRT 2015: link

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
POST A COMMENT

221 Comments

View All Comments

  • watzupken - Thursday, October 5, 2017 - link

    I don't know how you define as "best" for review graph. The point is that we are seeing new 6 cores solution from Intel, so very logically, people will be trying to compare apples with apples, i.e. 6 core solutions from both camps. So omitting the results from 1600 actually looks more than meets the eye to me, especially when you folks previously did a R5 1600X review. Reply
  • Ian Cutress - Thursday, October 5, 2017 - link

    I'm adding the R5 1600 data. It'll take 10-15 minutes, it's not a quick process. brb Reply
  • watzupken - Thursday, October 5, 2017 - link

    Thank you Ian. Please do add the data for R5 1600/X. From what I read elsewhere, it appears there is good competition between the Core i5 and R5 1600/X series. Reply
  • Ian Cutress - Thursday, October 5, 2017 - link

    OK, should be added. You might have to CTRL+F5 to clear the cache to see the updated versions. Reply
  • WinterCharm - Thursday, October 5, 2017 - link

    Thanks Ian!

    It really is the most logical and fair comparison.
    Reply
  • WinterCharm - Thursday, October 5, 2017 - link

    You really should have chosen SIMILARLY priced chips (So, 1700 / 1600 / 1600X) because it would have shown "here's the performance you get per dollar" which ultimately is what matters. Reply
  • Ian Cutress - Thursday, October 5, 2017 - link

    My ultimate goal is to have a graph widget that lets you select which CPU you want to focus on, and it automatically pulls in several around that price point as well as some of the same family. I'm not that skilled, though Reply
  • Error415 - Thursday, October 5, 2017 - link

    Performane per dollar doesn't matter, out right performance matters. SMH, only a fool buys the second best cpu when the best is only a few dollars more. Reply
  • zuber - Thursday, October 5, 2017 - link

    You basically just said "performance per dollar doesn't matter, only a fool ignores performance per dollar". Reply
  • sonny73n - Friday, October 6, 2017 - link

    +1 Reply

Log in

Don't have an account? Sign up now