Benchmarking Performance: CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

All of our benchmark results can also be found in our benchmark engine, Bench.

SunSpider 1.0.2: link

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Mozilla Kraken 1.1: link

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Google Octane 2.0: link

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

WebXPRT 2015: link

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

222 Comments

View All Comments

  • Chaser - Thursday, October 5, 2017 - link

    Thank you AMD.
  • vanilla_gorilla - Thursday, October 5, 2017 - link

    Exactly! No matter what side you're on, you gotta love the fact that competition is back in the x86 desktop space! And it looks like AMD 1700X is now under $300 on Amazon. Works both ways!
  • TEAMSWITCHER - Friday, October 6, 2017 - link

    I just don't see it this way. Since the release of Haswell-E in 2014 we've had sub $400 six core processors. While some like to compartmentalize the industry into mainstream and HEDT, the fact is, I built a machine with similar performance three years ago, for a similar price. Today's full featured Z370 motherboards (like the ROG Maximus X) cost nearly as much as X99 motherboards from 2014. To say that Intel was pushed by AMD is simply not true.
  • watzupken - Friday, October 6, 2017 - link

    I feel the fact that Intel had to rush a 6 core mainstream processor out in the same year they introduced Kaby Lake is a sign that AMD is putting pressure on them. You may find a Haswell E chip for sub 400 bucks in 2014, but you need to be mindful that Intel historically have only increase prices due to the lack of competition. Now you are seeing a 6 core mainstream chip from both AMD and Intel below 200 bucks. Motherboard prices are difficult to compare since there are lots of motherboards out there that are over engineered and cost significantly more. Assuming you pick the cheapest Z370 motherboard out there, I don't believe it's more expensive than a X99 board.
  • mapesdhs - Friday, October 6, 2017 - link

    KL-X is dead, that's for sure. Some sites claim CFL was not rushed, in which case Intel knew KL-X would be pointless when it was launched. People claiming Intel was not affected by AMD have to choose: either CFL was rushed because of pressure from AMD, or Intel released a CPU for a mismatched platform they knew would be irrelevant within months.

    There's plenty of evidence Intel was in a hurry here, especially the way X299 was handled, and the horrible heat issues, etc. with SL-X.
  • mapesdhs - Friday, October 6, 2017 - link

    PS. Is it just me or are we almost back to the days of the P4, where Intel tried to maintain a lead really by doing little more than raising clocks? It wasn't that long ago there was much fanfare when Intel released its first minimum-4GHz part (4790K IIRC), even though we all knew they could run their CPUs way quicker than that if need be (stock voltage oc'ing has been very productive for a long time). Now all of a sudden Intel is nearing 5GHz speeds, but it's kinda weird there's no accompanying fanfare given the reaction to their finally reaching 4GHz with the 4790K. At least in th mainstream, has Intel really just reverted to a MHz race to keep its performance up? Seems like it, but OS issues, etc. are preventing those higher bins from kicking in.
  • KAlmquist - Friday, October 6, 2017 - link

    Intel has been pushing up clock speeds, but (unlike the P4), not at the expense of IPC. The biggest thing that Intel has done to improve performance in this iteration is to increase the number of cores.
  • mapesdhs - Tuesday, October 10, 2017 - link

    Except in reality it's often not that much of a boost at all, and in some cases slower because of how the OS is affecting turbo levels.

    Remember, Intel could have released a CPU like this a very long time ago. As I keep having to remind people, the 3930K was an 8-core chip with two cores disabled. Back then, AMD couldn't even compete with SB, never mind SB-E, so Intel held back, and indeed X79 never saw a consumer 8-core part, even though the initial 3930K was a XEON-sourced crippled 8-core.

    Same applies to the mainstream, we could have had 6 core models ages ago. All they've really done to counter the lack of IPC improvements is boost the clocks way up. We're approaching standard bin levels now that years ago were considered top-notch oc's unless one was definitely using giant air coolers, decent AIOs or better.
  • wr3zzz - Thursday, October 5, 2017 - link

    I hope Anandtech solves the Civ6 AI benchmark soon. It's almost as important as compression and encoding benchmarks for me to decide CPU price-performance options as I am almost always GPU constrained in games.
  • Ian Cutress - Saturday, October 7, 2017 - link

    We finally got in contact with the Civ6 dev team to integrate the AI benchmark into our suite better. You should see it moving forward.

Log in

Don't have an account? Sign up now