Benchmarking Performance: CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

SunSpider 1.0.2 [link]

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Mozilla Kraken 1.1 [link]

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Google Octane 2.0 [link]

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

WebXPRT 2013 and 2015 [link]

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools. Web2013 is the older tool, superceded by Web2015, however both still are highly relevant for high-performance web applications today. 

Web: WebXPRT 13 on Chrome 56

Web: WebXPRT 15 on Chrome 56

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

254 Comments

View All Comments

  • Meteor2 - Wednesday, April 12, 2017 - link

    Benchmarks: I love the new Chromium compilation and straightforward 4K h264->h265 tests. Bravo.
  • Lehti - Wednesday, April 12, 2017 - link

    As it is, the Ryzen 5 lineup is a compelling purchase, even for us European who usually get awful deals with PC components. If AMD released it as an APU lineup, however, this would be a no-brainer for everyone. And yes, I know that Ryzen 5 chips are basically binned Ryzen 7s, but still...
  • vladx - Wednesday, April 12, 2017 - link

    Can't agree there, I'm from Europe and the 7600k is only around $20 more expensive than the Ryzen 1500x and it beats it in a lot of games and also fares better in office workloads. And that $20 gets at least even out when you put in consideration the Intel B250 motherboards which are $20-40 than competing AMD B350 mainstream offers.
  • Meteor2 - Wednesday, April 12, 2017 - link

    Where in Europe are you? In the UK the R5 1500X is $80 cheaper than the the i5-7600K.
  • t.s - Wednesday, April 12, 2017 - link

    You're focusing in single threaded apps / games, again, and again, and again. Not everyone use they computer for ST apps / games. And when you factored it in, R5 is very compelling product.
  • vladx - Thursday, April 13, 2017 - link

    That's true but enthusiasts and prosumers are maybe 2% of the market, the rest 98% won't use their PC for more than browsing the web, watching movies and basic office work.
  • deltaFx2 - Friday, April 14, 2017 - link

    @vladx : That's true but if browsing the web, watching movies, and basic office work is all you do, Excavator is perfectly fine for you. I expect people buying 7700k or R5 or even some i5s have some workloads that justify the expense. This is especially true of Ryzen as the current crop need an external GPU. IIRC Raven Ridge desktop parts come only next year.
  • Sages - Wednesday, April 12, 2017 - link

    Would it be possible to do another power review with ryzen like you guys did with Carrizo in 2016? Or do you guys not have the equipment for that? For me as a electrical engineering student that article was very interesting. Keep up the good work!!
  • TheJian - Wednesday, April 12, 2017 - link

    "A side note on OS preparation. As we're using Windows 10, there's a large opportunity for something to come in and disrupt our testing. So our default strategy is multiple: disable the ability to update as much as possible, disable Windows Defender, uninstall OneDrive, disable Cortana as much as possible, implement the high performance mode in the power options, and disable the internal platform clock which can drift away from being accurate if the base frequency drifts (and thus the timing ends up inaccurate)."

    Or you could have just used Win7 since 1/2 the world still uses it and don't plan on quitting it until well after 2020. Until I see someone actually REVIEW these chips with win7, they won't get my money. Vulkan runs on everything, I have no need for dx12 (all everything you guys just mentioned plus all the tracking etc etc). With no apu crap involved here, you should test win7 if only to show if there is any differences. Considering most of the issues are bios fixes it seems (motherboard), no reason to abandon win7 in testing. Again, half of your readers are using it, more than 2x win10, and many of these people are stuck on it because they don't know how to get back to win7...ROFL

    I can't wait for everyone to drop dx12 once whatever they're working on currently is done (many too far along to quit right now in a current game build). I think we'll see many more Vulkan/dx11 only announcements later this year. No point in a dev supporting an OS (dx12 I mean) that was given away for a year and still can't hit 1/2 of win7's users, not to mention many woke up an were accidentally "upgraded" to win10 with no ability to get back reliably. Uninstalling it doesn't always work (and many don't own win7 discs to get back in cases like Dell etc for some people) ;)

    But hey, keep acting like win7 doesn't exist much to the chagrin of your readers.
  • vladx - Wednesday, April 12, 2017 - link

    "Until I see someone actually REVIEW these chips with win7, they won't get my money."

    Who are you punishing here, but yourself? You probably shouldn't anyway because neither Ryzen or Kabylake are supported on Win7.

Log in

Don't have an account? Sign up now