Benchmarking Performance: CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

All of our benchmark results can also be found in our benchmark engine, Bench.

SunSpider 1.0.2: link

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

SunSpider has a single threaded focus, and we see the Kaby Lake-X processors take their spots at the top of the graph.

Mozilla Kraken 1.1: link

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Mozilla too relies on single threaded IPC and frequency. 

Google Octane 2.0: link

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

Octane is an interesting benchmark, requiring cores and ST performance, but mostly the latter. It also seems that either Intel's design is optimized for the benchmark or vice versa, given the substantial difference in performance. There's no way for the benchmark to use all of the threads from AMD, nor the 12 threads in the Core i7-7800X which has a lower single thread performance.

WebXPRT 2015: link

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

WebXPRT is a mix of ST and MT, but still based in the web and relies on ST performance a lot. Given the variable loading on the benchmark, Intel's newest features such as Speed Shift help keep it at the top.

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

176 Comments

View All Comments

  • Spoelie - Monday, July 24, 2017 - link

    On the first page, I assume the green highlight in the processor charts signifies an advantage for that side. Why are the cores/threads rows in the Ryzen side not highlighted? Or is 8/16 not better than 4/8?
  • Ian Cutress - Monday, July 24, 2017 - link

    Derp. Fixed.
  • Gothmoth - Monday, July 24, 2017 - link

    intel must really push money into anandtech. :) so many interesting things to report about and they spend time on a niche product.....
  • Ian Cutress - Monday, July 24, 2017 - link

    This has been in the works for a while because our CPU failed. I work on the CPU stuff - other editors work on other things ;) If you've got an idea, reach out to us. I can never guarantee anything (I've got 10+ ideas that I don't have time to do) but if it's interesting we'll see what we can do. Plus it helps us direct what other content we should be doing.
  • halcyon - Monday, July 24, 2017 - link

    This is an amazing amount of benchmarking with many options. thank you. Must have been a lot of work :-)
    The obvious idea is this:

    Gaming (modern CPU limited and most played games) & Productive work (rendering, encoding, 4K video work, R/statistics/Matlab)

    Test those under 4c/8t and 8c/16t CPUs both from AMD and Intel - all at most common non-esoteric overlock levels (+/-10%).

    This is what many of your readers want:

    How much does c. 5Ghz 4c/8t do vs 4.x Ghz 8c/16t when taken to it's everyday stable extreme, in modern games / productivity.

    The web is already full of benchmarks at stock speed. Or overclocked Ryzen R 7 against stock Intel, or OC intel against overclocked Ryzen - and the game/app selections are not very varied.

    The result is a simple graph that plots the (assumed) linear trend in performance/price and shows any deviations below/above the linear trend.

    Of course, if you already have the Coffee lake 6c/12t sample, just skip the 4c/8t and go with 6c/12t vs 8c/16 comparision.

    Thanks for all the hard work throughout all these years!
  • Ryan Smith - Monday, July 24, 2017 - link

    "so many interesting things to report about and they spend time on a niche product....."

    What can we say? CPUs have been our favorite subject for the last 20 years.=)
  • user_5447 - Monday, July 24, 2017 - link

    "For 2017, Intel is steering the ship in a slightly different direction, and launching the latest microarchitecture on the HEDT platform."

    Skylake-S, Kaby Lake-S and Kaby Lake-X share the same microarchitecture, right?
    Then Skylake-X is newer microarchitecture than Kaby Lake-X (changes to L2 and L3 caches, AVX-512).
  • Ian Cutress - Monday, July 24, 2017 - link

    Correct me if I'm wrong: SKL-SP cores are derived from SKL-S, and 14nm. KBL-S/X are 14+, and shares most of its design with SKL-S, and the main changes are power related. Underneath there's no real performance (except Speed Shift v2), but Intel classifies Kaby Lake as its latest non-AVX512 IPC microarchitecture.
  • user_5447 - Monday, July 24, 2017 - link

    Kaby Lake-S has some errata fixes compared to Skylake-S. AFAIK, this is the only change to the CPU core (besides the Speed Shift v2, if it even involved hardware changes).
    David Kanter says Skylake-X/EP is 14+ nm http://www.realworldtech.com/forum/?threadid=16889...
  • extide - Wednesday, July 26, 2017 - link

    I have a buddy who works in the fabs -- SKL-X is still on plain 14nm

Log in

Don't have an account? Sign up now