CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

All of our benchmark results can also be found in our benchmark engine, Bench.

SunSpider 1.0.2: link

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Mozilla Kraken 1.1: link

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Google Octane 2.0: link

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

WebXPRT 2015: link

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

Overall, all of our web benchmarks show a similar trend. Very few web frameworks offer multi-threading – the browsers themselves are barely multi-threaded at times – so Threadripper's vast thread count is underutilized. What wins the day on the web are a handful of fast cores with high single-threaded performance.

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

347 Comments

View All Comments

  • verl - Thursday, August 10, 2017 - link

    "well above the Ryzen CPUs, and batching the 10C/8C parts from Broadwell-E and Haswell-E respectively"

    ??? From the Power Consumption page.
  • bongey - Thursday, August 10, 2017 - link

    Yep if you use AVX-512 it will down clock to 1.8Ghz and draw 400w just for the CPU alone and 600w from the wall. See der8auer's video title "The X299 VRM Disaster (en)", all x299 motherboards VRMs can be ran into thermal shutdown under avx 512 loads, with just a small overclock, not to mention avx512 crazy power consumption. That is why AMD didn't put avx 512 in Zen, it is power consumption monster.
  • TidalWaveOne - Thursday, August 10, 2017 - link

    Glad I went with the 7820X for software development (compiling).
  • raddude9 - Thursday, August 10, 2017 - link

    In ars' review they have TR-1950X ahead of the i9-7900X for compilation:
    https://arstechnica.co.uk/gadgets/2017/08/amd-thre...

    In short it's very difficult to test compilation, every project you build has different properties.
  • emn13 - Thursday, August 10, 2017 - link

    Yeah, the discrepency is huge - converted to anandtech's compile's per day the arstechnica benchmark maxes out at a little less than 20, which is a far cry from the we see here.

    Clearly, the details of the compiler, settings and codebase (and perhaps other things!) matter hugely.

    That's unfortunate, because compilation is annoyingly slow, and it would be a boon to know what to buy to ameliorate that.
  • prisonerX - Thursday, August 10, 2017 - link

    This is very compiler dependent. My compiler is blazingly fast on my wimpy hardware becuase it's blazingly clever. Most compilers seem to crawl no matter what they run on.
  • bongey - Thursday, August 10, 2017 - link

    Looks like anandtech's benchmark for compiling is bunk, it's just way off from all the other benchmarks out there. Not only that, no other test shows a 20% improvement over the 6950x which is also a 10 core/20 thread cpu. Something tells me the 7900x is completely wrong or has something faster like a different pcie ssd.
  • Chad - Thursday, August 10, 2017 - link

    All I know is, for those of us running Plex, SABnzbd, Sonarr, Radarr servers simultaneously (and others), while encoding and gaming all simultaneously, our day has arrived!

    :)
  • Ian Cutress - Thursday, August 10, 2017 - link

    We checked with Ars as to their method.

    We use a fixed late March build around v56 under MSVC
    Ars use a fixed newer build around v62 via clang-cl using VC++ linking

    Same software, different compilers, different methods. Our results are faster than Ars, although Ars' results seem to scale better.
  • ddriver - Friday, August 11, 2017 - link

    Of every review out there, only your "superior testing methodology" presents a picture where TR is slower than SX.

Log in

Don't have an account? Sign up now