CPU Web Tests

One of the issues when running web-based tests is the nature of modern browsers to automatically install updates. This means any sustained period of benchmarking will invariably fall foul of the 'it's updated beyond the state of comparison' rule, especially when browsers will update if you give them half a second to think about it. Despite this, we were able to find a series of commands to create an un-updatable version of Chrome 56 for our 2017 test suite. While this means we might not be on the bleeding edge of the latest browser, it makes the scores between CPUs comparable.

All of our benchmark results can also be found in our benchmark engine, Bench.

SunSpider 1.0.2: link

The oldest web-based benchmark in this portion of our test is SunSpider. This is a very basic javascript algorithm tool, and ends up being more a measure of IPC and latency than anything else, with most high-performance CPUs scoring around about the same. The basic test is looped 10 times and the average taken. We run the basic test 4 times.

Web: SunSpider on Chrome 56

Mozilla Kraken 1.1: link

Kraken is another Javascript based benchmark, using the same test harness as SunSpider, but focusing on more stringent real-world use cases and libraries, such as audio processing and image filters. Again, the basic test is looped ten times, and we run the basic test four times.

Web: Mozilla Kraken 1.1 on Chrome 56

Google Octane 2.0: link

Along with Mozilla, as Google is a major browser developer, having peak JS performance is typically a critical asset when comparing against the other OS developers. In the same way that SunSpider is a very early JS benchmark, and Kraken is a bit newer, Octane aims to be more relevant to real workloads, especially in power constrained devices such as smartphones and tablets.

Web: Google Octane 2.0 on Chrome 56

WebXPRT 2015: link

While the previous three benchmarks do calculations in the background and represent a score, WebXPRT is designed to be a better interpretation of visual workloads that a professional user might have, such as browser based applications, graphing, image editing, sort/analysis, scientific analysis and financial tools.

Web: WebXPRT 15 on Chrome 56

Benchmarking Performance: CPU Rendering Tests Benchmarking Performance: CPU Encoding Tests
Comments Locked

545 Comments

View All Comments

  • spdragoo - Thursday, April 19, 2018 - link

    Per Tom's Hardware (https://www.tomshardware.com/reviews/amd-ryzen-7-2...

    "Our test rigs now include Meltdown And Spectre Variant 1 mitigations. Spectre Variant 2 requires both motherboard firmware/microcode and operating system patches. We have installed the operating system patches for Variant 2.

    Today's performance measurements do not include Intel's motherboard firmware mitigations for Spectre Variant 2 though, as we've been waiting for AMD patches to level the playing field. Last week, AMD announced that it’s making the mitigations available to motherboard vendors and OEMs, which the company says should take time to appear in the wild. We checked MSI's website for firmware updates applicable to our X370 platforms when AMD made its announcement, but no new BIOSes were available (and still aren't).

    Unfortunately, we were only made aware that Variant 2 mitigations are present in our X470 board's firmware just before launch, precluding us from re-testing the Intel platforms with patches applied. We're working on this now, and plan to post updated results in future reviews.

    The lack of Spectre Variant 2 patches in our Intel results likely give the Core CPUs a slight advantage over AMD's patched platforms. But the performance difference should be minimal with modern processors."

    For those that are TL:DR in their viewpoint: unlike Anandtech, TH did NOT include all of the Spectre/Meltdown patches, & even said that there might be differences in their test results.
  • Chris113q - Thursday, April 19, 2018 - link

    Other reviewers also had their setups meltdown/spectre patched and it's been already confirmed that these patches don't greatly impact gaming performance at all.
    It's clear that Anandtech's results are wrong here. I have read 12 other reviews and most of their results differ from the ones you got. You'd have to be delusional to take just 1 review as the absolute truth.
  • Ninjawithagun - Thursday, April 19, 2018 - link

    Incorrect. Those reviews were conducted back in January 2018 (look at the review dates). Microsoft issued new patches for Meltdown and Spectre earier this month (April 2018). I could find no other performance review showing performance gain/loss for Intel CPUs based upon the new patches other than the one posted now by AnandTech.
  • Ninjawithagun - Thursday, April 19, 2018 - link

    The only way to know for sure is for each hardware reviewer to provide the exact version of Windows 10 they used for testing. This will prove whether or not they ran benchmarks with the most current Windows updates/patches.
  • Intel999 - Thursday, April 19, 2018 - link

    It is plausible that many reviewers were lazy and carried over data from earlier reviews on Intel and 1000 series Ryzen CPUs.

    Thank you Anandtech for doing aa genuinely unbiased review that required a great deal of extra work compared to others.
  • 5080 - Thursday, April 19, 2018 - link

    And don't forget BIOS patches as well. If you have a fully patched system the impact is even bigger than just updating with the Windows KB patches.
  • sor - Thursday, April 19, 2018 - link

    Looking at Tom’s results, they have OC intels in first place. Other than that it’s damn close. Is there a chance you’re just browsing graphs to see who is in the top spot and not really comprehending the results?

    Aside from that, the test setups and even benchmarks used are different. You owe Ian an apology for not realizing you’re comparing OC results to his.
  • Silma - Thursday, April 19, 2018 - link

    Yes. Ian is a top reviewer. At worst he made a mistake in this evaluations. It happens to the best of us.
    However, I have an issue with non OC test. It seems to me people will purchase overclockable processors and graphic cards to overclock them. At least game results should probably be based on OC benchmarks.
  • pogostick - Thursday, April 19, 2018 - link

    @Silma No, it makes more sense to do it this way. Everyone who buys these processors are guaranteed to have a part that will run the manufacturer spec. OC is a random lottery.
  • ACE76 - Thursday, April 19, 2018 - link

    Wrong... majority of even gamers DON'T overclock...that us relagated to a niche market of enthusiasts.

Log in

Don't have an account? Sign up now