CPU Performance: Web and Legacy Tests

While more the focus of low-end and small form factor systems, web-based benchmarks are notoriously difficult to standardize. Modern web browsers are frequently updated, with no recourse to disable those updates, and as such there is difficulty in keeping a common platform. The fast paced nature of browser development means that version numbers (and performance) can change from week to week. Despite this, web tests are often a good measure of user experience: a lot of what most office work is today revolves around web applications, particularly email and office apps, but also interfaces and development environments. Our web tests include some of the industry standard tests, as well as a few popular but older tests.

We have also included our legacy benchmarks in this section, representing a stack of older code for popular benchmarks.

All of our benchmark results can also be found in our benchmark engine, Bench.

WebXPRT 3: Modern Real-World Web Tasks, including AI

The company behind the XPRT test suites, Principled Technologies, has recently released the latest web-test, and rather than attach a year to the name have just called it ‘3’. This latest test (as we started the suite) has built upon and developed the ethos of previous tests: user interaction, office compute, graph generation, list sorting, HTML5, image manipulation, and even goes as far as some AI testing.

For our benchmark, we run the standard test which goes through the benchmark list seven times and provides a final result. We run this standard test four times, and take an average.

Users can access the WebXPRT test at http://principledtechnologies.com/benchmarkxprt/webxprt/

WebXPRT 3 (2018)

WebXPRT 2015: HTML5 and Javascript Web UX Testing

The older version of WebXPRT is the 2015 edition, which focuses on a slightly different set of web technologies and frameworks that are in use today. This is still a relevant test, especially for users interacting with not-the-latest web applications in the market, of which there are a lot. Web framework development is often very quick but with high turnover, meaning that frameworks are quickly developed, built-upon, used, and then developers move on to the next, and adjusting an application to a new framework is a difficult arduous task, especially with rapid development cycles. This leaves a lot of applications as ‘fixed-in-time’, and relevant to user experience for many years.

Similar to WebXPRT3, the main benchmark is a sectional run repeated seven times, with a final score. We repeat the whole thing four times, and average those final scores.

WebXPRT15

Speedometer 2: JavaScript Frameworks

Our newest web test is Speedometer 2, which is a accrued test over a series of javascript frameworks to do three simple things: built a list, enable each item in the list, and remove the list. All the frameworks implement the same visual cues, but obviously apply them from different coding angles.

Our test goes through the list of frameworks, and produces a final score indicative of ‘rpm’, one of the benchmarks internal metrics. We report this final score.

Speedometer 2

Google Octane 2.0: Core Web Compute

A popular web test for several years, but now no longer being updated, is Octane, developed by Google. Version 2.0 of the test performs the best part of two-dozen compute related tasks, such as regular expressions, cryptography, ray tracing, emulation, and Navier-Stokes physics calculations.

The test gives each sub-test a score and produces a geometric mean of the set as a final result. We run the full benchmark four times, and average the final results.

Google Octane 2.0

Mozilla Kraken 1.1: Core Web Compute

Even older than Octane is Kraken, this time developed by Mozilla. This is an older test that does similar computational mechanics, such as audio processing or image filtering. Kraken seems to produce a highly variable result depending on the browser version, as it is a test that is keenly optimized for.

The main benchmark runs through each of the sub-tests ten times and produces an average time to completion for each loop, given in milliseconds. We run the full benchmark four times and take an average of the time taken.

Mozilla Kraken 1.1

3DPM v1: Naïve Code Variant of 3DPM v2.1

The first legacy test in the suite is the first version of our 3DPM benchmark. This is the ultimate naïve version of the code, as if it was written by scientist with no knowledge of how computer hardware, compilers, or optimization works (which in fact, it was at the start). This represents a large body of scientific simulation out in the wild, where getting the answer is more important than it being fast (getting a result in 4 days is acceptable if it’s correct, rather than sending someone away for a year to learn to code and getting the result in 5 minutes).

In this version, the only real optimization was in the compiler flags (-O2, -fp:fast), compiling it in release mode, and enabling OpenMP in the main compute loops. The loops were not configured for function size, and one of the key slowdowns is false sharing in the cache. It also has long dependency chains based on the random number generation, which leads to relatively poor performance on specific compute microarchitectures.

3DPM v1 can be downloaded with our 3DPM v2 code here: 3DPMv2.1.rar (13.0 MB)

3DPM v1 Single Threaded3DPM v1 Multi-Threaded

x264 HD 3.0: Older Transcode Test

This transcoding test is super old, and was used by Anand back in the day of Pentium 4 and Athlon II processors. Here a standardized 720p video is transcoded with a two-pass conversion, with the benchmark showing the frames-per-second of each pass. This benchmark is single-threaded, and between some micro-architectures we seem to actually hit an instructions-per-clock wall.

x264 HD 3.0 Pass 1x264 HD 3.0 Pass 2

CPU Performance: Encoding Tests Gaming: World of Tanks enCore
Comments Locked

213 Comments

View All Comments

  • monglerbongler - Friday, June 14, 2019 - link

    You don't need to buy a new computer every year and with an intelligently made upfront investment you can potentially keep your desktop, with minimal or zero hardware upgrades, for a *very* long time

    /news at 11

    If there is any argument that supports this its Intel's consumer/prosumer HEDT platforms.

    The X99 was compelling over X58. The x299 is not even remotely compelling. I still have my old X99/ i7-5930k (6 core 40 lane PCIe3). its still fantastic, but thats at least partially because I bit the bullet and invested in a good motherboard and GPU at the time. All modern games still play fantastically and it can handle absolutely anything I throw at it.

    More a statement of "future proofing" than inherent performance.
  • Sancus - Saturday, June 15, 2019 - link

    It's always disappointing to see heavily GPU bottlenecked benchmarks in articles like these, without a clear warning that they are totally irrelevant to the question at hand.

    It also feeds into the false narrative that what resolution you play at matters for CPU benchmarks. What matters a lot more is what GAME you're playing, and these tests never benchmark the actually CPU bound multiplayer games that people are playing, because benchmarking those is Hard.
  • BlueB - Friday, June 21, 2019 - link

    So if you're a gamer, there is STILL no reason for you to upgrade.
  • Hogan773 - Friday, July 12, 2019 - link

    I have a 2600K system with ASRock mobo

    Now that there is so much hype about the Ryzen 3, is that my best option if I wanted to upgrade? I guess I would need a new mobo and memory in addition to the CPU. Otherwise I can use the same SSD etc.
  • tshoobs - Wednesday, July 17, 2019 - link

    Still running my 3770 at stock clocks - "not a worry in the world, cold beer in my hand".

    Added an SSD and upgraded to a 1070 from the original GPU, . Best machine I've ever had.
  • gamefoo21 - Saturday, August 10, 2019 - link

    I was running my X1950XT AIW at wonder level overclocks with a Pentium M overclocked, and crushing Athlon 64 users.

    It would have been really interesting to see that 7700K with DDR3. I run my 7700K @ 5Ghz with DDR3-2100 CL10 on a GA-Z170-HD3. Sadly the power delivery system on my board is at it's limits. :-(

    But still a massive upgrade from a FX-8320e and MSI 970 mobo that I had before.
  • gamefoo21 - Saturday, August 10, 2019 - link

    I forgot to add that it's 32GB(8GB x 4) G.Skill CL9 1866 1.5V that runs at 2100 CL10 at 1.5V but I have to give up 1T command rate.

    The GPU that I carried over is the Fury X. Bios modded of course so it's undervolted, underclocked and the HBM timings tightened. Whips the stock config.

    The GPU is next up for upgrading, but I'm holding out for Navi with hardware RT and hopefully HBM. Once you get a taste of the low latency it's hard to go back.

    OpenCL memory bandwidth for my Fury X punches over 320GB/s with single digit latency. The iGPU in my 7700K, is around 12-14GB/s and the latency is... -_-
  • BuffyCombs - Thursday, February 13, 2020 - link

    There are several things about this article I dont like

    1. In the Game Tests, i actually dont care if one CPU is 50 Percent better when one shows 10 FPS and the other 15. Also I don’t care if it is 200 or 300 fps. So I would change to scale into a simple metric and that is: is it fun to play or not.

    2. Development is not mentioned: The Core Wars has just started and the monopoly of intel is over. Why should we invest in new processors when competition has just begun. I predict price per performance will fall faster in the next years than it did in the previous 10 years. So buying now is buying into an overpriced and fast developing marked.

    3. There is no Discussion if one should buy a used 2600k system today. I bought one a few weeks ago. It was 170 USD, has 16 GB of Ram and a gtx760. It plays all the games I throw at it and does the encoding of some videos I take in classes every week. Also I modified its cooler so that it runs very very silent. Using this system is a dream! Of course one could invest several times as much for a new system that is twice as fast in benchmarks but for now id rather save a few hundred bucks and invest when the competition becomes stagnant again or when some software I use really demands for it because of new instructions.
  • scrubman - Tuesday, March 23, 2021 - link

    Great write-up! Love my 2600k still to this day and solid at 4.6GHz on air the whole time! I do see an upgrade this year though. She's been a beast!! Never thought the 300A Celeron OC to 450 would get beat! haha
  • SirBlot - Monday, July 25, 2022 - link

    I get 60fps SotTR cpu game and render with rtx 3060ti with ray tracing on medium and everything else ultra. 2600k @4.2

Log in

Don't have an account? Sign up now