** = Old results marked were performed with the original BIOS & boost behaviour as published on 7/7.

Benchmarking Performance: CPU Office Tests

The Office test suite is designed to focus around more industry standard tests that focus on office workflows, system meetings, some synthetics, but we also bundle compiler performance in with this section. For users that have to evaluate hardware in general, these are usually the benchmarks that most consider.

All of our benchmark results can also be found in our benchmark engine, Bench.

PCMark 10: Industry Standard System Profiler

Futuremark, now known as UL, has developed benchmarks that have become industry standards for around two decades. The latest complete system test suite is PCMark 10, upgrading over PCMark 8 with updated tests and more OpenCL invested into use cases such as video streaming.

PCMark splits its scores into about 14 different areas, including application startup, web, spreadsheets, photo editing, rendering, video conferencing, and physics. We post all of these numbers in our benchmark database, Bench, however the key metric for the review is the overall score.

We're investigating the PCMark results, which seem abnormally high.
Update: We can't do a direct comparison due to the lack of a RX460 for PCMark for the moment

3DMark Physics: In-Game Physics Compute

Alongside PCMark is 3DMark, Futuremark’s (UL’s) gaming test suite. Each gaming tests consists of one or two GPU heavy scenes, along with a physics test that is indicative of when the test was written and the platform it is aimed at. The main overriding tests, in order of complexity, are Ice Storm, Cloud Gate, Sky Diver, Fire Strike, and Time Spy.

Some of the subtests offer variants, such as Ice Storm Unlimited, which is aimed at mobile platforms with an off-screen rendering, or Fire Strike Ultra which is aimed at high-end 4K systems with lots of the added features turned on. Time Spy also currently has an AVX-512 mode (which we may be using in the future).

For our tests, we report in Bench the results from every physics test, but for the sake of the review we keep it to the most demanding of each scene: Ice Storm Unlimited, Cloud Gate, Sky Diver, Fire Strike Ultra, and Time Spy.

3DMark Physics - Ice Storm Unlimited3DMark Physics - Cloud Gate3DMark Physics - Fire Strike Ultra3DMark Physics - Time Spy3DMark Physics - Time Spy

The older Ice Storm test didn't much like the Core i9-9900K, pushing it back behind the R7 1800X. For the more modern tests focused on PCs, the 9900K wins out. The lack of HT is hurting the other two parts.

GeekBench4: Synthetics

A common tool for cross-platform testing between mobile, PC, and Mac, GeekBench 4 is an ultimate exercise in synthetic testing across a range of algorithms looking for peak throughput. Tests include encryption, compression, fast Fourier transform, memory operations, n-body physics, matrix operations, histogram manipulation, and HTML parsing.

I’m including this test due to popular demand, although the results do come across as overly synthetic, and a lot of users often put a lot of weight behind the test due to the fact that it is compiled across different platforms (although with different compilers).

We record the main subtest scores (Crypto, Integer, Floating Point, Memory) in our benchmark database, but for the review we post the overall single and multi-threaded results.

Geekbench 4 - ST Overall

Geekbench 4 - MT Overall

Benchmarking Performance: CPU Encoding Tests Benchmarking Performance: CPU Legacy Tests
Comments Locked

447 Comments

View All Comments

  • Irata - Monday, July 8, 2019 - link

    Thanks for your reply Ryan. I did not intend to be rude when saying "lazy" but rather show that I do not think this is something that was done by intent.

    Like I said - mention these things and it helps clear up misunderstandings.

    It is definitely very positive that you test the Ryzen CPU with the latest builds though.
    I also like that you mention if prices include an HSF or not, but it would have been nice to mention the price of HSF used for Intel systems (when not boxed), as e.g. the Thermalright True Copper is a rather expensive CPU cooler.

    I think you already addressed not using a faster nVME drive (a PCIe 4 version would have been ideal if available - this would also have given an indication of potentially increased system power use for the Ryzen with PCIe 4 drives) on Twitter.

    Those are little nitpicks, so not intended to be a criticism of the overall article. It is just that people tend to be rather sensitive when it comes to Intel vs. AMD CPU comparisons, given Intel's history of things they are willing to do to keep mind- and marketshare.
  • Daeros - Monday, July 15, 2019 - link

    Whether or not it is intentional, AT has had an increasing Intel bias over the last several years. Watch to see how long it takes for an AMD article to get pushed down by rumors or vaporware from Intel or Nvidia.
  • rarson - Monday, July 8, 2019 - link

    I think Ryan brings up several salient points, and whether or not you think that they did or did not have the time to do what you wanted (they were also a man down without Dr. Cuttress), the fact of the matter is that AMD dropped a bunch of CPUs and GPUs all at once and literally everyone was scrambling to do what they could in order to cover these launches.

    I don't think it's coincidence that even in the tech Youtube space, if you watch 10 different reviews you'll largely see 10 different testing methodologies and 10 (somewhat) different results. Every single reviewer I've talked to said that this was one of, if not the most, difficult launch windows they've ever dealt with. Additionally, launching on a weekend with all of its associated complications (not just on reviewers' ends, but partners as well) is a bitch, with everyone scrambling at the last minute on their days off getting in last-minute updates and whatnot.

    When AMD tells you at the last minute, "Oh, the brand new Windows 10 update includes something new" you don't necessarily have time to go back and redo all the benchmarks you had already done on the Intel platform.

    TL;DR while there may have been flaws in some of the testing, take the details with a grain of salt and compare them to the myriad of other reviews out there for a better overall picture if necessary.
  • Irata - Tuesday, July 9, 2019 - link

    You are making a good point and unfortunately this was an - unfortunately - typical AMD CPU launch with things still being beta. I would assume testers are none too happy about having to re-do their tests.

    What I don't get from AMD (even if (and that's a capital IF) it's not their fault, it's their responsibility) is how they cannot see how this makes their products appear in a less favorable light. Let's say the buggy bios cost them 5%, the conclusion with a 5% better performance would have been even more in Ryzen 3000's favor.

    It's a bit like showing up to a job interview wearing the clothes you wore for the previous day's physical activity.
  • Daeros - Monday, July 15, 2019 - link

    Lazy isn't in it. Intentionally misleading is more like it. On one page, where AMD wins more than it looses in the charts, out of 21 paragraphs, 2 had something positive to say about AMD or Ryzen 3k without following up with something along the lines of "but we know Intel's got new tech coming, too"
  • Ryan Smith - Monday, July 8, 2019 - link

    To be sure, they're still valid. The patches for Fallout and ZombieLoad are not out yet (I only mention them because the vulnerabilities have already been announced).
  • RSAUser - Monday, July 8, 2019 - link

    They've been out since 14 May, what are you talking about?
  • djayjp - Monday, July 8, 2019 - link

    Don't forget RIDL
  • Meteor2 - Sunday, July 14, 2019 - link

    RIDL and Zombieload are the same thing.

    Yes, the Intel CPUs should have been re-benchmarked on 1903, updated after 14 May when the OS-side fixes for the new MDS-class flaws were released. That's only fair and it's quite reasonable to expect that users will apply security updates, not leave their systems unpatched and vulnerable for perhaps a percent or two of performance.
  • FireSnake - Monday, July 8, 2019 - link

    Ryan: how is this not explained in the article? I am reading this site for more then a decade and I trust you most. and I trust you will provide such information. I would expect, you update the article with this info.

Log in

Don't have an account? Sign up now