It’s been a long two weeks following our AMD-review-athon weekend, culminating 7/7 with our extensive coverage of the new Ryzen 3000 series CPUs, the new Radeon RX 5700 series Navi GPUs, as well as our complete overview of X570 chipset based motherboards.

Among the things that didn’t go quite as planned for in the hectic period leading up to Sunday was the matter of launch BIOSes. Always a thorny issue with new platform launches – BIOSes are often under intensive development right up until a new platform ships – we ended up in a situation where some boards had multiple BIOS versions floating around, with performance differences among them. And, while Moore's Law may be dead, Murphy's Law is alive and well, so of course the BIOS we ended up doing our initial Ryzen 3000 testing on was not the best BIOS for the platform.

So, we want to clarify the timeline of events for how we initially tested, what we’ve re-tested, and if and how the new BIOS behavior might change our original conclusion of the Ryzen 3000 series.

To go a little bit behind the scenes and talk about AMD's sampling process, the company had initially focused on outfitting reviewers with a selection of 4 different X570 motherboards. Among them was MSI's flagship, the MSI MEG X570 Godlike, which along with the MSI MEG X570 Ace, we already had in the lab for use in our first round of motherboard reviews. In a stroke of bad luck, our Godlike didn't make it to us intact, and we were never able get it to boot. So, following a further comedy of logistics issues that end with us receiving the CPUs only a few days before the launch date – and thus, without enough time to get a replacement board – we turned to our other X570 board, MSI's MEG Ace.

The MSI X570 MEG Ace, in turn, is still one of MSI's high-end motherboards and would normally be a good choice for a review board. The pitfall of using the Ace in this situation, however, is it wasn't one of the launch boards AMD was working with. So it didn't have an explicit and finely-tuned review BIOS like the Godlike had.

Ultimately, due to time pressure as well as unfamiliarity with the new Ryzen 3000 boosting behavior, we didn’t quite catch any issues of the board’s BIOS (or had been forewarned of issues) until we learned about and A/B tested a new public BIOS by MSI following the review article.

In a custom frequency test, we were able to verify that AMD’s new UEFI CPPC2 interface (Collaborative Power and Performance Control) wasn’t correctly working on the board as it did not boost to the higher frequencies, but most importantly it didn’t ramp up frequencies in the 1-2ms periods that AMD had promised, but rather in a quite slow ~500ms.

Re-testing and Updating Our Numbers

We’ve since been able to re-test both the Ryzen 9 3900X as well as the Ryzen 7 3700X, and have accordingly updated the review article with the new numbers. Furthermore, for everyone who has already read the initial review, we wanted to post a summary of the changes in the different workloads we saw on the 3900X:

Ryzen 3900X Before & After: SPEC2017 & Web Tests

The biggest change was in tests that are bound by the performance of a single thread. These tests primarily have either multiple threads with just a single heavy thread, or just one thread period. Here we saw the effect of the new BIOS in action, allowing the CPUs to get nearer to their advertised maximum boost speeds, and we saw the biggest increases ranging from 4% in SPEC to 7-9% in the web tests.

Interactive tests such as WebXPRT particularly saw bigger changes as the frequency boosts was amplified by the faster frequency ramp-up speed, resulting in increases that were above the 5.8% higher boost frequencies we were able to verify.

Ryzen 3900X Before & After: Systems Tests
*Note: The 3900X AppTimer result is likely an outlier.

Ryzen 3900X Before & After: Rendering Tests

Ryzen 3900X Before & After: Encoding Tests

In the systems, rendering, and encoding tests, the performance changes and improvements strongly depended on the workload’s multi-threaded behavior. Agisoft’s Photoscan test behaves similarly to the web tests in terms of improvements, while heavy multi-threaded tests in the system suite didn’t see any changes. Some tests have single-threaded component bottlenecks in them which end up with improvements in-between, averaging around 2-3%.

Ryzen 3900X Before & After: Gaming (720p)

Gaming benchmark changes was a bit more varied in terms of results, particularly because we saw some larger degradations. The main reason here is that some titles while being multi-threaded, have only a limited number of threads. In these titles and situations where we’re not just purely bound by performance of a single large thread, it’s likely that we’re seeing the CPU clock slightly lower in the new release BIOS compared to what we tested originally. Our results were also consistent across multiple runs in this regard, so this isn't an artifact of normal run-to-run variation.

Overall Conclusion: Better Single-Threaded Results, But Same Positioning

Overall MSI's updated launch BIOS improved our original numbers the most in areas where the new Ryzen 3000 already excelled at: office and productivity applications. Particularly exclusive single-threaded workloads saw a larger boost which makes the new Zen 2 all the more impressive. Meanwhile the toss-up in the gaming results seems to point out that there’s still improvements to be made in AMD’s boosting algorithms. None of this changes our overall performance analysis or recommendations, but when the difference between Intel and AMD is sometimes a game of inches, it's unsurprising that everyone is greatly interested in even the smallest change.

AMD did note that results might vary from vendor BIOS to vendor BIOS. In this regard, we’ll be continuing to monitor BIOS changes over the next few weeks and see if there will be any more substantial behavior updates in the new Precision Boost 2 mechanism.

What is for sure though, is that if you’re aiming to buy a new Ryzen 3000 series CPU, make sure to keep yourself updated on the newest BIOS as it’s likely the versions shipping with new X570 boards will not fully represent the full performance the new CPUs are capable of.

POST A COMMENT

75 Comments

View All Comments

  • ballsystemlord - Thursday, July 11, 2019 - link

    According to your picture: https://images.anandtech.com/graphs/graph14605/111...
    The new BIOS does worse on the GIMP test. The ** is marking the old result, right?
    Reply
  • ballsystemlord - Thursday, July 11, 2019 - link

    3700X: 3.38 old. 3.50 new. Lower is better. Reply
  • ballsystemlord - Friday, July 12, 2019 - link

    No, wait, your talking the 3900X only. Ok. My bad. I understand now. Reply
  • Arnulf - Friday, July 12, 2019 - link

    "Frimware" x2. Reply
  • serjrps - Thursday, July 11, 2019 - link

    Slightly off topic, but will you be reviewing the rest of the Zen 2 lineup? Would be quite interesting to have the full picture here in Anandtech. Reply
  • Ryan Smith - Thursday, July 11, 2019 - link

    With the caveat that the lineup is so large that we may not review quite literally all of it, the plan is to get some more CPUs in sooner than later. Reply
  • RSAUser - Wednesday, July 17, 2019 - link

    Can you just pick the most popular?
    Normal line was the 2600, 2700X, then lower end the 2400G (have one, bit biased) and if even more time the 2200G.
    New line it seems the most popular are: 3600 (I have one, so little biased) and then far behind the 3700X.
    Of the APU: 3400G.
    Reply
  • GreenReaper - Thursday, July 11, 2019 - link

    Thanks for your update. But I hope you will also be testing the impact of MDS/Zombieload, as here?
    https://www.phoronix.com/scan.php?page=article&...

    Windows *did* patch for these, in mid-May, but this required updated microcode for the CPUs not containing it already (probably including 9th-gen review samples, as they tend to be some of the first). BIOS patches for the majority of the motherboards you were using were available prior to review, in May/June, and thus reflects the current performance of these CPUs; but the versions you used for Intel boards was from 2018.

    For your convenience, the Fatial1ty Z370 Professional Gaming i7 (Intel 9th- and 8th-gen):
    https://www.asrock.com/MB/Intel/Fatal1ty%20Z370%20...

    The X299 OC Formula (HEDT X-series):
    https://www.asrock.com/MB/Intel/X299%20OC%20Formul...

    Sadly the GA-X170-EXTREME ECC (7th- and 6th-gen) does not have a public update:
    https://www.gigabyte.com/uk/Motherboard/GA-X170-EX...
    but maybe Gigabyte could be hassled for one.
    Reply
  • Ryan Smith - Thursday, July 11, 2019 - link

    "Thanks for your update. But I hope you will also be testing the impact of MDS/Zombieload"

    Yes. That's on the big list of things to do for once all the necessary software/firmware drops into place.
    Reply
  • GreenReaper - Thursday, July 11, 2019 - link

    Thank you. I do appreciate that there was a lot going on these last couple of months.

    For what it's worth, microcode can also be updated without BIOS support, using a driver like this:
    https://labs.vmware.com/flings/vmware-cpu-microcod...

    I'm unsure whether this will trigger OS mitigation in this particular case, even if installed and activated on boot, but it could presumably be checked via Get-SpeculationControlSettings:
    https://support.microsoft.com/en-gb/help/4074629/u...
    Reply

Log in

Don't have an account? Sign up now