CPU Benchmark Performance: AI Performance

As technology progresses at a breakneck pace, so do the demands of modern applications and workloads. As artificial intelligence (AI) and machine learning (ML) become increasingly intertwined with our daily computational tasks, it's paramount that our reviews evolve in tandem. To this end, we have AI and inferencing benchmarks in our CPU test suite for 2024. 

Traditionally, CPU benchmarks have focused on various tasks, from arithmetic calculations to multimedia processing. However, with AI algorithms now driving features within some applications, from voice recognition to real-time data analysis, it's crucial to understand how modern processors handle these specific workloads. This is where our newly incorporated benchmarks come into play.

Given makers such as AMD with Ryzen AI, with multiple iterations including the XDNA 2 NPU within the Ryzen AI 9 HX 370, and Intel with their Meteor Lake mobile platform featuring AI-driven hardware, aptly named Intel AI Boost within the silicon, AI, and inferencing benchmarks will be a mainstay in our test suite as we go further into 2024 and beyond.  While there's currently no defacto benchmark for AI at the moment, we've compiled a couple of different benchmarks to gauge performance.

It's also worth noting that desktop processors don't really utilize NPUs, so all of the grunt in the below benchmarks is done using the CPU.

(6-2) DeepSpeech 0.6: Acceleration CPU

(6-3) TensorFlow 2.12: VGG-16, Batch Size 16 (CPU)

(6-3b) TensorFlow 2.12: VGG-16, Batch Size 64 (CPU)

(6-3d) TensorFlow 2.12: GoogLeNet, Batch Size 16 (CPU)

(6-3e) TensorFlow 2.12: GoogLeNet, Batch Size 64 (CPU)

(6-3f) TensorFlow 2.12: GoogLeNet, Batch Size 256 (CPU)

In our AI-based benchmarks, which leverage TensorFlow, and even in DeepSpeech, both the Ryzen 9 9950X and Ryzen 9 9900 comfortably beat the competition when using the CPU cores. This puts Zen 5 in a good light, but graphics compute in AI is where the performance is at. Still, comparing Zen 5 to Zen 4 and Intel's Raptor Lake, the Zen 5 chips comfortably beat out the competition here.

CPU Benchmark Performance: Simulation Gaming Performance: 720p
Comments Locked

123 Comments

View All Comments

  • ZoZo - Thursday, August 15, 2024 - link

    Probably busy being RMA'd
  • bigboxes - Monday, August 19, 2024 - link

    HA!
  • shabby - Wednesday, August 14, 2024 - link

    That ppm issue is pretty bad, these chips shouldn't have been launched like this.
  • NextGen_Gamer - Wednesday, August 14, 2024 - link

    I am curious as to why AnandTech didn't immediately retest a subset of games, just a couple of the worst offenders, with the PPM disabled to see what happens. If the performance is restored and just fine with it turned off, that really isn't a huge problem. Software can always be fixed - or turned off lol. Definitely seems like AMD made the wrong choice saying PPM should be bundled and enabled by default though.
  • coburn_c - Wednesday, August 14, 2024 - link

    it's not a PPM issue, it's that one of the CCDs is trash
  • Gigaplex - Thursday, August 15, 2024 - link

    That would show up in a multi threaded load.
  • Oxford Guy - Friday, August 16, 2024 - link

    There is also a difference between one that clocks a bit better and "trash."

    It has been long known, afaik, that some cores are a bit better than others. It seems obvious that the same applies to CCDs.

    A third hypothesis, in terms of why this core parking software is being required seems to be that AMD is maximizing performance by favoring the CCD that has the better performance.
  • Samus - Saturday, August 17, 2024 - link

    It's a software issue, and like many previous software issues AMD has had (particularly with Microsoft Windows) it will be sorted out.
  • Blastdoor - Wednesday, August 14, 2024 - link

    Nice to see that AMD's 2024 top of the line chip fabbed on TSMC N4 can beat Intel's best 2023 chip fabbed on Intel 7.

    I look forward to seeing how it does against Intel's best 2024 chip fabbed on Intel 20A.
  • eva02langley - Wednesday, August 14, 2024 - link

    You probably missed the part about Intel Raptor Lakes Woes. Go back and read it.

    Also,

    "The Ryzen 9 9950X was 33% faster than the Intel Core i9 14900K performance overall and even the Ryzen 9 9900X was 18% faster than the Core i9 14900K. For those still on AM4, the Ryzen 9 9950X was delivering 1.87x the performance of the Ryzen 9 5950X processor. These are some great gains found with the Ryzen 9 9900 series."

    -Phoronix

Log in

Don't have an account? Sign up now