CPU Benchmark Performance: AI Performance

As technology progresses at a breakneck pace, so do the demands of modern applications and workloads. As artificial intelligence (AI) and machine learning (ML) become increasingly intertwined with our daily computational tasks, it's paramount that our reviews evolve in tandem. To this end, we have AI and inferencing benchmarks in our CPU test suite for 2024. 

Traditionally, CPU benchmarks have focused on various tasks, from arithmetic calculations to multimedia processing. However, with AI algorithms now driving features within some applications, from voice recognition to real-time data analysis, it's crucial to understand how modern processors handle these specific workloads. This is where our newly incorporated benchmarks come into play.

Given makers such as AMD with Ryzen AI, with multiple iterations including the XDNA 2 NPU within the Ryzen AI 9 HX 370, and Intel with their Meteor Lake mobile platform featuring AI-driven hardware, aptly named Intel AI Boost within the silicon, AI, and inferencing benchmarks will be a mainstay in our test suite as we go further into 2024 and beyond.  While there's currently no defacto benchmark for AI at the moment, we've compiled a couple of different benchmarks to gauge performance.

It's also worth noting that desktop processors don't really utilize NPUs, so all of the grunt in the below benchmarks is done using the CPU.

(6-2) DeepSpeech 0.6: Acceleration CPU

(6-3) TensorFlow 2.12: VGG-16, Batch Size 16 (CPU)

(6-3b) TensorFlow 2.12: VGG-16, Batch Size 64 (CPU)

(6-3d) TensorFlow 2.12: GoogLeNet, Batch Size 16 (CPU)

(6-3e) TensorFlow 2.12: GoogLeNet, Batch Size 64 (CPU)

(6-3f) TensorFlow 2.12: GoogLeNet, Batch Size 256 (CPU)

In our AI-based benchmarks, which leverage TensorFlow, and even in DeepSpeech, both the Ryzen 9 9950X and Ryzen 9 9900 comfortably beat the competition when using the CPU cores. This puts Zen 5 in a good light, but graphics compute in AI is where the performance is at. Still, comparing Zen 5 to Zen 4 and Intel's Raptor Lake, the Zen 5 chips comfortably beat out the competition here.

CPU Benchmark Performance: Simulation Gaming Performance: 720p
Comments Locked

123 Comments

View All Comments

  • temps - Thursday, August 15, 2024 - link

    Anybody buying a 9950X to do "content creation" on a Linux computer ... is the content they're creating about their struggles doing content creation on a Linux PC?
  • Gigaplex - Thursday, August 15, 2024 - link

    Linux is fine for content creation.
  • PeachNCream - Friday, August 16, 2024 - link

    This exchange about "content creation" is a good example of why vague categories are so useful for marketing because it leaves the advertisers in a comfortable place where the targets of their ads are left to interpret what those words mean and that meaning, since it's ill-defined, can vary quite widely leading to legal immunity for sales speech. Meanwhile, people also tend to end up in an argument without being thoughtful enough to factor in potential differences in personal application of meaning to a given thing. We're quite a silly species.
  • GeoffreyA - Friday, August 16, 2024 - link

    "We're quite a silly species."

    We're in need of a major update, Service Pack level :)
  • Oxford Guy - Friday, August 16, 2024 - link

    "We're quite a silly species."

    Understatement of the century.
  • temps - Friday, August 16, 2024 - link

    I do audio, there is still not a single workable daw for Linux so no, it is not. In fact it's utterly useless
  • Oxford Guy - Friday, August 16, 2024 - link

    AI is coming for your job, anyway. : )
  • shabby - Wednesday, August 14, 2024 - link

    Intel is on 10nm desktop parts now, you expect them to skip a few nodes medically?
  • shabby - Wednesday, August 14, 2024 - link

    Magically
  • eva02langley - Wednesday, August 14, 2024 - link

    Well, they will by going with TSMC, but it will also bring a new set of issues like max frequencies, density and power.

    I am not sure Intel will be able to redo another Raptor Like trick on TSMC.

Log in

Don't have an account? Sign up now