Conclusion

This year is perhaps one of the busiest of this decade for the PC, both in terms of the competitive landscape and how each chip manufacturer is trying to stay ahead of the other. If you've been keeping your ear close to the ground, looking to hear about what's coming around the corner or even what's going to be the next big thing (yes, RGB, you've had your day), then the most commonly used phrase when mentioned alongside the PC is AI. It's not just a buzzword, but it's an entire market driver with a lot of weight being pushed behind it from all sides.

Regardless of the opinion on AI, the AI PC, or what the AI PC actually is, more and more consumer hardware is coming equipped with AI on the chip. The first to market in the consumer space with a dedicated AI engine in the notebook space was AMD with their Zen 4-based Phoenix Point or the Ryzen 7040 series. Not to be outdone, but both Intel and even Quallcom have mobile processors with a Neural Processing Unit, or NPU as they are commonly known. It's less of a race to get AI on the PC, but it's more about who has the biggest TOPS. 

Touching on who currently has the biggest and meanest NPU on-chip in the notebook market with the highest TOPS is AMD, with the new XDNA 2 NPU architecture bringing this (current) victory to team AMD with the launch of the Ryzen AI 300 series, codenamed Strix Point. The Ryzen AI 300 series not only brings the highest TOPS from an NPU out, but it also marks the launch of AMD's latest Zen 5 microarchitecture. Even further, AMD has also brought their compact Zen 5c cores out on the same day as the main architecture, which is something they haven't done before; the compact cores usually come much later in the release cycle.

Today, AMD launches their Ryzen AI 300 series SoCs to the world, with a mixture of full-fat Zen 5 cores and the compact Zen 5c cores on the same die; they are, however, on their own CCXs. There are three chips at present, with the third being a late announcement, the Ryzen AI 9 HX 375, which actually has an XDNA 2 NPU, which is claimed to have 55 TOPS of AI performance under its hood. However, the rest of it is the same as the SoC we've been reviewing today, courtesy of the new ASUS Zenbook S 16 UM5606, which uses the AMD Ryzen AI 9 HX 370 to drive both compute and graphics.

The AMD Ryzen AI 9 HX 370 not only marks a new nomenclature, it not only brings the highest level of TOPS to notebooks on the market, but it also brings with it a new CPU core, Zen 5, which is built on TSMC's N4P (4 nm) node, but it also brings friends to the party. On top of the new XDNA 2 NPU, which is much faster than the previous NPU found in Phoenix and Hawk Point, it also brings the RDNA 3.5 graphics architecture, which looks to bring a whole host of improvements over RDNA 3 in terms of gaming performance.

Coming with a 12C/24T design, which consists of 4 x Zen 5 (full size) cores alongside 8 x Zen 5c (compact) cores, it has a base frequency of just 2.0 GHz, but the full-fat Zen 5 cores can boost all the way up to 5.1 GHz. Although it has a variable TDP of between 15 and 54 W, inside of the Zenbook S 16, it's configured at AMD's default TDP, which is 28 W. This puts it on parallel power-wise with Intel's Meteor Lake SoC chips. In contrast, the Ryzen 8040HS series had chips that started at 35 W and could be configured up to 54 W depending on the caliber of notebook or laptop it came in. However, TDPs aside, Zen 5 has finally arrived, and it's time to analyze how it currently shapes up in the mobile space.

Ryzen AI 9 HX 370 Performance Analysis

In this review, we not only tested the AMD Ryzen AI 9 HX 370 SoC (12C/24T) with the new Radeon 890M integrated graphics, but we've put it up against what it's replacing in the Zen 4 based Ryzen 9 7940HS (8C/16T) which has the RDNA 3 based Radeon 780M graphics. Intel's current Meteor Lake SoC, with the Intel Core Ultra 7 155H showcased in two notebooks, is also included.

(4-3b) CineBench 2024: Multi Thread

First up, the Ryzen AI 9 HX 370 didn't really appear to be anything special in the office and encoding sections of our CPU suite, with middling performance competitive with everything else. It put everything else to bed, though, and allowed the new Zen 5 cores (and Zen 5c) to stretch their proverbial legs. In the Cinebench 2024 rendering benchmark with the multi-threaded test selected, we saw the Ryzen AI 9 HX 370 outperform the Zen 4-based Ryzen 9 7940HS by around 17%, which is certainly a good win for Zen 5. It does have more cores, albeit more efficient and compact Zen 5c cores, but winning is winning.

(4-3) CineBench 2024: Single Thread

While Zen 5 boasts large IPC gains over Zen 4 (AMD claimed 16% on average), we didn't really see this for ourselves. The Ryzen AI 9 HX 370 still outperformed the 7940HS in the Cinebench 2024 single-threaded test, but it was more like 7% and not the 16% everyone was excited about. Fire up a workload that utilizes AVX-512, and sure, it will demolish, but in typical tasks, not so much.

AMD RDNA 3.5 Delivers Better Gaming Performance Than 3.0

Comparing RDNA 3 (Radeon 780M) to the latest RDNA 3.5 (Radeon 890M) in the Ryzen AI 9 HX 370, we saw improvements across all of our suites, which shows AMD has done wonders to improve their integrated graphics.

IGP Returnal, 1080p Medium - Average FPS

A prime example of AMD making improvements in performance over the last generation with the new Zen 5/Zen 5c SoC is in Returnal at 1080p with the medium preset selected. It managed to outperform the Ryzen 9 7940HS by 57%. While this isn't going to be the case in every game, we did see a consistent advantage to the Ryzen AI 9 HX 370 over the previous Phoenix Point-based 7940HS.

Overall, the combination of Zen 5 cores coupled with the RDNA 3.5-based Radeon 890M delivers better performance in gaming than the Phoenix-based Zen 4 predecessor and it also keeps Intel's current Meteor Lake SoC at bay. Still, it has to be said that integrated graphics still aren't quite there when it comes to delivering 1080p/60fps gaming, especially in big titles or AAA games, as they are more widely known. In lesser intensive games such as League of Legends, DOTA 2, and Faster Than Light.

The ASUS Zenbook S 16 UM5606: Sleek, Elegant and Highly Relevant

It wouldn't be fair to wrap up the Ryzen AI 9 HX 370 review without first giving some feedback and attention to ASUS's new Zenbook S 16 ultraportable notebook. The first thing to touch on is the design and overall composition of the Zenbook S 16's look and feel. First of all, the color is called 'Scandinavian White,' but to me, it looks more like a matte light silver, which isn't a complaint from me because it looks really good, especially when the sun shines on it. Secondly, it certainly looks lighter than it appears to be, but it's still lighter than the Apple 16-inch MacBook Pro with the M3 Max and most 16-inch notebooks, to be honest. It's deceptive how stylish and cloud-like it looks, but that's just my perception of how much it weighs compared to how I thought it was going to weigh based on how it looks.

Moving on, of course, the AMD Ryzen AI 9 HX 370 is going to take much of the plaudits, but the Zenbook 16 S certainly deserves some plaudits, too. It's thin at just 11.9 mm thick and includes plenty of nice subtle features, including thin bezels around the 16-inch Lumina OLED touchscreen display and an elegant white backlit keyboard that looks good when the lights get dimmed.

Of course, not everything is about looks, and at the heart of everything making it beat is the AMD Ryzen AI 9 HX 370. The ASUS Zenbook S 16 UM5606 itself, though, looks and feels as premium as any high-end notebook; it's packed with AI-integrated software features and applications for users to dive into if that's their thing. The chassis is made from ASUS's own material called 'Ceraluminum.' ASUS describes it as a high-tech ceramic designed to be both robust and light, with the naming sort of implying that it combines ceramic and aluminum. The result is a simple yet striking design that feels every bit as premium as it looks.

The ASUS Zenbook S 16 UM5606 starts at $1699 and is available now at retailers and on ASUS's website.

Final Thoughts: Ryzen AI 9 HX 370 Delivers in Intensive Loads, and RDNA 3.5 Does Well

AMD has firmly positioned itself at the forefront of the notebook market with the launch of the Ryzen AI 300 series, with Zen 5 being the star of the show. Zen 5 is the latest microarchitecture in AMD's roadmap and brings a host of improved architectures on key parts of the die itself. This includes the XDNA 2 NPU, which looks set to drive Microsoft Copilot+ AI-driven software into action and potentially push what NPUs and AI on-chip can do even more as we head into 2025. 

AMD also has the updated and upgraded RDNA 3.5 integrated graphics to help drive things forward, but again, it still doesn't compete with discrete graphics in terms of gaming performance. In contrast, it's designed more for premium ultrathin notebooks such as the ASUS Zenbook S 16, which seems a fitting launch platform for it.

Although the Ryzen AI 9 HX 370 with four regular Zen 5 cores and eight compact Zen 5c cores performed pretty well in multiple areas, it certainly did it when it counted, especially in more intensive workloads such as rendering. Less intensive workloads didn't really didn't tax it too much, and in those cases, it was pretty average in all honesty. In regular and real-world scenarios and workloads, we certainly didn't see up to a 16% increase in IPC performance, but the key is that Zen 5 has improved IPC over Zen 4. 

The Ryzen AI 300 series, including the Ryzen AI 9 HX 370, looks set to ignite a 'battle of the TOPS' where Generative AI performance is concerned among the main chip makers. Still, now that we've got Zen 5 in mobile, it'll be time soon to pivot towards Zen 5 for desktop, with the launch of the Ryzen 9000 series coming fast. In fact, it's in less than two weeks ever since AMD delayed the launch, so it'll be interesting to see how Zen 5 compares to Zen 4 on the desktop,  which is certainly a much hotter battleground.

Graphics Performance
Comments Locked

72 Comments

View All Comments

  • haplo602 - Monday, July 29, 2024 - link

    I second this request. Would be nice to see at least a brief analysis how the CPU behaves on different power levels.
  • abufrejoval - Monday, July 29, 2024 - link

    Could you break out the iGPU power consumption on the gaming benchmarks?

    Do you see a Wattage ceiling for the iGPU and do you see it getting priority over the CPU when both are maximized (e.g. combo of Furmark and Prime95)?
  • StormyParis - Monday, July 29, 2024 - link

    So much written about NPU and TOPS and I still have no idea what this will do for me.
  • Khanan - Monday, July 29, 2024 - link

    If you’re not into chat gpt- nothing.
  • StormyParis - Monday, July 29, 2024 - link

    I'm using it - a bit - on my 11 yo old PC, so I don't a need new fancy NPU with lotso of TOPS for that. Is there anything else I'm actually missing ?
  • Khanan - Monday, July 29, 2024 - link

    it's a bit different than chatgpt as it's assisted computing on the fly.
  • StormyParis - Tuesday, July 30, 2024 - link

    What does this even mean ? Clippy II ?
  • Khanan - Tuesday, July 30, 2024 - link

    Clippy2 but he’s kinda smart (and not an faq with graphics animation) and can actually help you with various things like chat gpt.
  • StormyParis - Tuesday, July 30, 2024 - link

    Ohhh, so I need local AI to better use Cloud AI. Next: AI in the keyboard to better use app AI to better use OS AI to better use Cloud AI. Plus an AI AI-aggregator ?

    Seriously, what will these TOPS actually do for me ?
  • GeoffreyA - Tuesday, July 30, 2024 - link

    TOPS will make your computer go fast, like stickers on the car :)

Log in

Don't have an account? Sign up now