The AMD Ryzen AI 9 HX 370 Review: Unleashing Zen 5 and RDNA 3.5 Into Notebooks
by Gavin Bonshor on July 28, 2024 9:00 AM ESTConclusion
This year is perhaps one of the busiest of this decade for the PC, both in terms of the competitive landscape and how each chip manufacturer is trying to stay ahead of the other. If you've been keeping your ear close to the ground, looking to hear about what's coming around the corner or even what's going to be the next big thing (yes, RGB, you've had your day), then the most commonly used phrase when mentioned alongside the PC is AI. It's not just a buzzword, but it's an entire market driver with a lot of weight being pushed behind it from all sides.
Regardless of the opinion on AI, the AI PC, or what the AI PC actually is, more and more consumer hardware is coming equipped with AI on the chip. The first to market in the consumer space with a dedicated AI engine in the notebook space was AMD with their Zen 4-based Phoenix Point or the Ryzen 7040 series. Not to be outdone, but both Intel and even Quallcom have mobile processors with a Neural Processing Unit, or NPU as they are commonly known. It's less of a race to get AI on the PC, but it's more about who has the biggest TOPS.
Touching on who currently has the biggest and meanest NPU on-chip in the notebook market with the highest TOPS is AMD, with the new XDNA 2 NPU architecture bringing this (current) victory to team AMD with the launch of the Ryzen AI 300 series, codenamed Strix Point. The Ryzen AI 300 series not only brings the highest TOPS from an NPU out, but it also marks the launch of AMD's latest Zen 5 microarchitecture. Even further, AMD has also brought their compact Zen 5c cores out on the same day as the main architecture, which is something they haven't done before; the compact cores usually come much later in the release cycle.
Today, AMD launches their Ryzen AI 300 series SoCs to the world, with a mixture of full-fat Zen 5 cores and the compact Zen 5c cores on the same die; they are, however, on their own CCXs. There are three chips at present, with the third being a late announcement, the Ryzen AI 9 HX 375, which actually has an XDNA 2 NPU, which is claimed to have 55 TOPS of AI performance under its hood. However, the rest of it is the same as the SoC we've been reviewing today, courtesy of the new ASUS Zenbook S 16 UM5606, which uses the AMD Ryzen AI 9 HX 370 to drive both compute and graphics.
The AMD Ryzen AI 9 HX 370 not only marks a new nomenclature, it not only brings the highest level of TOPS to notebooks on the market, but it also brings with it a new CPU core, Zen 5, which is built on TSMC's N4P (4 nm) node, but it also brings friends to the party. On top of the new XDNA 2 NPU, which is much faster than the previous NPU found in Phoenix and Hawk Point, it also brings the RDNA 3.5 graphics architecture, which looks to bring a whole host of improvements over RDNA 3 in terms of gaming performance.
Coming with a 12C/24T design, which consists of 4 x Zen 5 (full size) cores alongside 8 x Zen 5c (compact) cores, it has a base frequency of just 2.0 GHz, but the full-fat Zen 5 cores can boost all the way up to 5.1 GHz. Although it has a variable TDP of between 15 and 54 W, inside of the Zenbook S 16, it's configured at AMD's default TDP, which is 28 W. This puts it on parallel power-wise with Intel's Meteor Lake SoC chips. In contrast, the Ryzen 8040HS series had chips that started at 35 W and could be configured up to 54 W depending on the caliber of notebook or laptop it came in. However, TDPs aside, Zen 5 has finally arrived, and it's time to analyze how it currently shapes up in the mobile space.
Ryzen AI 9 HX 370 Performance Analysis
In this review, we not only tested the AMD Ryzen AI 9 HX 370 SoC (12C/24T) with the new Radeon 890M integrated graphics, but we've put it up against what it's replacing in the Zen 4 based Ryzen 9 7940HS (8C/16T) which has the RDNA 3 based Radeon 780M graphics. Intel's current Meteor Lake SoC, with the Intel Core Ultra 7 155H showcased in two notebooks, is also included.
First up, the Ryzen AI 9 HX 370 didn't really appear to be anything special in the office and encoding sections of our CPU suite, with middling performance competitive with everything else. It put everything else to bed, though, and allowed the new Zen 5 cores (and Zen 5c) to stretch their proverbial legs. In the Cinebench 2024 rendering benchmark with the multi-threaded test selected, we saw the Ryzen AI 9 HX 370 outperform the Zen 4-based Ryzen 9 7940HS by around 17%, which is certainly a good win for Zen 5. It does have more cores, albeit more efficient and compact Zen 5c cores, but winning is winning.
While Zen 5 boasts large IPC gains over Zen 4 (AMD claimed 16% on average), we didn't really see this for ourselves. The Ryzen AI 9 HX 370 still outperformed the 7940HS in the Cinebench 2024 single-threaded test, but it was more like 7% and not the 16% everyone was excited about. Fire up a workload that utilizes AVX-512, and sure, it will demolish, but in typical tasks, not so much.
AMD RDNA 3.5 Delivers Better Gaming Performance Than 3.0
Comparing RDNA 3 (Radeon 780M) to the latest RDNA 3.5 (Radeon 890M) in the Ryzen AI 9 HX 370, we saw improvements across all of our suites, which shows AMD has done wonders to improve their integrated graphics.
A prime example of AMD making improvements in performance over the last generation with the new Zen 5/Zen 5c SoC is in Returnal at 1080p with the medium preset selected. It managed to outperform the Ryzen 9 7940HS by 57%. While this isn't going to be the case in every game, we did see a consistent advantage to the Ryzen AI 9 HX 370 over the previous Phoenix Point-based 7940HS.
Overall, the combination of Zen 5 cores coupled with the RDNA 3.5-based Radeon 890M delivers better performance in gaming than the Phoenix-based Zen 4 predecessor and it also keeps Intel's current Meteor Lake SoC at bay. Still, it has to be said that integrated graphics still aren't quite there when it comes to delivering 1080p/60fps gaming, especially in big titles or AAA games, as they are more widely known. In lesser intensive games such as League of Legends, DOTA 2, and Faster Than Light.
The ASUS Zenbook S 16 UM5606: Sleek, Elegant and Highly Relevant
It wouldn't be fair to wrap up the Ryzen AI 9 HX 370 review without first giving some feedback and attention to ASUS's new Zenbook S 16 ultraportable notebook. The first thing to touch on is the design and overall composition of the Zenbook S 16's look and feel. First of all, the color is called 'Scandinavian White,' but to me, it looks more like a matte light silver, which isn't a complaint from me because it looks really good, especially when the sun shines on it. Secondly, it certainly looks lighter than it appears to be, but it's still lighter than the Apple 16-inch MacBook Pro with the M3 Max and most 16-inch notebooks, to be honest. It's deceptive how stylish and cloud-like it looks, but that's just my perception of how much it weighs compared to how I thought it was going to weigh based on how it looks.
Moving on, of course, the AMD Ryzen AI 9 HX 370 is going to take much of the plaudits, but the Zenbook 16 S certainly deserves some plaudits, too. It's thin at just 11.9 mm thick and includes plenty of nice subtle features, including thin bezels around the 16-inch Lumina OLED touchscreen display and an elegant white backlit keyboard that looks good when the lights get dimmed.
Of course, not everything is about looks, and at the heart of everything making it beat is the AMD Ryzen AI 9 HX 370. The ASUS Zenbook S 16 UM5606 itself, though, looks and feels as premium as any high-end notebook; it's packed with AI-integrated software features and applications for users to dive into if that's their thing. The chassis is made from ASUS's own material called 'Ceraluminum.' ASUS describes it as a high-tech ceramic designed to be both robust and light, with the naming sort of implying that it combines ceramic and aluminum. The result is a simple yet striking design that feels every bit as premium as it looks.
The ASUS Zenbook S 16 UM5606 starts at $1699 and is available now at retailers and on ASUS's website.
Final Thoughts: Ryzen AI 9 HX 370 Delivers in Intensive Loads, and RDNA 3.5 Does Well
AMD has firmly positioned itself at the forefront of the notebook market with the launch of the Ryzen AI 300 series, with Zen 5 being the star of the show. Zen 5 is the latest microarchitecture in AMD's roadmap and brings a host of improved architectures on key parts of the die itself. This includes the XDNA 2 NPU, which looks set to drive Microsoft Copilot+ AI-driven software into action and potentially push what NPUs and AI on-chip can do even more as we head into 2025.
AMD also has the updated and upgraded RDNA 3.5 integrated graphics to help drive things forward, but again, it still doesn't compete with discrete graphics in terms of gaming performance. In contrast, it's designed more for premium ultrathin notebooks such as the ASUS Zenbook S 16, which seems a fitting launch platform for it.
Although the Ryzen AI 9 HX 370 with four regular Zen 5 cores and eight compact Zen 5c cores performed pretty well in multiple areas, it certainly did it when it counted, especially in more intensive workloads such as rendering. Less intensive workloads didn't really didn't tax it too much, and in those cases, it was pretty average in all honesty. In regular and real-world scenarios and workloads, we certainly didn't see up to a 16% increase in IPC performance, but the key is that Zen 5 has improved IPC over Zen 4.
The Ryzen AI 300 series, including the Ryzen AI 9 HX 370, looks set to ignite a 'battle of the TOPS' where Generative AI performance is concerned among the main chip makers. Still, now that we've got Zen 5 in mobile, it'll be time soon to pivot towards Zen 5 for desktop, with the launch of the Ryzen 9000 series coming fast. In fact, it's in less than two weeks ever since AMD delayed the launch, so it'll be interesting to see how Zen 5 compares to Zen 4 on the desktop, which is certainly a much hotter battleground.
72 Comments
View All Comments
Rudde - Sunday, July 28, 2024 - link
The core-to-core latencies are disappointing. The Zen 4 apu has less than 21 ns worst case. Compare that to Zen 5+5c where you are lucky to get 21 ns at all. Most surprising to me is that threads within the same core have similar latency as between cores.I couldn't find any Zen 4+4c core-to-core latencies. The issue might have already been present in previous generation where Zen 4c wasn't used for the top-of-the-line.
haplo602 - Monday, July 29, 2024 - link
I was wondering the same. The division between the 2 core clusters is clearly obvious and this will make OS scheduling a problem. But even in the high-perf cluster the latencies are way worse than Zen4 ... also the fact that threads on the same core have the same latency as threads on different cores within the same cluster is unusual ... there seems to be some cache issue ...bernstein - Sunday, July 28, 2024 - link
wait wtf? rdna3.5 looks way faster than rdna3 (7940HS):in cp2077 it's 69% faster
in returnal it's 58% faster
in warhammer 3 it's 44% faster
sure that's with 33% more CU's but then again, it's at lower power (28W vs 35W)
i didn't expect too much of strix halo, but with rdna3.5 this efficient it will undoubtedly make a real splash when it hits with ~2.5x this perf at ~70W
haplo602 - Monday, July 29, 2024 - link
the new ryzen is running with lpddr5 7500MT/s which helps the graphics. if the 7940HS model is on 5600MT/s so-dimms then that's a huge difference right there ....Khanan - Monday, July 29, 2024 - link
- better cores, arch is slightly upgraded- more cores 256 shaders more (1024 total), which now reached a respectable number that is 4 digits like a discrete gpu card
- better vram and thus more bandwidth which also helps with performance like the other guy mentioned.
dwade123 - Sunday, July 28, 2024 - link
Wow this looks utterly disappointing. AMD's last chance to grab some mobile marketshare goes out the window. I won't be surprised if we see Lunar Lake taking over even the niche PC handheld marrket... ouch!abufrejoval - Monday, July 29, 2024 - link
Do you at least get paid for comments like this?Khanan - Monday, July 29, 2024 - link
No i think he lacks the knowledge to understand the review.TheinsanegamerN - Wednesday, July 31, 2024 - link
This is your brain on Intel Rap- *blue screen*Duncan Macdonald - Monday, July 29, 2024 - link
Could you run at least one of the tests at the 4 different power levels that this laptop supports to show the impact of power on performance.