The AMD Ryzen AI 9 HX 370 Review: Unleashing Zen 5 and RDNA 3.5 Into Notebooks
by Gavin Bonshor on July 28, 2024 9:00 AM ESTConclusion
This year is perhaps one of the busiest of this decade for the PC, both in terms of the competitive landscape and how each chip manufacturer is trying to stay ahead of the other. If you've been keeping your ear close to the ground, looking to hear about what's coming around the corner or even what's going to be the next big thing (yes, RGB, you've had your day), then the most commonly used phrase when mentioned alongside the PC is AI. It's not just a buzzword, but it's an entire market driver with a lot of weight being pushed behind it from all sides.
Regardless of the opinion on AI, the AI PC, or what the AI PC actually is, more and more consumer hardware is coming equipped with AI on the chip. The first to market in the consumer space with a dedicated AI engine in the notebook space was AMD with their Zen 4-based Phoenix Point or the Ryzen 7040 series. Not to be outdone, but both Intel and even Quallcom have mobile processors with a Neural Processing Unit, or NPU as they are commonly known. It's less of a race to get AI on the PC, but it's more about who has the biggest TOPS.
Touching on who currently has the biggest and meanest NPU on-chip in the notebook market with the highest TOPS is AMD, with the new XDNA 2 NPU architecture bringing this (current) victory to team AMD with the launch of the Ryzen AI 300 series, codenamed Strix Point. The Ryzen AI 300 series not only brings the highest TOPS from an NPU out, but it also marks the launch of AMD's latest Zen 5 microarchitecture. Even further, AMD has also brought their compact Zen 5c cores out on the same day as the main architecture, which is something they haven't done before; the compact cores usually come much later in the release cycle.
Today, AMD launches their Ryzen AI 300 series SoCs to the world, with a mixture of full-fat Zen 5 cores and the compact Zen 5c cores on the same die; they are, however, on their own CCXs. There are three chips at present, with the third being a late announcement, the Ryzen AI 9 HX 375, which actually has an XDNA 2 NPU, which is claimed to have 55 TOPS of AI performance under its hood. However, the rest of it is the same as the SoC we've been reviewing today, courtesy of the new ASUS Zenbook S 16 UM5606, which uses the AMD Ryzen AI 9 HX 370 to drive both compute and graphics.
The AMD Ryzen AI 9 HX 370 not only marks a new nomenclature, it not only brings the highest level of TOPS to notebooks on the market, but it also brings with it a new CPU core, Zen 5, which is built on TSMC's N4P (4 nm) node, but it also brings friends to the party. On top of the new XDNA 2 NPU, which is much faster than the previous NPU found in Phoenix and Hawk Point, it also brings the RDNA 3.5 graphics architecture, which looks to bring a whole host of improvements over RDNA 3 in terms of gaming performance.
Coming with a 12C/24T design, which consists of 4 x Zen 5 (full size) cores alongside 8 x Zen 5c (compact) cores, it has a base frequency of just 2.0 GHz, but the full-fat Zen 5 cores can boost all the way up to 5.1 GHz. Although it has a variable TDP of between 15 and 54 W, inside of the Zenbook S 16, it's configured at AMD's default TDP, which is 28 W. This puts it on parallel power-wise with Intel's Meteor Lake SoC chips. In contrast, the Ryzen 8040HS series had chips that started at 35 W and could be configured up to 54 W depending on the caliber of notebook or laptop it came in. However, TDPs aside, Zen 5 has finally arrived, and it's time to analyze how it currently shapes up in the mobile space.
Ryzen AI 9 HX 370 Performance Analysis
In this review, we not only tested the AMD Ryzen AI 9 HX 370 SoC (12C/24T) with the new Radeon 890M integrated graphics, but we've put it up against what it's replacing in the Zen 4 based Ryzen 9 7940HS (8C/16T) which has the RDNA 3 based Radeon 780M graphics. Intel's current Meteor Lake SoC, with the Intel Core Ultra 7 155H showcased in two notebooks, is also included.
First up, the Ryzen AI 9 HX 370 didn't really appear to be anything special in the office and encoding sections of our CPU suite, with middling performance competitive with everything else. It put everything else to bed, though, and allowed the new Zen 5 cores (and Zen 5c) to stretch their proverbial legs. In the Cinebench 2024 rendering benchmark with the multi-threaded test selected, we saw the Ryzen AI 9 HX 370 outperform the Zen 4-based Ryzen 9 7940HS by around 17%, which is certainly a good win for Zen 5. It does have more cores, albeit more efficient and compact Zen 5c cores, but winning is winning.
While Zen 5 boasts large IPC gains over Zen 4 (AMD claimed 16% on average), we didn't really see this for ourselves. The Ryzen AI 9 HX 370 still outperformed the 7940HS in the Cinebench 2024 single-threaded test, but it was more like 7% and not the 16% everyone was excited about. Fire up a workload that utilizes AVX-512, and sure, it will demolish, but in typical tasks, not so much.
AMD RDNA 3.5 Delivers Better Gaming Performance Than 3.0
Comparing RDNA 3 (Radeon 780M) to the latest RDNA 3.5 (Radeon 890M) in the Ryzen AI 9 HX 370, we saw improvements across all of our suites, which shows AMD has done wonders to improve their integrated graphics.
A prime example of AMD making improvements in performance over the last generation with the new Zen 5/Zen 5c SoC is in Returnal at 1080p with the medium preset selected. It managed to outperform the Ryzen 9 7940HS by 57%. While this isn't going to be the case in every game, we did see a consistent advantage to the Ryzen AI 9 HX 370 over the previous Phoenix Point-based 7940HS.
Overall, the combination of Zen 5 cores coupled with the RDNA 3.5-based Radeon 890M delivers better performance in gaming than the Phoenix-based Zen 4 predecessor and it also keeps Intel's current Meteor Lake SoC at bay. Still, it has to be said that integrated graphics still aren't quite there when it comes to delivering 1080p/60fps gaming, especially in big titles or AAA games, as they are more widely known. In lesser intensive games such as League of Legends, DOTA 2, and Faster Than Light.
The ASUS Zenbook S 16 UM5606: Sleek, Elegant and Highly Relevant
It wouldn't be fair to wrap up the Ryzen AI 9 HX 370 review without first giving some feedback and attention to ASUS's new Zenbook S 16 ultraportable notebook. The first thing to touch on is the design and overall composition of the Zenbook S 16's look and feel. First of all, the color is called 'Scandinavian White,' but to me, it looks more like a matte light silver, which isn't a complaint from me because it looks really good, especially when the sun shines on it. Secondly, it certainly looks lighter than it appears to be, but it's still lighter than the Apple 16-inch MacBook Pro with the M3 Max and most 16-inch notebooks, to be honest. It's deceptive how stylish and cloud-like it looks, but that's just my perception of how much it weighs compared to how I thought it was going to weigh based on how it looks.
Moving on, of course, the AMD Ryzen AI 9 HX 370 is going to take much of the plaudits, but the Zenbook 16 S certainly deserves some plaudits, too. It's thin at just 11.9 mm thick and includes plenty of nice subtle features, including thin bezels around the 16-inch Lumina OLED touchscreen display and an elegant white backlit keyboard that looks good when the lights get dimmed.
Of course, not everything is about looks, and at the heart of everything making it beat is the AMD Ryzen AI 9 HX 370. The ASUS Zenbook S 16 UM5606 itself, though, looks and feels as premium as any high-end notebook; it's packed with AI-integrated software features and applications for users to dive into if that's their thing. The chassis is made from ASUS's own material called 'Ceraluminum.' ASUS describes it as a high-tech ceramic designed to be both robust and light, with the naming sort of implying that it combines ceramic and aluminum. The result is a simple yet striking design that feels every bit as premium as it looks.
The ASUS Zenbook S 16 UM5606 starts at $1699 and is available now at retailers and on ASUS's website.
Final Thoughts: Ryzen AI 9 HX 370 Delivers in Intensive Loads, and RDNA 3.5 Does Well
AMD has firmly positioned itself at the forefront of the notebook market with the launch of the Ryzen AI 300 series, with Zen 5 being the star of the show. Zen 5 is the latest microarchitecture in AMD's roadmap and brings a host of improved architectures on key parts of the die itself. This includes the XDNA 2 NPU, which looks set to drive Microsoft Copilot+ AI-driven software into action and potentially push what NPUs and AI on-chip can do even more as we head into 2025.
AMD also has the updated and upgraded RDNA 3.5 integrated graphics to help drive things forward, but again, it still doesn't compete with discrete graphics in terms of gaming performance. In contrast, it's designed more for premium ultrathin notebooks such as the ASUS Zenbook S 16, which seems a fitting launch platform for it.
Although the Ryzen AI 9 HX 370 with four regular Zen 5 cores and eight compact Zen 5c cores performed pretty well in multiple areas, it certainly did it when it counted, especially in more intensive workloads such as rendering. Less intensive workloads didn't really didn't tax it too much, and in those cases, it was pretty average in all honesty. In regular and real-world scenarios and workloads, we certainly didn't see up to a 16% increase in IPC performance, but the key is that Zen 5 has improved IPC over Zen 4.
The Ryzen AI 300 series, including the Ryzen AI 9 HX 370, looks set to ignite a 'battle of the TOPS' where Generative AI performance is concerned among the main chip makers. Still, now that we've got Zen 5 in mobile, it'll be time soon to pivot towards Zen 5 for desktop, with the launch of the Ryzen 9000 series coming fast. In fact, it's in less than two weeks ever since AMD delayed the launch, so it'll be interesting to see how Zen 5 compares to Zen 4 on the desktop, which is certainly a much hotter battleground.
72 Comments
View All Comments
kkilobyte - Sunday, July 28, 2024 - link
I don't find it disappointing at all. It manages to perform as well or better (sometimes by a significant amount), while running on a 28W instead of 35W budget. I think it is a very important point when it comes to laptop CPUs.It's pretty unfortunate that AT didn't also test the laptop with the 17W TDP. It would have been very interesting to see how big (or not) the impact on performances was. If the loss is limited, it may be an nice tradeoff for that kind of machine.
brucethemoose - Sunday, July 28, 2024 - link
> There isn't a defined benchmark that tests AI performance from a level playing fieldllama.cpp has a vulkan backend, and a couple of built in benchmarks. Its not the *fastest* backend (people on AMD/Intel just use rocm or sycl), but it's at least fair.
There are also vulkan ports of other models like esrgan.
Gavin Bonshor - Sunday, July 28, 2024 - link
Hey Bruce, thanks for the heads up on that. I'll check it outMakaanPL - Sunday, July 28, 2024 - link
Thank you for the review, nice work as always. Strix Point beating last-gen HS chip despite low cooling performance chassis is quite promising. It doesn't address the idle power, though, and in the mobile space it's very important as well.By the way, do you plan to cover production laptops with Qualcomm X Elite/Plus? Yoga seems to be really interesting and only one with reasonable pricing of 32GB RAM option, but very few reviews were published so far.
Ryan Smith - Sunday, July 28, 2024 - link
"By the way, do you plan to cover production laptops with Qualcomm X Elite/Plus?"Yes. It's taken entirely too long to get a sample in, but we should finally have one at the start of August.
eastcoast_pete - Monday, July 29, 2024 - link
I fully place the blame for that delay on Qualcomm and their launch partners. They have been quite "picky" about who gets what subnotebook or 2-in-1 and when. Which I believe was a mistake; they now face competition from AMD (like this one here) and soon also from Lunar Lake. At least AMD has apparently learned from their bad example, and sent out review units to many sites quickly.Khanan - Sunday, July 28, 2024 - link
Good article.Terry_Craig - Sunday, July 28, 2024 - link
What is most impressive is that even in this ultra-thin model the framerate is super stable.abufrejoval - Sunday, July 28, 2024 - link
A great piece of engineering on both sides for sure, very much where I was hoping AMD would land in terms of performance.And I was very tempted until I saw the price: ASUS asks for more than €2000 on their direct sales shop and that is just way too much no matter what. Doing as good as the fruity cult doesn't mean you should charge their prices, especially the €400 markup for 8GB of RAM and 1TB of SSD.
I guess the ASUS exclusivity wasn't cheap, but I'll wait until prices have gone to saner levels, which I'm very sure they will.
And then I really wanted 64GB of RAM, which I believe is actually impossible with LPDDR5?
eastcoast_pete - Monday, July 29, 2024 - link
You might have to wait for the first LPCAMM2 notebooks for that. Micron and I believe Samsung are shipping memory modules that allow for 64 GB fast LP RAM.And yes, I agree on the pricing; it's, let's say, ambitious. And not helping with fast uptake. While Meteor Lake laptops are not as fast (but not that much slower either), they can be had, nicely equipped, for a lot less.
It'll be interesting to see how Intel and launch partners will price Lunar Lake, and of course how Lunar Lake will perform.