System-Wide Testing and Gaming

For our system wide tests, we had time to go through Geekbench 5, PCMark, and GFXBench. For workload based testing, we see performance uplifts with the S8g1, and it is a noting that here we tested PCMark with both performance mode on and off, which gave a +10% increase in the score – we’ve seen this before running PCMark on both Arm and x86 devices where turbo and favored cores can have large effects on scores. By contrast, GB5 scored the same.

GeekBench 5

PCMark Work 3.0 - PerformancePCMark Work 3.0 - Web Browsing 3.0PCMark Work 3.0 - Video EditingPCMark Work 3.0 - WritingPCMark Work 3.0 - Photo EditingPCMark Work 3.0 - Data Manipulation

In our PCMark tests, it's clear who the new ruler of the roost is.

GFXBench Aztec Ruins - High - Vulkan/Metal - Off-screenGFXBench Aztec Ruins - Normal - Vulkan/Metal - Off-screenGFXBench Manhattan 3.1 Off-screen

On the graphics side, Qualcomm’s new number-less Adreno that is advertised as being ‘new from the ground up (but we won’t tell you how)’ again offers generational improvements for next year’s Android flagships. Qualcomm historically also offers better graphics performance per watt, so we’ll have to wait until we get the devices on hand to showcase that data. But overall, the gains in these tests show a large +50% performance jump over previous generation S888 graphics performance. In 2022, we'll have MediaTek’s flagship trying to aim for the same market but based on the Mali GPU, and graphics is an area that Qualcomm historically outpaces Mali designs quite easily. The only serious competitor in this space is Apple.

Machine Learning: MLPerf and AI Benchmark 4 Conclusionary Remarks: Arm v9 for Android
Comments Locked

169 Comments

View All Comments

  • Alistair - Tuesday, December 14, 2021 - link

    Their GPU is great, their CPU is 3 years behind now, and this improvement over last year is almost nill. Sigh. Sad.
  • Raqia - Tuesday, December 14, 2021 - link

    I'm looking forward to the '23 Nuvia designed cores for laptop compute, so let's see what they can do.

    However, I think it's perfectly fine if they went with a smaller ARM solution for future phone SoCs: in the SG81 and the 888 they consciously chose to limit L3 cache sizes in their CPU complex (and hence single threaded performance) for 2 generations from the biggest possible to dedicate die area and power consumption for other higher impact purposes. To me, an ideal Apple phone would have 6 of their small cores so they can dedicate more die area to their GPU, NPU and ISPs.

    John Carmack himself thought it best to throttle the CPU to half of maximum clock speed in even the XR2 (which is a 865 derivative using a faster clocked, bigger cache A77 as its biggest core):

    https://twitter.com/ID_AA_Carmack/status/130662113...
    https://twitter.com/ID_AA_Carmack/status/131878675...

    but he praised the XR2 in no uncertain terms, calling it "a lot of processing"

    https://youtu.be/sXmY26pOE-Y?t=1972

    It is indeed the DSPs and the GPUs doing the heavy lifting in the VR use case; I don't see it being much different for phones where wireless data rates are by far the biggest bottleneck.

    The CPU benches you see headlining many web SoC reviews matter only for the benchmark obsessed, but pretty much no one else.
  • Alistair - Tuesday, December 14, 2021 - link

    Your throttling argument doesn't make sense when the iPhone is more efficient also. You can run an iPhone at Snapdragon speed, and then you use way less power.
  • Raqia - Tuesday, December 14, 2021 - link

    If you look at the efficiency curves for the A77 and the A13's big CPU, they're pretty danged close:

    https://miro.medium.com/max/1155/1*U7qA0vDhixGAYes...

    The bigger point is, for phones it's well past the point of diminishing returns to pin the A13 CPU where most benchmarks do since it's simply not a bottleneck in realistic workloads. You can make a very fast CPU for bench-marketing purposes and get semi-technical people excited about your SoC, but you won't need to go very far along the curve to both hit its "knee" and have excellent performance.

    Apple made the core for laptops and desktops (for which it's well suited) but included it in its iPhone for marketing purposes rather than to address actual performance needs. Some cite the fact that more apps are coded in Javascript and websites are more Javascript intensive these days, but by far the bigger culprit in responsiveness is data connectivity and they were happy to use Intel's inferior modems behind the scenes while trotting out big but irrelevant Geekbench scores. Furthermore, part of their battery-gate issue stems from the huge possible current draw of their CPUs, which while efficient still use high peak power and current.

    Qualcomm has certainly been worse in efficiency and performance across multiple SoC processing blocks for the past two generations due to switching to Samsung as its premium SoC fab, and I certainly have no kind words for them in making that decision. However, given what they had to work with in terms of die area and power draw, they did make the correct decision in de-emphasizing the CPU block for relatively more grunt in the other blocks.
  • ChrisGX - Thursday, December 16, 2021 - link

    Yes, that's right, but Samsung's inadequate process nodes are primarily responsible for Snapdragon parts (and all premium mobile SoCs based on licensed ARM IP) falling further behind. (Note: ARM SoCs are still seeing notable improvements in the execution rate of floating point workloads even as integer performance wallows.) For that reason, it will be very interesting to see how the TSMC fabbed MediaTek Dimensity 9000 acquits itself.

    The more telling part of this story, I think, is the failure of ARM and ARM licensees to manage this transition to high performance mobile SoCs while maintaining energy efficiency leadership. In the mobile phone world, today, Apple not only wears the performance crown but the energy efficiency crown as well.
  • Wilco1 - Saturday, December 18, 2021 - link

    There are claims that Dimensity 9000 has ~49% better perf/W than SD8gen1: https://www.breakinglatest.news/business/tsmcs-4nm...

    That means the efficiency gap was indeed due to process as suspected. There is definitely an advantage in using the most advanced process 1 year before everyone else.
  • Raqia - Saturday, December 18, 2021 - link

    Really good to see them pick up their game: bigger L3 cache and faster clocked middle cores seem to be part of the reason efficiency and multicore performance are up as well aside from process.

    Some rumors indicate the dual sourced version of the S8G1 (SM8475) may be more efficient than the samsung node fabbed version but not as much as expected. It seems like Qualcomm picks different sub-blocks to optimize with each generation: this gen it was most certainly the GPU. Looks like the CPU block can be expected to languish until they bring up the NUVIA designed cores likely in '24. As their initial focus was servers, NUVIA may not have had a suitable small core in the pipeline for '23 which is much more important for mobile than laptop scale devices.
  • Wilco1 - Sunday, December 19, 2021 - link

    Yes it looks like Mediatek have done a great job. The larger caches should help power efficiency as well indeed. It will be interesting to see how the larger L3 and system cache compare with the Snapdragon and Exynos in AnandTech's benchmarks.
  • Kamen Rider Blade - Tuesday, December 14, 2021 - link

    I wonder how much more performance Android would gain by going with C++ instead of Java.

    https://benchmarksgame-team.pages.debian.net/bench...

    There's ALOT of performance to be gained by going with C/C++/Rust.

    The fact that Android went with Java for it's primary programming language while Apple went with a C/C++ derivative could be what explains the large gap.
  • jospoortvliet - Wednesday, December 15, 2021 - link

    Might make a difference in day to day use but not in these benchmarks as they already use native code.

Log in

Don't have an account? Sign up now