Problems with PUBG: Not All GPUs Render Equally

In part of our testing with PUBG, we did stumble across a particularly alarming scenario which we never really see with standardized testing. When comparing Snapdragon to Kirin, trying to observe Huawei's quoted performance differences, there appears to be a major difference between what Adreno phones were rendering, and what Mali powered phones were rendering and displaying.

Looking into more detail, it’s very obvious that the OnePlus 6 tested here (a Snapdragon/Adreno phone) resulted in far better image quality compared to the other phones.

 

      

There are two notable characteristics. First of all, the Adreno render is simply a lot sharper. It looks like the game uses a very different image scaling algorithm. For equality testing, we set the rendering resolution to 720p and upscaled to 1080p on all of the phones. While the Adreno shows up as relatively sharp, the Mali phones are seemingly quite blurry, and this is actually also noticeable on the phone when playing.

The second noticeable element, and arguably more important, is that the Adreno phone actually has anisotropic texture filtering enabled, while the Mali devices are seemingly ignoring it and falling back to bilinear filtering. In a game like PUBG, this is also very noticeable when playing and creates quite big picture quality differences. This also puts quite a differential load on the graphics, resulting in an apples-to-oranges comparison.

Consequently, Huawei’s GPU Turbo marketing comparisons to the competition also are questionable: the anisotropic filtering performance issue can impact framerates by much as 16-18% on its own. Because the Mali GPU devices have this issue, it creates a very unequal comparison when diagnosing performance to such detail. It means that out of the gate, the performance of the Mali phones is already up 16-18%, but at the expense of quality. (Ed: We used to see this a lot in the PC space over 10 years ago, where different GPUs would render different paths or have ‘tricks’ to reduce the workload. They don’t anymore.)

It’s also to be noted that while the Mali devices actually should have a workload advantage given that they’re not doing nearly as much texture filtering work as the Adreno, the performance and efficiency of the Adreno smartphones is still better. Although admittedly the differences are minor given that the game caps out at a maximum of 40fps at maximum quality. That only leaves power efficiency as the metric.

For power efficiency, even with the difference in rendering paths and quality, here Snapdragon 845 phones have a massive advantage, playing the game at 2.5-3W with AF enabled, while the Kirin 970 phones routinely average at 4-4.5W. The higher power consumption and efficiency means that the battery life on those devices will have a deficit.

Real World vs. Synthetic Testing

While I fully understand Huawei’s focus on real-world performance comparison in PUBG rather than synthetic benchmarks, we use synthetic benchmarks to determine the varacity of new features for a good reason – they are industry standards and well understood. Honor’s and Huawei’s marketing focus on PUBG seems a bit poorly thought out when it comes to actual technical comparisons in that regard, which we address on the next page.

There is the added aspect of different GPUs not even rendering the same graphics path, as described below: the fact that Adreno GPUs add anisotropic filtering and have higher quality image scaling effectively means they’re running at a noticeably higher image quality level. This is not taken into account in the performance and efficiency comparisons in Huawei’s materials, lending the materials to be a lot less credible. 

The Bottom Line

Still, GPU Turbo is a promising new technology that will give Huawei a competitive edge, all other things being equal. The sad fact here is that for the Kirin 960 and Kirin 970, things are not equal. The competitive landscape will change a lot with the Kirin 980, but until then, current generation device users need have a clear understanding and realistic expectations to what GPU Turbo can actually bring to the table.

The Difficulty in Analyzing GPU Turbo The Minor Issue of Overzealous Marketing
Comments Locked

64 Comments

View All Comments

  • jjj - Tuesday, September 4, 2018 - link

    Good first step but could be expanded well beyond the GPU and the entire system built around it.
    Been thinking about this for some years and could lead to very different hardware if you have an NPU manage everything.
  • ZolaIII - Tuesday, September 4, 2018 - link

    NNPU didn't even earn to eat hire. No one will do it better than your self. Switching off two big cores does much more than all this fuss about GPU turbo.
  • mode_13h - Tuesday, September 4, 2018 - link

    Not to agree or disagree with your point, but I think you mean "here" instead of "hire".
  • mode_13h - Tuesday, September 4, 2018 - link

    You mean like this?

    https://www.phoronix.com/scan.php?page=news_item&a...
  • mode_13h - Tuesday, September 4, 2018 - link

    Anyway, I'm thinking a deep learning model could probably do a better job at managing core clock speeds and perhaps even deciding whether to schedule certain tasks on big vs. little cores.
  • ZolaIII - Wednesday, September 5, 2018 - link

    We (not AI) need to evolve scheduler logic and add SMP affinity flags to processes. Only then game's can begin. Here goes the rain again. By the way thanks for that.
  • mr_tawan - Tuesday, September 4, 2018 - link

    Does it raytrace?
  • Manch - Wednesday, September 5, 2018 - link

    I think the question that should be asked is:

    Can it raytrace Crysis?
  • Lord of the Bored - Wednesday, September 5, 2018 - link

    I'd settle for raytracing FEAR.
  • sing_electric - Tuesday, September 4, 2018 - link

    This presents a quandary for benchmarking/reviewing: In the past, if a company released drivers that changed the performance of the device while running a specific app, we'd all call it "cheating" if that app was a benchmark. However, by extending the "cheats" to other apps, the user sees real benefits, even though it's the same behavior.

    It also means that performance numbers have to be taken with even more salt, because the performance on a popular app which has been "Turboed" by Huawei might not be indicative of the performance you see if you only say, play less popular games that Huawei hasn't profiled.

Log in

Don't have an account? Sign up now