System Performance

Given that we’ve seen excellent raw CPU performance of the Kirin 980, we should also largely see this translated over to actual system performance. System performance is what we call the performance of more realistic every-day workloads, which are most of the time mainly transactional in their nature, in contrast to the more continuous long SPEC tests of the previous pages.

The Mate 20’s come with Android 9/P out of the box, and in terms of mechanisms that promise to improve system performance, Huawei/HiSilicon employ a custom scheduler for the Kirin 980 that is able to properly deal with the three efficiency CPU groups (Perf & efficiency A76’s, and A55s).

Huawei has been locking down things quite tightly over the past year, so I wasn’t able to extract that much information out of the kernel. What I did find out is that it looks like they’re using a scheduler that is based on Google’s ACK (Android Common Kernel) and builds custom modifications on top of that. Among the key features that look to be enabled in the kernel is WALT – which I think if I’m not mistaken would make this the first non-Qualcomm SoC which sports the more responsive load tracking mechanism out of the box.

It’s to be noted that after our recent article addressing less than honest benchmarking behaviour, that Huawei has changed the behaviour of its battery power modes. The new “Performance mode” in the battery settings is off by default, which I found quite a bit odd as a default setting. To be able to get the full performance of the SoC blocks, this setting should be turned on, and we’ll note that all our testing was with the performance mode enabled, something which Huawei also recommended us to do.  

PCMark Work 2.0 - Web Browsing 2.0

Starting off with the PCMark Web Browsing 2.0 test, we see the Mate 20’s take a considerable lead among all Android devices. Here it is evidently clear that this is a considerable generational leap in performance, and more so compared to the previous generation Kirin 970 devices.

PCMark Work 2.0 - Video Editing

The video editing test again has become somewhat non-representative of performance as most flagship devices hover within the same score range without much difference between each other. I’m still now sure why some devices score ever so slightly higher or lower, but the absolute differences are quite minor..

PCMark Work 2.0 - Writing 2.0

The PCMark Writing test is among one of the most representative ones in terms of putting a number on overall device snappiness and speed. Here the Mate 20’s again take the lead, however the delta to the second best devices here isn’t quite as big as in the web browsing test. The OnePlus 6 and Pixel 3 both seem to have an advantage over other devices due to the fact that they’re running Android 9/P along with an up-to-date Qualcomm scheduler.

PCMark Work 2.0 - Photo Editing 2.0

The photo editing test consists of small workload bursts – applying photo filters via RenderScript APIs. Here both performance and again performance responsiveness are key. The Mate 20’s again do very well, however they don’t quite match the performance of some of the best Snapdragon 845 devices, featuring the more up to date Qualcomm schedulers.

PCMark Work 2.0 - Data Manipulation

The Data Manipulation test is heavily influenced by single-threaded performance. Here although they don’t seem to quite match the Pixel 3 in this particular test, the Mate 20’s are still ahead of most other Android phones.

PCMark Work 2.0 - Performance

In the overall PCMark performance test, the Mate 20’s just land ahead of the Pixel 3 and OnePlus 6.

Speedometer 2.0 - OS WebView

In the WebView tests where we first use Speedometer, a JS framework test, we see the Mate 20’s again take a good leap ahead of the second-best Android platforms based on the Snapdragon 845. Against the previous generation Kirin 970 phones, Huawei was again essentially able to double the performance. It’s still not enough to catch up to Apple, but at least we’re on par with the A10, a result that was also largely represented by the SPEC2006 results.

WebXPRT 3 - OS WebView

WebXPRT is a tad less microarchitecturally demanding than Speedometer, and here performance largely seems to scale with simple overall raw CPU execution power. Again we see a similar positioning as in Speedometer, with the Mate 20’s taking the lead among Android devices.

My experience with the devices pretty much matches the system benchmarks – the Mate 20’s are among the fastest devices on the market. Where the Kirin 980’s performance shines is in more complex and heavier workloads, such as loading a webpage or opening content of more heavy apps.

In terms of overall feel and responsiveness, I do feel that the Mate 20’s maybe weren’t quite as fast as the Pixel 3 or OnePlus 6. Here these phones do feel a bit quicker in opening some applications or new activities. It’s possible that Huawei maybe is lacking some OS framework related boosters that these phones might be using. I do plan to try to reintroduce empirical and controlled app loading time testing in the future, so this might be a topic we’ll revisit soon enough.

Second Generation NPU - NNAPI Tested GPU Performance & Power
Comments Locked

141 Comments

View All Comments

  • Andrei Frumusanu - Friday, November 16, 2018 - link

    Nothing on the nanoSD, I don't even have any way to test it. As for storage, again I'm not posting any results in the review because the tools are broken/misleading. If it's any worth, both phones are leading in terms of Androbench performance.
  • Chitti - Saturday, November 24, 2018 - link

    Andrei, its almost 10 days.
    U didn't upload it yet 😓.
  • s.yu - Friday, November 16, 2018 - link

    Samsung's body + Apple's notch, a popular opinion on the net.
    For the record Huawei's always "taking note" of somebody's design, they copied Sony's Omnibalance back with the P8, especially with that power button, moving on they've been closely following Samsung's design (S6,S7,S8) until the P20, in which they copied Apple, with the latest Mate20Pro, it's both, altogether.
  • Andrei Frumusanu - Friday, November 16, 2018 - link

    I don't really agree with this (Beyond the P20's looking similar to the iPhone X), Huawei always had quite distinct designs in its phones, especially on the Mate series.
  • s.yu - Friday, November 16, 2018 - link

    Well for the P8 Huawei's own slide mentioning a "balanced design" following Sony's use of "Omnibalance" as well as the obvious resemblance in design did give them away, Huawei's Mate 9 Pro's a facelift of the S6/S7, and their subsequent so-called "Porsche Design" versions as well as the corresponding "Pro" versions all suspiciously follow Samsung's move in design philosophy from the S7 onwards. Then Apple's IPX and all...
  • levizx - Saturday, November 17, 2018 - link

    Well, that's quite a bold regarding P8, P8 looks nothing like SONY. By your logic, any phone that claims "slim" or "premium" would be clones.

    How else would you design a phone with 16:9 curved display with 3 years old technology, I'd like to see you try.

    You have to be very stupid to think Mate 10/P20 series looks anything like S7/S8/iPhone being non-curved with front/back fingerprint readers.
    So your logic is essentially - curved display: copying Samsung, non-curved display: copying Samsung, notch with fingerprint reader and triple camera: copying iPhone.
  • s.yu - Saturday, November 17, 2018 - link

    That's some weak trolling.

    Let me tell you now how exactly the P8 looks like Sony's Xperia Z released earlier:
    1. It's very boxy for its release date, compared to its peers only Sony of that era used such a design philosophy though Sony stuck to it for the many years to come while Huawei went on to copy Samsung the subsequent generation starting from Mate 9 Pro.
    2. Sony's machine-milled power button was iconic in their Xperia Z and Z1, then Huawei came over, slightly changed the shape and stuck it onto an equally boxy body with suspiciously similarly named design philosophy.

    How else would *I* design? That's not my problem, I'm not a team of engineers paid to innovate on a smartphone design after all, but HTC and Samsung both had unique solutions at the time, especially Samsung's S6 was an ingenious generational leap which pioneered the trend of glass-sandwich-metal bodies until this day.

    When Huawei wasn't so obviously copying, well of course you know what happened, the unsightly Mate S, Mate 8 and Mate 9.

    The Mate 9 Pro's screen was curved, together with the home button it's a straight Samsung S6E/S7E ripoff under a façade of "Porsche Design". At least get your basic facts straight before you troll.

    I didn't say that the Mate 10 was a Samsung/Apple copy, you put that in my mouth. Not every Huawei is a copy, just that they copy somebody almost every generation, which also shows from their highly inconsistent, rapidly shifting design language, because they "borrow" from different opponents each year.

    The P20 is a thorough IPX clone, up there with the Mi8, there's no doubt about that.
  • Quantumz0d - Friday, November 16, 2018 - link

    Agreed.

    Press don't care unfortunately and that makes the marketing work. How else Huawei could gather all that. Look at Pixel 3XL its the best android phone according to press. Less features is more nowadays and you should pay more for the super cloned designs and submitting your ownership as well.

    And it's China and their famous pro local IP theft game, no one can win there except their own.
  • levizx - Saturday, November 17, 2018 - link

    What a stupid and racist troll. So in your mind Pixel XL is not a clone, but all Huawei phones are?

    Mate 10 Pro looks more like LG V30 than anything else, and they are only 2 months apart, no chance of copying at all.
  • s.yu - Saturday, November 17, 2018 - link

    Look at you grasping at straws like that, the Mate 10 Pro may not be a copy, but Mate RS was a clear Samsung copy.

Log in

Don't have an account? Sign up now