System Performance

Given that we’ve seen excellent raw CPU performance of the Kirin 980, we should also largely see this translated over to actual system performance. System performance is what we call the performance of more realistic every-day workloads, which are most of the time mainly transactional in their nature, in contrast to the more continuous long SPEC tests of the previous pages.

The Mate 20’s come with Android 9/P out of the box, and in terms of mechanisms that promise to improve system performance, Huawei/HiSilicon employ a custom scheduler for the Kirin 980 that is able to properly deal with the three efficiency CPU groups (Perf & efficiency A76’s, and A55s).

Huawei has been locking down things quite tightly over the past year, so I wasn’t able to extract that much information out of the kernel. What I did find out is that it looks like they’re using a scheduler that is based on Google’s ACK (Android Common Kernel) and builds custom modifications on top of that. Among the key features that look to be enabled in the kernel is WALT – which I think if I’m not mistaken would make this the first non-Qualcomm SoC which sports the more responsive load tracking mechanism out of the box.

It’s to be noted that after our recent article addressing less than honest benchmarking behaviour, that Huawei has changed the behaviour of its battery power modes. The new “Performance mode” in the battery settings is off by default, which I found quite a bit odd as a default setting. To be able to get the full performance of the SoC blocks, this setting should be turned on, and we’ll note that all our testing was with the performance mode enabled, something which Huawei also recommended us to do.  

PCMark Work 2.0 - Web Browsing 2.0

Starting off with the PCMark Web Browsing 2.0 test, we see the Mate 20’s take a considerable lead among all Android devices. Here it is evidently clear that this is a considerable generational leap in performance, and more so compared to the previous generation Kirin 970 devices.

PCMark Work 2.0 - Video Editing

The video editing test again has become somewhat non-representative of performance as most flagship devices hover within the same score range without much difference between each other. I’m still now sure why some devices score ever so slightly higher or lower, but the absolute differences are quite minor..

PCMark Work 2.0 - Writing 2.0

The PCMark Writing test is among one of the most representative ones in terms of putting a number on overall device snappiness and speed. Here the Mate 20’s again take the lead, however the delta to the second best devices here isn’t quite as big as in the web browsing test. The OnePlus 6 and Pixel 3 both seem to have an advantage over other devices due to the fact that they’re running Android 9/P along with an up-to-date Qualcomm scheduler.

PCMark Work 2.0 - Photo Editing 2.0

The photo editing test consists of small workload bursts – applying photo filters via RenderScript APIs. Here both performance and again performance responsiveness are key. The Mate 20’s again do very well, however they don’t quite match the performance of some of the best Snapdragon 845 devices, featuring the more up to date Qualcomm schedulers.

PCMark Work 2.0 - Data Manipulation

The Data Manipulation test is heavily influenced by single-threaded performance. Here although they don’t seem to quite match the Pixel 3 in this particular test, the Mate 20’s are still ahead of most other Android phones.

PCMark Work 2.0 - Performance

In the overall PCMark performance test, the Mate 20’s just land ahead of the Pixel 3 and OnePlus 6.

Speedometer 2.0 - OS WebView

In the WebView tests where we first use Speedometer, a JS framework test, we see the Mate 20’s again take a good leap ahead of the second-best Android platforms based on the Snapdragon 845. Against the previous generation Kirin 970 phones, Huawei was again essentially able to double the performance. It’s still not enough to catch up to Apple, but at least we’re on par with the A10, a result that was also largely represented by the SPEC2006 results.

WebXPRT 3 - OS WebView

WebXPRT is a tad less microarchitecturally demanding than Speedometer, and here performance largely seems to scale with simple overall raw CPU execution power. Again we see a similar positioning as in Speedometer, with the Mate 20’s taking the lead among Android devices.

My experience with the devices pretty much matches the system benchmarks – the Mate 20’s are among the fastest devices on the market. Where the Kirin 980’s performance shines is in more complex and heavier workloads, such as loading a webpage or opening content of more heavy apps.

In terms of overall feel and responsiveness, I do feel that the Mate 20’s maybe weren’t quite as fast as the Pixel 3 or OnePlus 6. Here these phones do feel a bit quicker in opening some applications or new activities. It’s possible that Huawei maybe is lacking some OS framework related boosters that these phones might be using. I do plan to try to reintroduce empirical and controlled app loading time testing in the future, so this might be a topic we’ll revisit soon enough.

Second Generation NPU - NNAPI Tested GPU Performance & Power
Comments Locked

141 Comments

View All Comments

  • cha0z_ - Tuesday, November 20, 2018 - link

    I don't like how the best phone samsung made this year is not here (the note 9). That phone has a lot bigger body vs s9 and 3 times bigger heatpipe that is also better (the body of the phone heats, but the SOC is not throttled. Actually note 9 in heavy use is hotter than the s9+ but sustains better ;) ) + it's tweaked not for peak performance, but sustained performance + samsung DID improve the kernel and the control of the exynos 9810. I am sure all the factors will lead to noticeable difference compared to the s9 exynos tests from the start of the year.

    I know that you are tired of the exynos 9810, we all know that chip is far worse than the rivals, but still it would be better to show it in it's best light instead of the all negativity. Comparing in a single table a phone twitce smaller than the other and drawing conclusions about the SOCs inside is plain wrong.
  • eastcoast_pete - Tuesday, November 20, 2018 - link

    @Andrei:Any statement from Huawei on how long they will continue to provide OS updates for, and how quickly after Google releases them? With prices approaching 1000 dollars/euros/pounds, the old "release and abandon" would be a bit too much. Thanks!
  • abufrejoval - Tuesday, November 20, 2018 - link

    It doesn't get any better: Here you have all the hardware to turn into a credible workstation with sufficient compute, gaming and even inference power to do 90% of what normal PC users would need with UPS, storage and a high resolution touch screen included at pocket size and laptop budgets....

    But you simply cannot get the power onto a screen large enough to work with all day (Miracast is really doesn't have acceptable fidelity)

    And they simply won't let you take control over what could be a very personal and very portable workstation, because they deny you control over the computer you purchased (no rooting).

    All that power in a form factor that precludes putting it to work just drives me knocking my head into the wall!
  • whyamihere - Thursday, November 22, 2018 - link

    If possible do you think you could look at the power consumption of a BOE screen on the Mate 20 pro. I'm wondering if the battery issues you saw on the pro model had to do with the LG screen, as LG screens on the pro model seem to have issues such as really bad green tint that gets worse over time.
  • Jalk44 - Thursday, November 22, 2018 - link

    A: it's not the first QHD phone by Huawei,that's was the mate 9 pro

    B: it's also not the first phone with both front and back full curved glass, that would be the mate rs
  • MyFluxi - Thursday, November 22, 2018 - link

    hey, can you do a screen battery test with the BOE screen and also a general review on the boe screen. some saying that the vibrancy is less on the BOE but the uniformity is better
  • ballsystemlord - Friday, November 23, 2018 - link

    Hi. Your local S+G corrector here. Todays mistake is an obvious one, the word "if" should be substituted by the word "is".
    "Here acceleration if facilitated through the HVX DSPs."
    --
    "Here acceleration is facilitated through the HVX DSPs."
    I lightly read the last 3 pages. I got tired of reading everything.
  • salbashi - Tuesday, November 27, 2018 - link

    Did Anandtech notice any benchmark mode on Mate 20 or Mate 20 Pro this time around?
    Cause that would be Huawei caught cheating again right after P20 and P20 Pro.
  • Davidsic - Wednesday, November 28, 2018 - link

    Hello, my first Mate 20 Pro had the same brightness anomaly you are talking about (LG screen) and my second one that i recieved yesterday have the same issue and it's a BOE screen !
  • AlexTi - Sunday, March 17, 2019 - link

    Mate 20 having Qi wireless charging possibility seems to be a mistake in specifications. The one I've just bought definitely lacks it (model number HMA-L29), and specs on Huawei website do not include this feature for non-Pro Mate 20.

Log in

Don't have an account? Sign up now