System Performance

Given that we’ve seen excellent raw CPU performance of the Kirin 980, we should also largely see this translated over to actual system performance. System performance is what we call the performance of more realistic every-day workloads, which are most of the time mainly transactional in their nature, in contrast to the more continuous long SPEC tests of the previous pages.

The Mate 20’s come with Android 9/P out of the box, and in terms of mechanisms that promise to improve system performance, Huawei/HiSilicon employ a custom scheduler for the Kirin 980 that is able to properly deal with the three efficiency CPU groups (Perf & efficiency A76’s, and A55s).

Huawei has been locking down things quite tightly over the past year, so I wasn’t able to extract that much information out of the kernel. What I did find out is that it looks like they’re using a scheduler that is based on Google’s ACK (Android Common Kernel) and builds custom modifications on top of that. Among the key features that look to be enabled in the kernel is WALT – which I think if I’m not mistaken would make this the first non-Qualcomm SoC which sports the more responsive load tracking mechanism out of the box.

It’s to be noted that after our recent article addressing less than honest benchmarking behaviour, that Huawei has changed the behaviour of its battery power modes. The new “Performance mode” in the battery settings is off by default, which I found quite a bit odd as a default setting. To be able to get the full performance of the SoC blocks, this setting should be turned on, and we’ll note that all our testing was with the performance mode enabled, something which Huawei also recommended us to do.  

PCMark Work 2.0 - Web Browsing 2.0

Starting off with the PCMark Web Browsing 2.0 test, we see the Mate 20’s take a considerable lead among all Android devices. Here it is evidently clear that this is a considerable generational leap in performance, and more so compared to the previous generation Kirin 970 devices.

PCMark Work 2.0 - Video Editing

The video editing test again has become somewhat non-representative of performance as most flagship devices hover within the same score range without much difference between each other. I’m still now sure why some devices score ever so slightly higher or lower, but the absolute differences are quite minor..

PCMark Work 2.0 - Writing 2.0

The PCMark Writing test is among one of the most representative ones in terms of putting a number on overall device snappiness and speed. Here the Mate 20’s again take the lead, however the delta to the second best devices here isn’t quite as big as in the web browsing test. The OnePlus 6 and Pixel 3 both seem to have an advantage over other devices due to the fact that they’re running Android 9/P along with an up-to-date Qualcomm scheduler.

PCMark Work 2.0 - Photo Editing 2.0

The photo editing test consists of small workload bursts – applying photo filters via RenderScript APIs. Here both performance and again performance responsiveness are key. The Mate 20’s again do very well, however they don’t quite match the performance of some of the best Snapdragon 845 devices, featuring the more up to date Qualcomm schedulers.

PCMark Work 2.0 - Data Manipulation

The Data Manipulation test is heavily influenced by single-threaded performance. Here although they don’t seem to quite match the Pixel 3 in this particular test, the Mate 20’s are still ahead of most other Android phones.

PCMark Work 2.0 - Performance

In the overall PCMark performance test, the Mate 20’s just land ahead of the Pixel 3 and OnePlus 6.

Speedometer 2.0 - OS WebView

In the WebView tests where we first use Speedometer, a JS framework test, we see the Mate 20’s again take a good leap ahead of the second-best Android platforms based on the Snapdragon 845. Against the previous generation Kirin 970 phones, Huawei was again essentially able to double the performance. It’s still not enough to catch up to Apple, but at least we’re on par with the A10, a result that was also largely represented by the SPEC2006 results.

WebXPRT 3 - OS WebView

WebXPRT is a tad less microarchitecturally demanding than Speedometer, and here performance largely seems to scale with simple overall raw CPU execution power. Again we see a similar positioning as in Speedometer, with the Mate 20’s taking the lead among Android devices.

My experience with the devices pretty much matches the system benchmarks – the Mate 20’s are among the fastest devices on the market. Where the Kirin 980’s performance shines is in more complex and heavier workloads, such as loading a webpage or opening content of more heavy apps.

In terms of overall feel and responsiveness, I do feel that the Mate 20’s maybe weren’t quite as fast as the Pixel 3 or OnePlus 6. Here these phones do feel a bit quicker in opening some applications or new activities. It’s possible that Huawei maybe is lacking some OS framework related boosters that these phones might be using. I do plan to try to reintroduce empirical and controlled app loading time testing in the future, so this might be a topic we’ll revisit soon enough.

Second Generation NPU - NNAPI Tested GPU Performance & Power
Comments Locked

141 Comments

View All Comments

  • name99 - Friday, November 16, 2018 - link

    Please don't treat me like a child; read my comments and treat me accordingly.
    DDR as a rate (transactions) DOUBLE the clock was only relevant to the transition from SDR to DDR.
    What do you think is the difference between DDR and DDR2, or DDDR2 and DDR3, or DDR3 and DDR4?

    Part of the problem seems to be that no-one can agree on what "clock" actually refers to.
    There are at least two clocks of interest - the internal DRM clock, and the external bus clock.

    As far as I can tell:
    - DDR doubled the transfer rate over the external bus. (External bus, internal clock the same, just like SDR). Internal clock is ~100..200MHz
    - DDR2 runs the external clock at twice the internal clock.
    - DDR3 runs the external clock at 4x the internal clock. (still running from ~100 to 266MHz)

    - At DDR4 I'm no longer sure (which is part of the whole reason for this confusion).
    The obvious assumption is that the external clock is now run at 8x the internal clock; but that does NOT seem to be the case. Rather what's defined as the internal clock is now run twice as fast, so that the internal:external multiplier is still 8x, but the internal clock speeds now range from ~200 to ~400MHz.

    Meanwhile, is LPDDR following the same pattern at each generation? I haven't a clue, and can find no useful answer on the internet.
  • anonomouse - Friday, November 16, 2018 - link

    I think the discussion of internal/external clock ratios is somewhat orthogonal to your originally posed question: the clock that is being advertised is the IO clock for the LPDDR4 modules, since they're telling you what the peak bandwidth of the module is. Commands are on the same clock but SDR instead of DDR and each command takes multiple cycles. Don't quite see what is so confusing about the 2133MHz clock though, since the way they are describing it is entirely accurate and is no different from previous practices. DDR4-3200 has a 1600MHz IO clock too.

    Also worth remembering that while pin speed is higher, individual LPDDR4 channels are 16bits vs 64bits, so it's not like the actual bandwidth is necessarily higher. This phone has 4-channels to get 34.1GB/s, which is the same bandwidth you'd get from a 2-channel DDR4-2133 system, but much more feasible to scale up capacity/channels/clocks on DDR4.
  • frostyfiredude - Saturday, November 17, 2018 - link

    Look, I have no idea where you're going with all the internal clocks and DDR4, DDR3, etc differences so I'm not commenting. But, here are the facts on the Mate 20 Pro:

    The DRAM - Memory controller interface is clocked at 2133Mhz.
    Due to being of the DDR family, 2 bits are transferred per clock.
    Together, this mean 4266Mbits/s transfer rate per pin.
    Finally its a 64-bit bus, meaning 64 data pins. 273024Mbits/s aggregate bandwidth.
    That breaks down to 34.1GB/s.
    In standard DIMM form on your favourite PC parts store, this is advertised as DDR4-4266 or PC4-34100.
  • ternnence - Friday, November 16, 2018 - link

    closer from ram to cpu core, higher frequency ram could get. HBM is another example.
  • eastcoast_pete - Friday, November 16, 2018 - link

    @Andrei: thanks for this in-depth review! I wonder how S.LSI takes your pessimistic take on their M4; it seems they have a hard time backing away from their in-house design that doesn't seem to cut it. Also, I appreciate that you're live-updating the review with additional information; I trust reviews that add and update their findings as new data become available much more than the one-and-done style.
    Question: Did you have a chance to ask Huawei along those lines: "What is your commitment to OS updates, how quickly will you make them available, and for how many years?". Having been burned by Huawei a few years ago (promised OS update never arrived), I am still a bit once burned, twice shy. These devices are pricey, and if Huawei wants to take on Apple at Apple prices, they should mirror Apple's commitment to provide OS updates for several years.
  • rayhydro - Friday, November 16, 2018 - link

    I'm using the mate 20 now, and I can confirm it has the same stereo setup as the mate20pro. maybe your unit's top tweeter is faulty ?
  • rayhydro - Friday, November 16, 2018 - link

    I tested both side by side in the stores, both model's stereo speakers sound pretty much the same or extremely similar to my ears. I opted for mate 20 due to it's smaller notch and headphone jack :D
  • lucam - Friday, November 16, 2018 - link

    I still think Mali GPU is a garbage GPU
  • Lolimaster - Friday, November 16, 2018 - link

    To put it simply, at the same year, they're 1 year behind.

    Mali G76 MP10 ~ Adreno 540 (a bit faster on the mali side, maybe)
  • lucam - Saturday, November 17, 2018 - link

    Adreno is always been better. Still think Imagination has the best solution tho

Log in

Don't have an account? Sign up now