CPU Performance & Efficiency: SPEC2006

We move on with our analysis by using SPEC2006 on the Snapdragon 855 QRD. SPEC2006 is an important benchmark as not only does it represent a tool that is used by many companies to architect their CPU designs, but it also a very well understood and academically documented workloads that can serve as a macro-benchmark to determine microarchitectural aspects of a CPU and system.

It’s to be noted that SPEC2006 has been deprecated in favour of SPEC2017, and although we’ll switch to that at some point, for mobile platforms SPEC2006 still represents a good benchmark. Because our scores aren’t official submissions, as per SPEC guidelines we have to declare them as internal estimates from our part.

A Big Note on Power on the QRD

Although for this article I was able to collect power figures for both CPU and GPU workloads, the figures are not of an as high certitude as when measured on commercial devices. The reason for this is that much like last year’s Snapdragon 845 QRD, this year’s 855 platform reports rather high idle power in the 950-1050mW range, about 500mW more than one would expect in a final product. Because our power measurement methodology represents publishing active system power, meaning we measure total power during a given workload and subtract the idle power under the same conditions, there is a degree of uncertainty if the idle power by default is quite high.

Today’s power efficiency figures thus merely represent a guideline – and we’ll make sure to re-test the results once we get our hands on final commercial devices.

The Results – The Snapdragon 855 Performs Admirably

We’ll start off with the aggregate results and drill down in the detailed results later:

The Snapdragon 855 ends up performing extremely well, ending up neck-and-neck with the Kirin 980’s performance, which shouldn’t come as too big of a surprise.

In SPECint2006, the Snapdragon 855 performs 51% better than the Snapdragon 845, all while improving power efficiency by 39% over its predecessor. Against the Kirin 980 which is currently its nearest Android competitor, the Snapdragon just slightly edges ahead by 4%.

In SPECfp2006, the Snapdragon 855 shows an even bigger 61% leap over the Snapdragon 845, and also manages to better showcase the 9% clock speed advantage over the Kirin 980, sporting a similar performance lead.

Again what is most important in these results is the power efficiency figures. One of the things that had me worried during Qualcomm’s Snapdragon 855 launch in Hawaii last month is that the company pretty much avoided talking or publishing any meaningful power efficiency claims on the side of the CPU. Fortunately it seems there wasn’t any need to be concerned as the Snapdragon 855, at first glance, seems to be extremely efficient even on the high clocked 2.85GHz Prime core.

Detailed Results

Drilling down into the detailed results, the one comparison that is most interesting is the performance of the Snapdragon 855 against the Kirin 980. On one hand the Snapdragon 855 is clocked 9% higher as well as promises some tuned microarchitectural characteristics which promise to improve IPC – while on the other hand HiSilicon’s implementation is more straightforward and brings with itself a bigger L3 cache as well as memory latency advantages.

In the vast majority of workloads, both chipsets are neck-and-neck, only diverging in some key aspects. In less memory hierarchy demanding workloads, the Snapdragon more easily is able to showcase its clock speed advantage. In more latency sensitive workloads, this difference shrinks or reverses. 462.libquantum is an interesting result as Qualcomm commented that its lead here is primarily due to the customisations made on the CPU core – although they wouldn’t exactly specify which aspect in particular is bringing the boost.

The biggest performance discrepancy on the negative side of things is the 13% disadvantage in 458.sjeng – the benchmark is most sensitive to branch mispredictions and again here Qualcomm has stated they’ve made changes to the branch data structures of the core.

What is most odd for me to see as a result, is the fact that 429.mcf performs admirably well on the Snapdragon 855 – which goes against intuition given the platform’s memory latency disadvantage. It is possible here that the Snapdragon 855 performs better than the Kirin 980 due to its better L3 cache latency?

On the SPECfp2006 results, the results can be very clearly categorised into two sets: In one set the Snapdragon 855 clearly showcases a healthy advantage over the Kirin 980, up to very notable 17% and 22% leads in 447.dealII and 453.povray. In the other set, the Snapdragon is again neck-and-neck with the Kirin 980, and these happen to again be the workloads that are most memory sensitive in the FP suite.

Overall, the Snapdragon 855’s CPU performance does not disappoint. Performance on average is ahead of the Kirin 980, although not by much. Here both chipsets are most of the time neck-and-neck, and it will mostly depend on the workload which of the two will take the lead.

More important than performance, the efficiency of the Snapdragon 855 is top-notch, exceeding what I had expected from the higher clock implementation of the chip. There is still a degree of uncertainty over the power numbers on the QRD platform, but if these figures are representative of commercial devices, then 2019’s flagship will see excellent battery life.

Introduction & Specifications Inference Performance: Good, But Missing Tensor APIs
Comments Locked

132 Comments

View All Comments

  • WildBikerBill - Wednesday, January 16, 2019 - link

    What I want to know is...now that we know the high end, what do the affordable mid-range products become?
  • B3an - Wednesday, January 16, 2019 - link

    This SoC is VERY disappointing. Wont be upgrading this year to any phone that has this.

    Hopefully Samsungs new SoC for 2019 is much MUCH better than the utter joke they had in the Galaxy S9... That was a fucking disaster... I'm hoping it actually performs well in REAL WORLD cases this time, not just mostly meaningless benchmarks, but i doubt it. Samsung reminds me of when desktop PC GPU makers would cheat in benchmarks by using driver hacks.
  • serendip - Wednesday, January 16, 2019 - link

    It looks like Qualcomm is having an Intel-like moment where performance stops having meaningful increases year-on-year. For me, an SD835 device is more than fast enough and an 855 only makes sense for higher-performing larger devices like Windows tablets.

    Time to focus on the software then... my old SD650 device got a new lease on life with a clean build of Lineage on Android Pie. The same slowdown that hit the laptop/PC markets could cause a crash in the smartphone market as people keep their phones for 3-4 years instead of upgrading annually.
  • serendip - Wednesday, January 16, 2019 - link

    I doubt it. Apple seems to be the only one with a cracking chip design team. Huawei seems to be doing decent work with HiSilicon but ARM designs are still far behind.

    Does it matter though? Apple's latest chips are so overpowered for their phones and tablets, the performance numbers are more for bragging rights than anything else. That could change once they start using A-series chips in their laptops.
  • yankeeDDL - Sunday, January 20, 2019 - link

    Disclaimer: I have been using a Galaxy S8 (SD835) and I don't feel the need to upgrade anytime soon, however:
    a) Having more power is always nice, and there are times where the phone ... stutters, especially when moving from "heavy" games.
    b) The gap with the iphones is embarrassing, and I don't see any technical justification. Yes, the iPhones are optimized all around (HW+SW) thanks to their closed ecosystem, but nearly 2x gap on the GPU is a deliberate choice which should be, at the very least justified.

    We need competition in the mobile CPU/GPU, or Qualcomm will quickly become the Intel of mobile, sitting on his a** until something better comes along.
  • cha0z_ - Monday, January 21, 2019 - link

    Dunno why Andrei is so kind in his wording about the new snapdragon. For start it's nothing that more powerful vs the kirin 980 (while it was shaped to literally obliterate it in both CPU/GPU, especially the GPU). Also even the A11 is making a joke of it and the A12 sustained performance is higher than the sd855 peak in GPU... and CPU is also for the A12 and even A11.

    I would kinda understand for the sd855 to lack behind the A12 with 15% in CPU/GPU, will accept somewhat to lose to the A12 even with more, but losing to the A11 is roflmao funny. How in the world you can call it success when qualcomm(as a leader in that regard) can't catch up with apple for years? Recently even the GPU started to lag behind BIG time, before atleast that was on par. Well.. cool.
  • mfaisalkemal - Sunday, January 20, 2019 - link

    Hi Andrei, what do you think about 3 benchmark on https://www.asteroidsbenchmarks.com ?

    all of them include metal and vulkan api benchmark so we can comparing iOS and Vulkan mobile.

    The benchmark include off screen test.
  • DontTreadOnMe - Thursday, January 24, 2019 - link

    Does this A76 CPU support the pointer authentication codes that Apple have had since iPhone X? It seems like this is a potentially very useful security feature that it would be nice to see on Android devices.
  • Uol - Tuesday, January 29, 2019 - link

    thank you <a href="https://www.wikipedia.org/">site</a>
  • Nystiael - Thursday, February 7, 2019 - link

    Very nice. I will but it by I don't have the money atm.

    Greetings
    https://showbox-apk.mobi

Log in

Don't have an account? Sign up now