System Performance

One of the more popular and pervasive beliefs in this industry is that specs increasingly don’t matter. In a lot of ways, this review isn’t really the right place to address whether or not this matters, but the short answer is that things like SoC performance matter quite a bit. Outside of the display, the SoC and RF subsystems are one of the biggest power consumers in a phone today and unlike the display or RF systems the CPU and GPU can cause short spikes of enormous power consumption. At this point, we’ve seen SoCs this year that consume anywhere between 6 to over 12 watts when faced with a full load situation. The important part here is that when an SoC uses that much power, it needs to be delivering enough performance to justify the power consumption. In order to test aspects of the phone like the SoC we use our standard suite of benchmarks, which are designed to test various real-world scenarios to get an idea of what peak performance looks like.

Kraken 1.1 (Chrome/Safari/IE)

Google Octane v2  (Chrome/Safari/IE)

WebXPRT 2013 (Chrome/Safari/IE)

WebXPRT 2015 (Chrome/Safari/IE)

In the standard web browser benchmarks, the iPhone 6s and iPhone 6s Plus are clearly in the lead. The difference in some cases is significant, but given that the benchmarks that we’re running here are all enormous optimization targets it's still a reasonable comparison point. In the interest of trying to avoid optimization targets I decided to look at some new JavaScript benchmarks that aren’t regularly used right now. One interesting benchmark is Ember Performance, which is a JavaScript app framework that is used in a number of popular websites and applications. This isn’t as popular as AngularJS at the moment, but in the absence of a good mobile benchmark EmberJS should be a reasonably good proxy.

EmberJS (Chrome/Safari/IE)

In this benchmark, we can see that there’s a pretty enormous performance uplift that results when you compare the iPhone 6s' to anything else out there on the market. Weirdly enough, on average it looks like Samsung’s S-Browser ends up slower here than Chrome, but it’s likely that this is just because S-Browser is using an older build of Chromium which negates the advantages of platform-specific optimizations that Samsung is integrating into S-Browser.

Basemark OS II 2.0 - Overall

Basemark OS II 2.0 - System

Basemark OS II 2.0 - Memory

Basemark OS II 2.0 - Graphics

Basemark OS II 2.0 - Web

Looking at Basemark OS II, once again Apple is basically taking the lead across the board. The differences aren’t necessarily as enormous as they are in single-threaded browser benchmarks, but the iPhone 6s’ retain a significant overall performance lead over the next best mobile devices.

Overall, in benchmarks where CPU performance is a significant influence the iPhone 6s is pretty much at the very top of the stack. Of course, Apple has also had about 6-8 months of time since the launch of SoCs like the Snapdragon 810 and Exynos 7420 so this is at least partially to be expected. The real surprise and/or disappointment would be if future Exynos and Snapdragon SoCs continue to lag behind the A9 in CPU performance.

A9's GPU: Imagination PowerVR GT7600 System Performance Cont'd and NAND Performance


View All Comments

  • daveedvdv - Tuesday, November 3, 2015 - link

    People can disagree on what's the "best" overall, but once they reach for the "they're obviously paid by XXX" argument, they have forfeited their own credibility.

    Great job on that review! Many thanks for what obviously must have been painstaking work getting all the measurements and estimates for SoC feature counts.
  • Alexey291 - Tuesday, November 3, 2015 - link

    Or maybe, just maybe, they actually see the pretty damn obvious deterioration of quality in the website. Possibly they noticed that reviews have now become adverts instead of actual critiques.

    I don't actually think they get paid anything straight up, but boy is Anandtech editorial team scared of offending the vendors. The time when these guys were at all objective has passed a long time ago.

    But yeah great review. This webby is certainly the best at saying 'the best'.

  • zeeBomb - Saturday, November 7, 2015 - link

    Oh yes definitely! Reply
  • djsvetljo - Monday, November 2, 2015 - link

    Oh please. There so many things wrong with this phone.

    BTW, didn't Anand himself went to work for Apple last year?
  • AEdouard - Monday, November 2, 2015 - link

    As there are things wrong with any other phone, and the negatives (minor by all accounts) are mentioned. Reply
  • djsvetljo - Monday, November 2, 2015 - link

    There are many wrong things with many wrong platforms and phones. [ I my self still hold a BlackBerry10 and Moto X first generation because I can't chose a modern phone for my needs (size being key factor). ]
    That is why nobody of such high of tribune should dare to call something "the best".
  • AEdouard - Monday, November 2, 2015 - link

    The Nexus 6P seems pretty much the clear top choice on Android right now no? Reply
  • NEDM64 - Monday, November 2, 2015 - link

    "on Android" Reply
  • ASEdouardD - Monday, November 2, 2015 - link

    Yeah, that's why I said Android. I have a 6s Plus which I really like right now.

    But I would be perfectly happy with a 6P. Also loved my Nexus 5, despite its drawbacks (battery, camera).
  • zeeBomb - Monday, November 2, 2015 - link

    Its okay man. At least, Google finally got the camera right. Reply

Log in

Don't have an account? Sign up now