System Performance Cont'd

Moving on towards our more GPU-bound workloads, we use our standard test suite of benchmarks like GFXBench and 3DMark to get a good idea for performance. Unfortunately, due to the move to iOS 9 the Unity engine version used in Basemark X is no longer working so for now we’re left with 3DMark and GFXBench. There is also Basemark OS II’s graphics test, but this is embedded in a larger benchmark with CPU and storage performance tests.

3DMark 1.2 Unlimited - Overall

3DMark 1.2 Unlimited - Graphics

3DMark 1.2 Unlimited - Physics

As always with 3DMark, there are some issues in the data structures used. Due to the data dependencies present within the physics test, it is necessary for the CPU to stall for data to be committed to memory before continuing on to the next portion of the test instead of executing instructions in parallel. This strongly reduces the practical performance of the CPU because the architecture is primarily focused upon instruction-level parallelism to deliver major performance gains. However, due to the strong showing in graphics performance the iPhone 6s’ still manage to take the lead.

GFXBench 3.0 Manhattan (Onscreen)

GFXBench 3.0 T-Rex HD (Onscreen)

GFXBench 3.0 Manhattan (Offscreen)

GFXBench 3.0 T-Rex HD (Offscreen)

In GFXBench, the A9 SoC just shows absurd performance. It’s strange to think about how the iPad Air 2’s GPU seemed incredibly quick at the time but with the A9 Apple has surpassed that level of performance in their smartphone SoCs. The move to a new generation of PowerVR GPU IP, in addition to the move to a FinFET process node are really the drivers for this kind of performance improvement.

Overall, the Apple A9 SoC is the best SoC in any phone shipping today. In cases like web browsing, gaming, and even just going through the UI it’s quite evident that this new SoC is a major factor in improving performance and smoothness across the board. Something as simple as visiting some popular tech websites will show this, which really goes to show how much “specs” still matter due to their influence on user experience.

NAND Performance

At this point is almost goes without saying that storage performance is important, but in a lot of ways the testing here is still in its early days. In the case of the iPhone 6s we’ve discussed what distinguishes its storage solution from others in this industry, but for those that are unaware the iPhone 6s uses PCIe and NVMe instead of a UFS or eMMC storage solution. In a lot of ways, this makes the storage on board closer to the SSD that you might find in a more expensive PC but due to PCB limitations you won’t necessarily see the enormous parallelism that you might expect from a true SSD. In the time since the initial results we've found that all of our review units use Hynix-supplied NAND. In order to test how this storage solution performs, we use Eric Patno’s storage test which allows for a simple storage test comparable to AndroBench 3.6.

Internal NAND - Sequential Read

Internal NAND - Sequential Write

Internal NAND - Random Read

Internal NAND - Random Write

Here, we can really see the enormous performance improvements that result from a combination of TLC NAND with an SLC cache, along with the new NVMe protocol which allows for low CPU overhead and removes architectural bottlenecks to storage performance. This should allow for things like faster burst photos and faster app updates. Downloading and updating apps on the iPhone 6s feels noticeably faster than it is on the iPhone 6, to the extent that small apps feel like they install almost instantly when I’m on a WiFi connection fast enough to saturate storage bandwidth.

System Performance Battery Life and Charge Time
Comments Locked

531 Comments

View All Comments

  • flyingfiddle - Wednesday, November 4, 2015 - link

    Truly amazed and convinced that Apple has the best SoC of any phones, and their investment on the SoC paid off. So does their investment on refined iOS experience. I am Android guy but I have to admit I really wish SoC on Android could catch up one day, sooner the better.

    On the other hand, just because Apple is great in some areas does not mean they should get away with other things that's not as great. The raw power of a high end phone has become more than sufficient for many general users, such that making it more powerful is starting to generate diminished return. I could think of many things that I wish iPhone has, such as longer battery life (i know it's great, relatively, but why not push the boundary?), better screen/body ratio, external memory, more setting and better UI in the camera app, etc.
    Well, still not my cup of tea but truly wish Android SoC could catch up one day. That's assuming Android platform survive that long (they have the largest market share but really don't make much money). I hope my money helps supporting them a bit longer..
  • tytung - Wednesday, November 4, 2015 - link

    Can anyone comment on the iPhone 6s Plus frame rate dropping issue ? Animations looks choppy and the frame rate looks like only about 30 fps, unlike 60 fps on the 6s. If the GPU on the phone is so powerful this should not be an issue. In fact, for a phone this expensive UI frame rate drop is really a shameful problem.
  • polmes - Thursday, November 5, 2015 - link

    Got tired of iOS and moved to Android (Galaxy S6) earlier this year, but Apple definitely deserves an applause for being basically the only one to keep innovating in the mobile space. kudos
  • Socius - Thursday, November 5, 2015 - link

    Hmmmm...any idea why your iPhone 6s Plus scored just 15800 in Google octane when mine scored over 18,000? That's a pretty big discrepancy at 15%. Does your phone have a Samsung CPU? Mine is TSMC.
  • zeeBomb - Thursday, November 5, 2015 - link

    Both units are TSMC.
  • Socius - Thursday, November 5, 2015 - link

    Then there's something off as there is no way the 6s plus should be scoring just 15,800 on octane.
  • mortimerr - Thursday, November 5, 2015 - link

    I've never actually owned an Apple product in my life. All the way back to the original iPod classic. But I will probably finally be changing my stupid principle of 'No Apple Products'.

    The Android landscape recently has been going back instead of forward. Android 5-6 showcase minor improvements over 4.4.4 (Personally I also prefer Halo. Marshmallow and Lollipop looks slightly cartoony), battery life isn't that much of a leap (a lot of devices are experiencing the mobile radio active bug), and due to the fact that the high end market in the East is so saturated, most OEMs are cutting costs and putting out mid tier phones that lack top end hardware.

    A lot of recent releases for Android have a great price point but either have a terrible camera (sensor, pixel size, post processing etc) or the IPS display leaves something to be desired, or it's this or it's that. The only OEM pushing the platform forward is Samsung. But, to be quite frank, I find those devices ugly to look at in every way from the bezel, UI skin, back, front, etc.

    Where as Apple continues to simply improve with every iteration. Dual source fab at 14nm! What? 3D touch, increasing the ppi, maintaining solid battery life, great low light camera performance. Offering a big size and a small size with the same internals.
    Sony also did this but I don't see the 810 as a very good chip going forward. Especially when it's already pretty far behind in performance to the Exynos and A#. I'll look forward to see if Sony updates the Z line.

    I want to wait for Q2'16 for when devices with the 820 start being released, but what's the point when every device will inevitably have some drawback or large flaw or straight up just not be released in N. America.
  • JTRCK - Friday, November 6, 2015 - link

    Where do you want phones to go? There's not much else they can do. A phone being imperfect is "always" the case. There is always something lacking in all these devices, including the iPhone 6S and 6S Plus. One of the first mentions in this review is that the author is still using an HTC One M7 from years ago. Because quite honestly, that was the pinnacle of smartphone design plus an excellent combination of fluid software, excellent performance, and an excellent night performance for a camera (though everything else about that camera was a downgrade). That 3 year old phone is still a very good performer today.

    Increasing processor/RAM/Storage speed is all excellent and it's expected, but the benefits from such increases are hardly felt by the user on day to day usage. Especially if the software is done properly. Example: I have an old iPhone 4s at home that I use for music streaming that consistently beat out my previous note 4 on application opening, multitasking, sound output quality, web surfing speed, etc. Which phone is superior? Which phone is better? Did AnandTech give that iPhone 4s the BEST award? In my view Apple has always been the king of software and hardware performance. They can get a device with 512mb of ram to outperform a Note 4 with a multicore processor and with 3GB of ram. They should always get the BEST award. But is the BEST (100%) really worth $1,200.00 when the second BEST (99%) is half the price?

    I'm not talking about Samsung here. Their phones are expensive with crappy performance. I'm talking about the Moto X Pure, HTC One M9/10, Nexus 6P, etc. I used an iPhone 6S Plus for 2 weeks (and an iPhone 6 Plus for 4 months before that) and returned it for the Nexus 6P. I find the 6P to be a much better phone than the iPhone 6S plus in almost every aspect. It charges faster, it opens applications just as fast, I can multitask faster with the 6P with a side launcher without ever having to see a home screen. I can transition within an app at a faster pace due to dedicated back buttons. A simple thing as not having a "button" to go back a task annoyed me to no end with the iPhone. Not to mention all the limitations of iOS. The only benefit of iPhone for me were the integrations with my Macbook, but other than that. I disliked both iPhones.

    The iPhone has all this amazing technology at its core, but my grandmother would never know when using her new 6S. And that's how it should be. I'm more amazed that a Nexus 6P costs half what an iPhone costs while still managing to do just as much, if not more. I honestly found nothing revolutionary about the 6S Plus while using it. In fact, I found it to be quite similar to the 6 Plus. Which I found to be quite similar to the iPhone 4s. Just much larger. And in terms of OS performance, vanilla android at this point is quite simply just as visually pleasing, power efficient, responsive and performant as iOS.
  • FL777 - Friday, November 6, 2015 - link

    Amusingly, there is a YouTube real world speed test between the Nexus 6P and the iPhone 6S and the Nexus 6P BEATS THE IPHONE 6S!!!!!

    http://www.frequency.com/video/nexus-6p-vs-iphone-...

    So much for the iPhone 6S SoC being unbeatable LOL.
  • Blark64 - Friday, November 6, 2015 - link

    Umm, did you watch the video? The difference was milliseconds, and with a "hand-done" test like this the phones were well within the margin of error, and essentially tied. Also, that was possibly the least informative benchmark I've ever seen, since repeatedly launching apps in a tight cycle is something that essentially no one actually does in the real world. That's why benchmarks that are either: more reflective of the real world, or synthetic and scientifically repeatable (like Geekbench and the various browser benchmarks), are probably a better guide.

Log in

Don't have an account? Sign up now