System Performance Cont'd

Moving on towards our more GPU-bound workloads, we use our standard test suite of benchmarks like GFXBench and 3DMark to get a good idea for performance. Unfortunately, due to the move to iOS 9 the Unity engine version used in Basemark X is no longer working so for now we’re left with 3DMark and GFXBench. There is also Basemark OS II’s graphics test, but this is embedded in a larger benchmark with CPU and storage performance tests.

3DMark 1.2 Unlimited - Overall

3DMark 1.2 Unlimited - Graphics

3DMark 1.2 Unlimited - Physics

As always with 3DMark, there are some issues in the data structures used. Due to the data dependencies present within the physics test, it is necessary for the CPU to stall for data to be committed to memory before continuing on to the next portion of the test instead of executing instructions in parallel. This strongly reduces the practical performance of the CPU because the architecture is primarily focused upon instruction-level parallelism to deliver major performance gains. However, due to the strong showing in graphics performance the iPhone 6s’ still manage to take the lead.

GFXBench 3.0 Manhattan (Onscreen)

GFXBench 3.0 T-Rex HD (Onscreen)

GFXBench 3.0 Manhattan (Offscreen)

GFXBench 3.0 T-Rex HD (Offscreen)

In GFXBench, the A9 SoC just shows absurd performance. It’s strange to think about how the iPad Air 2’s GPU seemed incredibly quick at the time but with the A9 Apple has surpassed that level of performance in their smartphone SoCs. The move to a new generation of PowerVR GPU IP, in addition to the move to a FinFET process node are really the drivers for this kind of performance improvement.

Overall, the Apple A9 SoC is the best SoC in any phone shipping today. In cases like web browsing, gaming, and even just going through the UI it’s quite evident that this new SoC is a major factor in improving performance and smoothness across the board. Something as simple as visiting some popular tech websites will show this, which really goes to show how much “specs” still matter due to their influence on user experience.

NAND Performance

At this point is almost goes without saying that storage performance is important, but in a lot of ways the testing here is still in its early days. In the case of the iPhone 6s we’ve discussed what distinguishes its storage solution from others in this industry, but for those that are unaware the iPhone 6s uses PCIe and NVMe instead of a UFS or eMMC storage solution. In a lot of ways, this makes the storage on board closer to the SSD that you might find in a more expensive PC but due to PCB limitations you won’t necessarily see the enormous parallelism that you might expect from a true SSD. In the time since the initial results we've found that all of our review units use Hynix-supplied NAND. In order to test how this storage solution performs, we use Eric Patno’s storage test which allows for a simple storage test comparable to AndroBench 3.6.

Internal NAND - Sequential Read

Internal NAND - Sequential Write

Internal NAND - Random Read

Internal NAND - Random Write

Here, we can really see the enormous performance improvements that result from a combination of TLC NAND with an SLC cache, along with the new NVMe protocol which allows for low CPU overhead and removes architectural bottlenecks to storage performance. This should allow for things like faster burst photos and faster app updates. Downloading and updating apps on the iPhone 6s feels noticeably faster than it is on the iPhone 6, to the extent that small apps feel like they install almost instantly when I’m on a WiFi connection fast enough to saturate storage bandwidth.

System Performance Battery Life and Charge Time
Comments Locked

531 Comments

View All Comments

  • danbob999 - Monday, November 2, 2015 - link

    yeah, because reviewers value aesthetics more than functionality
  • scbundy - Monday, November 2, 2015 - link

    Some of us don't feel "Living pictures" and Touch 3D are all that revolutionary either. And I agree with the earlier posters, the price should be accounted for when determining the final score. The Nexus 6P in Canada is half the price as an iPhone 6S Plus. So if the device performs well and is well designed, and can hit the price tier that it does, wouldn't you say that does something meaningful to move the smartphone industry forward?
  • RealityMonster - Tuesday, November 3, 2015 - link

    No, not really. Lots of phones are being sold cheaply--good phones. That doesn't mean they have anything to contribute, they're just good phones at a low price.

    Cheap cars don't move the car industry forward. It's the expensive ones with new technology--the Mercedes and Teslas--that do. Anti-lock brakes, new drivetrain tech, adaptive headlights, etc., etc. Those all come from cars that are at the very high end, and the tech eventually comes down to the cheaper cars.

    I'm not disparaging the Nexus line--by every account I've read, they're the best Android phones around and they're affordable to boot. But that doesn't mean they're a meaningful step forward in usability or performance.
  • deasys - Monday, November 2, 2015 - link

    There's a good Nexus 6p test here: https://www.youtube.com/watch?v=tTIaUH6PIvo
  • amdwilliam1985 - Tuesday, November 3, 2015 - link

    They're only doing 5X review, no 6P. I know man, sigh...
  • Klug4Pres - Monday, November 2, 2015 - link

    Please quote phone prices on the basis of outright purchase - this site has an international readership, for whom the intricacies of US contract subsidies are completely irrelevant.
  • Ryan Smith - Monday, November 2, 2015 - link

    Agreed. I've switched them to the off-contract prices.
  • Brandon Chester - Monday, November 2, 2015 - link

    That was my fault, it was a holdover from the launch chart. In Canada it's actually $399/$529/$659 for the 6s on contract!
  • doggface - Monday, November 2, 2015 - link

    In Australia these phones cost north of Aud$1000. Or you can get it on a plan for about $100+ a month over 2 years.

    Same with the Samsungs. What a deal breaker.
  • zeeBomb - Monday, November 2, 2015 - link

    A standard 2 year plan for $100 each month...that's a limit-break bank breaker!

Log in

Don't have an account? Sign up now