System Performance

One of the more popular and pervasive beliefs in this industry is that specs increasingly don’t matter. In a lot of ways, this review isn’t really the right place to address whether or not this matters, but the short answer is that things like SoC performance matter quite a bit. Outside of the display, the SoC and RF subsystems are one of the biggest power consumers in a phone today and unlike the display or RF systems the CPU and GPU can cause short spikes of enormous power consumption. At this point, we’ve seen SoCs this year that consume anywhere between 6 to over 12 watts when faced with a full load situation. The important part here is that when an SoC uses that much power, it needs to be delivering enough performance to justify the power consumption. In order to test aspects of the phone like the SoC we use our standard suite of benchmarks, which are designed to test various real-world scenarios to get an idea of what peak performance looks like.

Kraken 1.1 (Chrome/Safari/IE)

Google Octane v2  (Chrome/Safari/IE)

WebXPRT 2013 (Chrome/Safari/IE)

WebXPRT 2015 (Chrome/Safari/IE)

In the standard web browser benchmarks, the iPhone 6s and iPhone 6s Plus are clearly in the lead. The difference in some cases is significant, but given that the benchmarks that we’re running here are all enormous optimization targets it's still a reasonable comparison point. In the interest of trying to avoid optimization targets I decided to look at some new JavaScript benchmarks that aren’t regularly used right now. One interesting benchmark is Ember Performance, which is a JavaScript app framework that is used in a number of popular websites and applications. This isn’t as popular as AngularJS at the moment, but in the absence of a good mobile benchmark EmberJS should be a reasonably good proxy.

EmberJS (Chrome/Safari/IE)

In this benchmark, we can see that there’s a pretty enormous performance uplift that results when you compare the iPhone 6s' to anything else out there on the market. Weirdly enough, on average it looks like Samsung’s S-Browser ends up slower here than Chrome, but it’s likely that this is just because S-Browser is using an older build of Chromium which negates the advantages of platform-specific optimizations that Samsung is integrating into S-Browser.

Basemark OS II 2.0 - Overall

Basemark OS II 2.0 - System

Basemark OS II 2.0 - Memory

Basemark OS II 2.0 - Graphics

Basemark OS II 2.0 - Web

Looking at Basemark OS II, once again Apple is basically taking the lead across the board. The differences aren’t necessarily as enormous as they are in single-threaded browser benchmarks, but the iPhone 6s’ retain a significant overall performance lead over the next best mobile devices.

Overall, in benchmarks where CPU performance is a significant influence the iPhone 6s is pretty much at the very top of the stack. Of course, Apple has also had about 6-8 months of time since the launch of SoCs like the Snapdragon 810 and Exynos 7420 so this is at least partially to be expected. The real surprise and/or disappointment would be if future Exynos and Snapdragon SoCs continue to lag behind the A9 in CPU performance.

A9's GPU: Imagination PowerVR GT7600 System Performance Cont'd and NAND Performance
Comments Locked

531 Comments

View All Comments

  • ciderrules - Tuesday, November 3, 2015 - link

    You think long press is OK? Imagine if right clicking in Windows you had to hold the right mouse button down for a second before the context menu popped up. You think people would accept that? 3D Touch is literally right click. It's faster than that stupid long press and leaves long press for other less used options.

    Note 5 is inferior to the iPhone 6S Plus. In almost every way, except the screen. And the screen is not nearly as big an advantage as you try to make it out to be. Sound like someone is upset at their choice of purchase.
  • MattL - Tuesday, November 3, 2015 - link

    @ciderrules

    Your tone reveals your bias.

    Long press is fine, you can have a long press that's as low as 500 ms or so, maybe even less... Pressure sensitive touch (I refuse to call it 3D touch lol) might be a slight bit faster, maybe more efficient, we'll see... but the truth is that a lot of the functionality that was added could have easily been done with a long press, right now people are seeing the contrast of going from no long-press like context specific functionality straight into pressure sensitive context menus, so it seems extremely improved because they skipped an entire step they could have done long ago.

    You assume too much about me lol, I don't own a Note 5, I own a Note 4. I didn't see a reason to pay to upgrade to the Note 5, it's an incremental upgrade, worth getting for new users but not enough to rush to upgrade. I have owned an iPhone in the past, so I'm plenty familiar with Android and iOS... I love my Note 4 and don't see any reason to upgrade to either Note 5 or iPhone 6s Plus.

    The iPhone 6s Plus is not superior in every way except the screen lol. The screen is very likely to be superior on the Note 5 (since Samsung has put out far superior screens for multiple generations now) though I'll hold off on the Display Mate review which does a *far* deeper analysis than Anandtech on screen. Areas where Anandtech makes offhand commments about viewing angle quality etc Displaymate will release hard numbers, such as how much brightness decreases at an angle, contrast loss, etc.

    Don't downplay the advantage of screen quality in the Samsung phones over the iPhones though, they offer a *Far* superior contrast which often is considered the most important image quality aspect. They usually offer somewhat superior color accuracy though they both are getting so close to perfect they both are usually beyond (or close to beyond) what the human I can see. Keep in mind that the Samsung phones offer a mode that is calibrated and supports the Adobe color gamut, something that is very impressive on a mobile device (and for professionals is actually very useful). Also viewing angles are often far superior on the latest Samsung screens, especially in brightness and contrast (where you see a significant benefit).

    All these things add up quite a bit and considering the screen is your primary interface input for your phone it shouldn't be underplayed... Honestly far more important than CPU and GPU speeds in my opinion (why I mostly stopped caring about CPU and GPU specs a couple years ago, though from a technical perspective it's interesting).

    These are all things you should educate yourself on before you make assumption based comments about another persons intentions.

    I am impressed with Apples progress on the CPU and GPU side... Storage (to a lesser extent since let's be honest PCIe storage was inevitable to come to phones, just like NFC payments came to Android phones first Apple hit this mark a bit early, credit given in context) is also a good improvement. Apple users have long argued they don't care about specs like that though ironically and honestly I've agreed with them for at least 2 years now (when I felt phones reached a certain level of power where they get diminished returns beyond that, unless some drastic new feature is discovered that needs serious more power, say maybe MS continuum where it needs to run as a desktop).

    I'm just a proponent of a fair review, the distinct advantages of the Note 5 and Edge phones are heavily underplayed in this comparison while the advantages to the latest iPhone is heavily emphasized... Not only that Anandtech mentions two out of three negatives to the Samsung display aren't even mentioned in their Samsung review (and something I don't find mention of in other in-depth display reviews) so either they didn't feel the need to point it out when they actually reviewed the product or they felt the need to speculate or invent new negatives to make it look more balanced.

    Comparisons are pointless unless they are fair.
  • MattL - Tuesday, November 3, 2015 - link

    Also to add, one area where the latest Samsung phones excel (and other Android phones actually) is camera quality. Refer to the dxomark analysis where the iPhone's latest camera is literally a wash compared to it's last gen tech... while Android cameras (that were already better than last gen iPhone) have taken a further step up.

    Ironically it's a reverse of what you see with the SoC, where Apple took a big step forward while Android SoC languished a bit (though again to be fair it's 6 months older, but still it wasn't a bit step forward) while the iPhone camera performance literally was overall equal to last gen (a baby step forward in some areas and backward in others) while Android continues to use camera tech that progresses nicely forward.
  • osxandwindows - Tuesday, November 3, 2015 - link

    Personally I like the iPhone camera better.
    I have a note 5 and iPhone.
    Some people think DXO marc were paid.
    Many people like the iPhone camera better tho.
    The note 5 has a grate camera.
    Heck people didn't like the sony z5 at all.
    So on the camera side its completely your opinion.
    Or should I say personal for a preference.
  • MattL - Friday, November 6, 2015 - link

    But see it isn't your opinion lol. That's like saying the SoC is your opinion, which completely invalidates all the great work Anandtech did on reviewing every detail of that SoC.

    Now how the software uses that SoC (being the OS) comes somewhat down to opinion, do you like iOS vs Android etc.

    Cameras are the same way, you can analyze the raw performance of a variety of aspects, especially the sensor. Now how you like the Camera app software, that can come down to preference or if there are trade-offs you might prefer trading one thing for another etc.

    Also no one who has a clue thinks dxomark was paid off lol. They've been doing sensor analysis for a long time, before mobile phones were worth measuring they just did DSLR sensor analysis, including the top end professional grade cameras. They still do this and are still an oft referenced source not only by professionals and consumers but by other camera review sites around the web. Sensor and metric performance is just one aspects of a Camera of course, but they offer tangible and quantifiable metrics that can help you understand how cameras compare... and the latest gen of iPhones scored equal to the last gen, effectively no improvement, while the Android cameras keep leading the pack.

    It's not surprising since the leading sensors on the Mobile list on dxomark are made by Sony which also has the leading sensors in professional grade DSLR and mirroless cameras as well. Sony has made best-in-class sensors (Nikkon has used sony sensors for many of their cameras for a while now) for a long time.

    This is why anyone who has a clue just laughs at anyone questioning Dxomark or that a Sony sensor in a phone can be better than an Apple one.

    Again there are more things to consider than raw performance, much like the iPhone's new superior SoC won't get you Android style widgets, a back button, or multi-tasking if you prefer those things... just like a new Android coming out with a faster SoC won't get you the iOS UI experience (if that's your preference)... but there are important metrics to evaluate and it feels like this review downplayed all the advantages of the other phones and overplayed the CPU and GPU advantage in the new iPhones. Some of us just think that's a bit biased.
  • ciderrules - Tuesday, November 3, 2015 - link

    Something clearly bothers you to spend so much time typing a response.
  • osxandwindows - Wednesday, November 4, 2015 - link

    Naw man just felt like doing it.
  • FL777 - Friday, November 6, 2015 - link

    Great comment, I thought that the authors "fell in love" with the efficiency that Apple built into its new SoC. Being computer lovers, it is somewhat foregivable. However, they do appear to be school children saying, "Wow, this bright shiny SoC is the best damn thing in the whole wide world."

    Hands down, the Note 5 and Galaxy S6 at the very least compete with the iPhone 6S and in my mind, they are better phones for a number of reasons.
  • FL777 - Tuesday, November 3, 2015 - link

    First let me compliment the authors of this article. No other website anywhere does as thorough a job as Anandtech in objectively reviewing a smartphone. You provide solid, objective facts for your reviews. That is something most reviewers utterly fail at. That being said I have some criticisms:

    1. The iPhone 6S display is just sad compared to the Ssamung S6 and Note 5
    2. 3D Touch has been listed as buggy in other reviews and yet you don't mention this issue
    3. The Note 5 and Samsung S6 BOTH charge much more quickly than the iPhone 6S. That is VERY IMPORTANT IN THE REAL WORLD
    4. Both the Note 5 and the S6 have wireless charging, which is very convenient. The Note 5 has quick wirless charging which is revolutionary - no other phone has it.
    5. The Samsung S6 and Note 5 SoC is effectively about 7 months older thatn the iPhone 6S SoC. I hope you will be as complimentary to the Galaxy S7 SoC when it comes out in January. It is supposed to be 25% faster than the 6S SoC. The new Samsung SoC is rumored to be a beast.
    6. Also upcoming with the Galaxy S7 is alwo rumored (and this is just a rumor) to have its own 3D touch.
    7. While the iPhone 6S is faster than the Note 5 and Galaxy S6, is there really that much difference in the real world? I think you have lost your objectivity because youa re impressed with Apple's SoC. And remember, the huge gains the IPhone 6S would not really be possible with Samsung's and TMCS's chip manufacturing skills. Apple should be concerned with Samsung's advent of manufacturing its own SoC chips - by all accounts, the Exnyos 7420 is a brilliant SoC and it STILL competes with the iPhone 6S, though it is nearly eight months older.
    8. MANY professional reviewers including some professional photographer reviewers have stated that the S6 camera, the Note 5 camera and the LG4 camera are all better than the iPhone 6S camera. One rason is that they can take RAW photographs and have full manual control. Again, it appears that you have lost your objectivity when reviewing the camera functions.
    9. I own the Galaxy S6 and one of my friends that I dance with has the iPhone 6S and you are INCREDIBLY wrong in your conclusions for low-light situations. At our dances, my friend's iPhone 6S is UNUSABLE, the sensor simply doesn't let enough light in My Samsung S6 has become the goto phone to take ALL of the crtical videos and pictures when we dance. One of my other friends owns an iPhone 6 and he can't use his phone at our dances. He borrowed my phone to vidoe his friend last week when his friend was dancing with a famous champion.

    Simply said, you couldn't be more in error about the low-light capabliities of the two phones. Frankly the iPhone 6S is embarrassing in really dark situations.

    I agree that the iPhone 6S and the Galaxy S6 / Note 5 are the two best phones on the market right now. Where we disagree is that the iPhone 6S is that much better than the Note 5 and S6. The display issue itself is embarrassing. The iPhone doesn't even have an HD screen. The 6S is the fastest smartphone on the planet right now, but so what????? It is only a microsecond faster than Samsung's last generation phones and most people won't care. Applies IOS is superior in its cohesiveness, Android is catching up quickly.
  • blackcrayon - Tuesday, November 3, 2015 - link

    The display issue is far from "embarrassing". What's embarrassing is having a display that taxes your GPU to the point that you can't maintain top level performance over the course of an intense 3D graphics session. I'll take performance over more pixels any day, the small observable difference is a terrible tradeoff some of the manufacturers are making just to post a larger number on a spec sheet.

Log in

Don't have an account? Sign up now