General Purpose Performance

Section by Anand Shimpi

Apple's philosophy on increasing iPhone performance is sort of a mix between what Microsoft is doing with Windows Phone 7/8 and what the high-end Android smartphone makers have been doing. On the software side Apple does as much as possible to ensure its devices feel fast, although I notice a clear tendency for newer iOS releases to pretty much require the latest iPhone hardware in order to maintain that speedy feel over the long haul. When it comes to hardware, Apple behaves very much like a high-end Android smartphone vendor by putting the absolute fastest silicon on the market in each generation of iPhone. The main difference here is that Apple controls both the software stack and silicon, so it's able to deliver a fairly well bundled package each year. It's a costly operation to run, one that is enabled by Apple's very high profit margins. Ironically enough, if Apple's competitors would significantly undercut Apple (it doesn't cost $599 - $799 to build a modern smartphone) I don't know that the formula would be able to work for Apple in the long run (Apple needs high margins to pay for OS, software and silicon development, all of which are internalized by Apple and none of which burden most of its competitors).

Good cross platform benchmarks still don't really exist on smartphones these days. We're left describing experience with words and trying to quantify performance differences using web based benchmarks, neither of which is ideal but both of which will have to do for now. The iPhone 5 experience compared to the 4S is best explained as just being snappier. Apps launch faster, scrolling around iOS Maps is smoother, web pages take less time to load and the occasional CPU/ISP bound task (e.g. HDR image processing) is significantly quicker. If you're the type of person who appreciates improvements in response time, the iPhone 5 delivers.

How does it compare to the current crop of high-end Android smartphones? I would say that the 5 generally brings CPU performance up to par with the latest and greatest in the Android camp, and in some cases surprasses them slightly. It's difficult making cross platform comparisons because of huge differences in the OSes as well as separating out tasks that are CPU bound from those that simply benefit from a higher rendered frame rate.

I took a cross section of various web based benchmarks and looked at their performance to help quantify where the iPhone 5 stands in the world. First up are the RIABench focus tests, these are javascript benchmarks that focus on various compute bound tasks. I used Chrome for all Android devices to put their best foot forward.

RIABench Focus-tests

This first test shows just how slow the 800MHz Cortex A9s in the iPhone 4S were compared to the latest and greatest from Qualcomm and NVIDIA. At roughly half the clock speed of those competitors, the 4S was just much slower at compute bound tasks. Apple was able to mask as much of that as possible with smooth UI rendering performance, but there was obviously room for improvement. The iPhone 5 delivers just that. It modernizes the iPhone's performance and inches ahead of the Tegra 3/Snapdragon S4 platforms. Only Intel's Atom Z2460 in the Motorola RAZR i is able to outperform it.

Next up is Kraken, a seriously heavy javascript benchmark built by Mozilla. Kraken focuses on forward looking applications that are potentially too slow to run in modern browsers today. The result is much longer run times than anything we've seen thus far, and a very CPU heavy benchmark:

Mozilla Kraken Benchmark

The standings don't change much here. The iPhone 4S is left in the dust by the iPhone 5, which steps ahead of the latest NVIDIA/Qualcomm based Android devices. The Apple advantage here is just over 10%. Once again, Intel's Atom Z2460 pulls ahead with the clear lead.

In our iPhone 5 Performance Preview we looked at Google's V8 javascript test as an alternative to SunSpider. The more data points the merrier:

Google V8 Benchmark - Version 7

Here the iPhone 5 manages to hold onto its second place position, but just barely. Once more, the Atom based RAZR i maintains the performance lead.

Google's Octane benchmark includes all 8 of the V8 tests but adds 5 new ones including a PDF reader, 3D bullet physics engine and portable 3D game console emulator all built in javascript.

Google Octane Benchmark v1

The 5 pulls ahead of the HTC One X here and maintains a healthy 31% lead, but once again falls short of the RAZR i.

We of course included our SunSpider and BrowserMark tests, both of which show the iPhone 5 very favorably:

SunSpider Javascript Benchmark 0.9.1 - Stock Browser

BrowserMark

Performance obviously depends on workload, but it's clear the iPhone 5 is a big step forward from the 4S and tends to outperform the latest ARM based Android smartphones. As the rest of the ARM based SoC players move to Cortex A15 designs they should be able to deliver faster devices in the first half of 2013.

Intel's current position when it comes to CPU performance is interesting. A move to a dual-core design could be enough to remain performance competitive with 2013 ARM based SoCs. Remembering that Atom is a 5 year old CPU core that performs at the level of a 10 year old mainstream notebook CPU puts all of this progress in perspective. Intel's biggest issue going forward (other than getting Atom into more tier 1 phone designs) is going to be improving GPU performance. Luckily it seems as if it has the roadmap to do just that with the Atom Z2580.

Six Generations of iPhones: Performance Compared GPU Analysis/Performance
POST A COMMENT

278 Comments

View All Comments

  • medi01 - Wednesday, October 17, 2012 - link

    1) Compare ipad2's gamut, cough
    2) Check values on toms
    http://media.bestofmicro.com/3/4/331888/original/g...
    http://www.tomshardware.com/reviews/ipad-3-benchma...

    Unlike anand, toms was beyond primitive contrast/brightness benchmarking for quite a while.
    Reply
  • thunng8 - Thursday, October 18, 2012 - link

    Not sure if I should trust Tom's figures compared to Anands's.

    In any case, both show the ipad3 has higher gamut, especially in sRGB.
    Reply
  • steven75 - Wednesday, October 17, 2012 - link

    I think what you meant to say is that AMOLEDs win on black levels and that's about it. LCDs still win in accuracy and most importantly ability to see them in outdoor settings. Reply
  • KoolAidMan1 - Tuesday, October 16, 2012 - link

    Not even close. Even the better Android displays like the Galaxy S3 has a PenTile display. Despite having more "pixels" it actually has fewer subpixels than the iPhone does. Unless you have bad eyesight the S3 display looks really bad in comparison, and this is before we get to even worse smartphone displays out there by HTC, etc. Reply
  • Sufo - Tuesday, October 16, 2012 - link

    Old pentile displays were visibly jaggy on vertical lines - even my old lumia 800 exhibited this to some extent. On the GS3 tho, it is not noticeable and it has nothing to do with eyesight.

    Your comment makes it sound (to someone who has seen many different smartphone displays in person) as though you haven't spent much time with the GS3 (read: many smartphones) at all. Simply mentioning that is uses pentile subpix config, from you, sounds like regurgitated information. Not only that, but you seem to gloss over the many benefits that amoled panels bring. It's arguable that these benefits are more important than an accurate colourspace on (specifically) a mobile phone - although it is ofc entirely subjective.

    This brings me to the last tell of ignorance I noted; your mention of HTC. Have you used a One X? For those who do not like amoled panels, the display on the one x is perhaps nicer than both the gs3 and the ip5. Ofc you may say Android is not your cup of tea, and that's a perfectly justifiable stance, however it has nothing to do with display tech.

    tl;dr You sound like you don't know what you're talking about
    Reply
  • KoolAidMan1 - Tuesday, October 16, 2012 - link

    I do know what I'm talking about given that I've seen many smartphones, and I've calibrated my share of desktop displays to sRGB.

    Differences in display tech aside, Android phones have never gotten color profiles right, EVER. They're almost always oversaturated, have too much contrast, and are inaccurate. Anand even posted a difference in color accuracy between several devices, and the profile for the S3 is totally what I expected.

    The S3 really doesn't look good, period, but then again there are people who argue that TN panels are just fine against IPS. I'm used to hearing nonsense on forums when it comes to display from people who don't know what to look for.
    Reply
  • KoolAidMan1 - Tuesday, October 16, 2012 - link

    BTW, apologies if that came out harsh, but the difference in color and contrast accuracy between something like the S3 and a properly calibrated device is a night and day difference to me. I'm pretty sensitive to display quality though; my main desktop display at home is still an NEC and my plasma is a Pioneer Elite (RIP) Reply
  • rocketbuddha - Tuesday, October 16, 2012 - link

    For Android you have the following 720p HD Displays

    SLCD - HTC Rezound (2011 tech)
    SLCD 2 - HTC One X, Sony HD
    HD SAMOLED Pentile - GS3, Galaxy Nexus, Moto Razr HD
    HD SAMOLED RGB - Galaxy Note II
    True IPS LCD - LG Optimus 4X, Optimus G
    Super IPS LCD -Asus Padphone, Sharp phones etc

    So you have big set of choices. If dark contrasts are important then SAMOLED is the way to go. SAMOLED RGB over SAMOLED Pentile.
    If overall color and whites are important go with SLCD2.
    IPS LCDs are the closest to the Retina Display and u have a choices there too. You can pick and choose what is good for you and have alternatives.
    Reply
  • Spunjji - Thursday, October 18, 2012 - link

    The HTC One X has what is hailed to be one of the best LCD smartphone displays out there. Your claim is invalid.

    Similarly, the Galaxy Note 2 has an AMOLED display without PenTile. Sure, it's lower density, but one does not hold a 5.5" screen so close to one's face.
    Reply
  • medi01 - Wednesday, October 17, 2012 - link

    ""The iPhone 5 display is better than any current Android display.""
    Why don't you go hit your dumb head with something heavy, ipad would do?
    Reply

Log in

Don't have an account? Sign up now