The CPU and its Performance

I keep mentioning that the iPhone 3GS is faster than its predecessor, but these numbers speak louder than anything I can write:

Application Launch Time Apple iPhone 3G (3.0) Apple iPhone 3GS (3.0)
Star Defense 54.4 s 22.9 s
Sims 3 28.0 s 9.5 s
Resident Evil 32.0 s 22.5 s
Messaging App 4.66 s 1.97 s
Mail App 2.31 s 0.85 s
Search for "Man" 4.0 s 1.91 s
App Store 7.2 s 3.7 s
Power On Test 39.7 s 25.0 s
iPhone 3GS Advantage over iPhone 3G   95%

 

This is a generational improvement in performance folks. The new 3GS is, at worst, only 42% faster than the iPhone 3G. At best? Nearly 200% faster. Apple was right to abandon the aging ARM11 core used in the iPhone 3G in favor of the Cortex A8 in the 3GS. I also wonder if any of these performance gains are helped by using faster NAND flash in the 3GS. It wouldn't be enough to account for all of the performance boost, but perhaps 5 - 10%.

WiFi and 3G web page rendering speed is also a lot faster on the 3GS:

3G Apple iPhone (3.0) Apple iPhone 3G (3.0) Apple iPhone 3GS (3.0) Palm Pre (1.03)
anandtech.com 41.0 s 24.2 s 14.0 s 17.0 s
arstechnica.com 34.4 s 18.2 s 9.6 s 13.5 s
hothardware.com 84.3 s 58.3 s 19.8 s 23.0 s
pcper.com 67.1 s 35.1 s 18.5 s 22.1 s
digg.com 75.2 s 47.2 s 19.9 s 24.9 s
techreport.com 44.5 s 25.2 s 13.6 s 12.5 s
tomshardware.com 75.7 s 28.8 s 22.2 s 25.2 s
facebook.com 103.4 s 46.3 s 15.4 s 26.8 s

 

I re-ran all of my web browsing performance tests on all of the phones to provide the most accurate comparison. I ran the Palm Pre data before the 1.04 OS release came out but apparently that update didn't improve browsing performance so I wouldn't expect much difference there.

The 3GS makes everything faster, including web browsing over the 3G network. Just to be clear, I used the full site versions of all of these web pages - I did not use any mobile or iPhone optimized sites in the timing. I tried to perform all of the tests at the same time to eliminate any network strangeness. Each test was performed three times and I reported the average.

The 3GS is nearly 300% faster than the original iPhone in browsing over the cellular network. Here the 3GS looks to be around 114% faster than the iPhone 3G - definitely worth the upgrade if you do a lot of browsing on your phone. The iPhone 3GS ended up 24% faster than the Palm Pre, but I suspect that most of that is due to performance differences between Sprint and AT&T at my house.

It is important to realize what we're talking about here. These phones, particularly ones that are using old ARM11 based SoCs, are CPU bound while loading web pages. Even while browsing over a relatively slow < 1Mbps cellular network, the CPU still ends up being a significant bottleneck to web page rendering performance. Compare that to how things work on the desktop - when was the last time you felt your PC was too slow to browse the web? The Cortex A8 is a huge step forward here, and once again, there's no excuse for putting any ARM11 in a high end smartphone today.

Let's remove more bottlenecks and see how big of a difference the CPU alone makes, the following tests were performed over WiFi:

WiFi Apple iPhone 3G (3.0) Apple iPhone 3GS (3.0) Palm Pre (1.03)
anandtech.com 13.3 s 8.8 s 10.1 s
arstechnica.com 12.8 s 8.2 s 8.2 s
hothardware.com 35.8 s 15.1 s 11.6 s
pcper.com 27.8 s 17.3 s 21.3 s
digg.com 36.1 s 17.5 s 16.3 s
techreport.com 17.1 s 11.6 s 7.8 s
tomshardware.com 21.7 s 12.2 s 12.4 s
facebook.com 29.3 s 10.5 s 22.1 s

 

Remove the cellular bottleneck and things mostly stay the same between iPhones. The new 3GS is nearly 100% faster than the old 3G (and iPhone original). The major change comes from the comparison to the Palm Pre. The 3GS is now only 8% faster than the Pre, a significant improvement from the earlier releases of webOS. I do firmly believe that Palm has much room to improve performance on its device to bring it up to speed compared to the 3GS. It's running very similar hardware to the iPhone 3GS, there's no reason for it to feel so much slower.

Let me take this opportunity to also chastise HTC for using the Qualcomm MSM7200A in the new Hero smartphone. Here we have yet another Android OS phone using a horrendously old ARM11 based CPU, it’s just unacceptable. The table above shows you how much more performance is on the table if you move to Cortex A8. I’m still waiting for a handset maker to do Android justice and pair it with a truly robust hardware platform.

More Detail on ARM11 vs. Cortex A8 The GPU and its Performance
Comments Locked

60 Comments

View All Comments

  • MrJim - Wednesday, July 8, 2009 - link

    Why no mention of the heat issues?
  • ViRGE - Wednesday, July 8, 2009 - link

    Anand, if you haven't already, jailbreak the 3GS and grab SysInfoPlus from Cydia. It may be able to tell you the clock speed of the 3GS's ARM, although to what extent I'm not sure since it hasn't been specifically programmed for the A8.
  • ltcommanderdata - Wednesday, July 8, 2009 - link

    I don't suppose that program can also tell the GPU clock speed too?

    I always thought that the MBX work at bus speed, ie. 103MHz for the iPhone/3G and 133MHz for the 2nd Gen iPod Touch instead of the 60Mhz that Anand has speculated. Assuming the iPhone 3G S has a 150MHz bus speed, the SGX could run at 150MHz which is a reasonable compromise between Anand's 100MHz and 200MHz estimates.
  • fyleow - Wednesday, July 8, 2009 - link

    How useful is the new GPU? The iPhone's performance has come a long way from the first generation but I don't see developers taking full advantage of the jump. If you bump up the graphics of your game it might run smoothly on the 3GS but end up lagging on the 1st gen iPhone.

    The increase in load times and battery life is much welcomed, but when do we get to see some apps that take advantage of the upgraded hardware in other more interesting ways? I can see a resolution increase as being one way to do that. The game would look better on a higher resolution screen but performance wouldn't suffer on the older models because the lower resolution would place less demand on the hardware.

    2010 will be an interesting year. There should be a bigger upgrade to the iPhone, most likely a resolution bump and a significantly modified OS that supports background tasks. Apple has been keeping all the devices on the iPhone platform on feature parity so far with the OS upgrades (minus obvious limitations due to hardware differences). It would be interesting to see how they handle the switch and the resulting two classes of phones that come from it (i.e. old "legacy" iPhones/Touch vs new iPhones/Touch).
  • ltcommanderdata - Wednesday, July 8, 2009 - link

    You're right that it's difficult to take full advantage of the SGX without writing a separate dedicated code path for it and one for the MBX. However, there are simpler ways to take advantage of the iPhone 3G S power without writing 2 separate code paths. For example, you can scale draw distance based on hardware. Firemint demonstrated the iPhone 3G S accelerating 40 cars in Real Racing compared to 6 in the iPhone 3G, so the potential for better scalable AI is there. For a RPG, perhaps having more NPCs walking around to make the environment more lifelike. This can all be done using existing OpenGL ES 1.1 code playable on all iPhones/Touches, optimizing for each device, without making older iPhone users feel like they are playing some Lite version of the game as implementing shaders and HDR using OpenGL ES 2.0 in the iPhone 3G S might do.

    I believe the reluctance of Apple to change the resolution is that it could break the interface layout for existing apps and/or make things ugly if apps haven't used vector graphics. It would have been nice if they had enforced resolution independence early on, but I don't believe they did. Resolution independence is also what is needed for Apple to introduce an iPhone nano with a smaller screen and presumably smaller resolution.
  • smallpot - Wednesday, July 8, 2009 - link

    Thanks for the article Anand. Your long-form articles are the reason Anandtech is my number one tech website. I'm thinking of articles such as this, your articles on SSD performance, and the long-form story behind the RV770. After reading such articles, I really feel like I've learned something, rather than just had performance metrics thrown at me without context.
  • Baron Fel - Tuesday, July 7, 2009 - link

    Interesting article.

    As far as portable gaming goes, the Ipod Touch/iPhone/Zune HD dont have a chance against the DS or even the PSP. The software support just isnt there.

    PSP hardware runs circles around the DS, so why is the DS killing it in sales? Good games.

    and are we getting more SSD articles anytime soon? I think thats what we want to see :D
  • ltcommanderdata - Tuesday, July 7, 2009 - link

    Given all the media attention about discoloration and possible heat issues with the iPhone 3G S, I was wondering if you could comment on your experience in this area. Do you think it's a real concern or just stories popularized to generate page hits as Apple related stories tend to do? The latest reports on discoloration indicate that it might actually be from a reaction with some third-party cases that may be reversed by cleaning with alcohol.

    Similarly, there have been lower-key reports of build quality issues with the Palm Pre having a wobbly screen from it's slide-out keyboard. Has this been a major issue for you and do you think it'll be an issue over time?
  • Anand Lal Shimpi - Tuesday, July 7, 2009 - link

    I haven't seen anything to indicate heat as being a bigger concern with the 3GS. It's a new processor so there's bound to be some bad chips out there, but I wouldn't be too concerned.

    The build quality on the Pre did bother me. It's something that I think bothered me more because of my experience with the iPhone. The screen was a bit wobbly and overall the device just didn't feel as well put together. Part of it is because of the slide out keyboard, but part of it has to be cost/experience related. I think you'd get used to it over time, but if you then held an iPhone you'd quickly grow tired of the build quality issues once again :)

    Take care,
    Anand
  • tomoyo - Tuesday, July 7, 2009 - link

    Btw Anand, the chart for number of stages in the cpus shows the Iphone 3GS as 8 stage instead of 13.

Log in

Don't have an account? Sign up now