Improved ISP in A5

So we’ve been over the optical system and the sensor, but there’s another factor as well - image signal processing (ISP). It surprised me to see Apple bring this up on stage, but it’s a hugely important point to make, that the quality of images captured on a given platform depends on everything in the image processing chain. The A5 SoC includes an improved ISP over what was in the A4, and is referred to as the H4. You can watch the OS power gate the ISP and activate it when you launch the camera on console as well:

Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::ISP_LoadFirmware_gated: fw len=1171480 Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::ISP_LoadFirmware_gated - firmware checksum: 0x0545E78A Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::power_on_hardware

The changes include faster processing to accommodate an 8 MP sensor, and vastly improved white balance (which we will show later), and finally some face detection algorithms that work in conjunction with autofocus and autoexposure. I’ve also noticed that the A5’s ISP seems to have improved AF speed (it’s hard to measure, but it just seems much faster) and more importantly the framerate of the capture preview is much higher. I’ve included a small video showing just how much smoother the 4S looks than the 4, even on my 1080p60 camera (which YouTube then reduces to 30fps) the difference is noticeable.

When the ISP detects a face, it’ll paint a green rectangle over the region and run the AF/AE routine just like it would if you tapped to focus. Like all face detection algorithms, it’s decent but not perfect, and I saw the face detection rectangle come up while shooting pictures of pumpkins at a pumpkin patch (which was fairly repeatable on one pumpkin), and a few other random occasions. Apple claims their ISP will run face detection on up to 10 faces and balance AF/AE accordingly for the best exposure.

I mentioned that the camera application preview framerate is improved - which it is - but the camera application is also speedier. Word on the street is that camera application launch time was a significant focus for the 4S, and I set out to measure the difference over the predecessors cameras. Camera launch time is one thing that was singled out during the presentation, but another that can be measured is HDR processing time. I quit all tasks and launched the camera application fresh five times (from tapping camera to seeing the iris fully open), then averaged.

Camera Performance Comparison
Property iPhone 3GS iPhone 4 iPhone 4S
Camera Launch Time (seconds) 2.8 2.3 1.4
HDR Capture Time (seconds) - 4.9 3.2
Working Distance (cm) ~7.0 7.0 6.5

The result on the 4S is a bit behind Apple’s quoted 1.1 seconds, though it’s possible they were measuring after an initial launch, whereas I’m starting with the camera completely closed each time. Still, 0.3 seconds isn’t that far away from their own measurements. The 4S is almost an entire second faster at launching the camera app than the 4, and 1.5x faster at merging three images to HDR than the 4. I also decided to get a rough measure of working distance on the three cameras, or the closest an object can be to the camera and still be focused on.

Camera Improvements Still Image Capture Quality
Comments Locked

199 Comments

View All Comments

  • bak0n - Monday, October 31, 2011 - link

    It gives my Android something to look up with the Iphone locks up for no apparent reason.
  • cokain - Monday, October 31, 2011 - link

    ...can you find objective reviews. Quality > quantity.
  • Guspaz - Tuesday, November 1, 2011 - link

    I've actually found Siri to be a time saver for sending text messages too. I've not used it much in crowded environments, but when I'm alone or in a car, it's must faster to say "Tell Andrew I've just left and should be there in about half an hour" than it is to unlock the phone, scroll to the messages app, launch the app, find the right contact, and then type the message. Siri lets me skip a lot of the setup there, activating while locked and using "Tell Andrew" to skip a bunch of the steps.
  • deeselcyde - Tuesday, November 1, 2011 - link

    Our company just upgraded our 3gs' to the 4s this past week and my phone (through Verizon) rarely gets a 3g signal while everyone else does, heats up to an ungodly temperature, and the battery lasts about 4 hours. Took it in to a "genius" and they said the antenna was screwed up. My replacement should be here tomorrow. I'm hoping it's all good. I'm sure it will be.
  • solipsism - Tuesday, November 1, 2011 - link

    Any local voice control or all sent server-side for processing?

    In other words, when wanted to call a contact or play an artists on the iPhone 4 Voice Control figured it out on the device. Does Siri determine what needs to be to sent to Apple?
  • solipsism - Tuesday, November 1, 2011 - link

    ArsTechnica analyses the data sizes used for Siri. Bottom line: It shouldn't affect most users limited data plans.

    » http://arstechnica.com/apple/news/2011/11/how-data...
  • indianidle - Tuesday, November 1, 2011 - link

    As a Computer Science grad student, I love the way you guys methodically analyze all the tiny bits that make up a smartphone. As a new iPhone 4S user (just got it last week), I can see why it's so great! Thanks for the review again!

    Cheers!
  • shashank7040 - Tuesday, November 1, 2011 - link

    and very nice info.
  • shashank7040 - Tuesday, November 1, 2011 - link

    Nokia Bendable Phones...........http://goo.gl/NhHKX
  • SunLord - Tuesday, November 1, 2011 - link

    Does anyone know if the 4s supports EVDO rev b? Since sprint will be rolling it out next year as part of it's network upgrade?

Log in

Don't have an account? Sign up now