Improved ISP in A5

So we’ve been over the optical system and the sensor, but there’s another factor as well - image signal processing (ISP). It surprised me to see Apple bring this up on stage, but it’s a hugely important point to make, that the quality of images captured on a given platform depends on everything in the image processing chain. The A5 SoC includes an improved ISP over what was in the A4, and is referred to as the H4. You can watch the OS power gate the ISP and activate it when you launch the camera on console as well:

Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::ISP_LoadFirmware_gated: fw len=1171480 Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::ISP_LoadFirmware_gated - firmware checksum: 0x0545E78A Oct 18 16:35:02 unknown kernel[0] : AppleH4CamIn::power_on_hardware

The changes include faster processing to accommodate an 8 MP sensor, and vastly improved white balance (which we will show later), and finally some face detection algorithms that work in conjunction with autofocus and autoexposure. I’ve also noticed that the A5’s ISP seems to have improved AF speed (it’s hard to measure, but it just seems much faster) and more importantly the framerate of the capture preview is much higher. I’ve included a small video showing just how much smoother the 4S looks than the 4, even on my 1080p60 camera (which YouTube then reduces to 30fps) the difference is noticeable.

When the ISP detects a face, it’ll paint a green rectangle over the region and run the AF/AE routine just like it would if you tapped to focus. Like all face detection algorithms, it’s decent but not perfect, and I saw the face detection rectangle come up while shooting pictures of pumpkins at a pumpkin patch (which was fairly repeatable on one pumpkin), and a few other random occasions. Apple claims their ISP will run face detection on up to 10 faces and balance AF/AE accordingly for the best exposure.

I mentioned that the camera application preview framerate is improved - which it is - but the camera application is also speedier. Word on the street is that camera application launch time was a significant focus for the 4S, and I set out to measure the difference over the predecessors cameras. Camera launch time is one thing that was singled out during the presentation, but another that can be measured is HDR processing time. I quit all tasks and launched the camera application fresh five times (from tapping camera to seeing the iris fully open), then averaged.

Camera Performance Comparison
Property iPhone 3GS iPhone 4 iPhone 4S
Camera Launch Time (seconds) 2.8 2.3 1.4
HDR Capture Time (seconds) - 4.9 3.2
Working Distance (cm) ~7.0 7.0 6.5

The result on the 4S is a bit behind Apple’s quoted 1.1 seconds, though it’s possible they were measuring after an initial launch, whereas I’m starting with the camera completely closed each time. Still, 0.3 seconds isn’t that far away from their own measurements. The 4S is almost an entire second faster at launching the camera app than the 4, and 1.5x faster at merging three images to HDR than the 4. I also decided to get a rough measure of working distance on the three cameras, or the closest an object can be to the camera and still be focused on.

Camera Improvements Still Image Capture Quality
POST A COMMENT

201 Comments

View All Comments

  • tipoo - Monday, October 31, 2011 - link

    Anyone know if there is a reason this hasn't made it into any Andriod phone yet? Does Google specify compatible GPU's, or is it cost, or development time, etc? Looks like it slaughters even the Mali 400 which is probably the next fastest. Reply
  • zorxd - Monday, October 31, 2011 - link

    The only reason is that no one used it yet. The TI OMAP 4470 will use the 544 which is probably a little faster.
    The SGS2 is using the slower Mali 400, however it was released 6 months ago. Yet it's not that bad, even beating the 4S in Glbenchmark pro.
    Reply
  • zorxd - Monday, October 31, 2011 - link

    I meant no SoC vendor is using it. Reply
  • djboxbaba - Monday, October 31, 2011 - link

    The numbers were incorrect and have been updated, the 4S is ~2x faster than the GS2 on the GLBenchmark Pro. Reply
  • freezer - Thursday, November 03, 2011 - link

    But not when running at phone's native resolution. Thats what people will use while running games on their phone.

    iPhone 4S has much more pixels for GPU to draw while having much smaller screen. Not very optimal for gaming right?

    http://glbenchmark.com/result.jsp?benchmark=glpro2...
    Reply
  • djboxbaba - Thursday, November 03, 2011 - link

    Correct, but we're comparing the GPU's by standardizing the resolution. Of course in the native resolution this will change. Reply
  • thunng8 - Monday, October 31, 2011 - link

    I don't see any GL benchmark that the Mail 400 beats the 4S??? Reply
  • freezer - Thursday, November 03, 2011 - link

    That's because Anandtech review shows only the 720p offscreen results.

    This gives very different numbers compared to running GL Benchmark Pro in phone's native resolution.

    iPhone 4S has about 60% more pixels than Galaxy S2, and so its GPU has to draw much more pixels in every frame.

    Go to glbenchmark.com and dig database yourself.
    Reply
  • Ryan Smith - Monday, October 31, 2011 - link

    The 544 should be identical to the 543 at the same clock and core configuration. It's effectively a 543 variant with full D3D feature level 9_3 support. The primary purpose of the 544 will be to build Windows devices, whereas for non-Windows devices the 543 would suffice. We don't have access to PowerVR's pricing, but it likely costs more due to the need to license additional technologies (e.g. DXTC) to achieve full 9_3 support. Reply
  • Penti - Tuesday, November 01, 2011 - link

    Who will use it to support Windows Phone though? Qualcomm uses their own AMD/ATi based Adreno GPU. I guess it will be TI's attempt off getting Microsoft to support Windows Phone on their SoC in order to supply say partners of theirs like Nokia. Or might just be a later purchase/contract date for the other SoC vendors. Getting the IP-blocks later, but many did opt for the Mali-400 so why wouldn't they opt for the successor too? It seems to have worked out good. Samsung is just one of the vendors that usually did use PowerVR. I guess ST-E will use it in order to support Windows Phone on Nova A9540 SoC too. While Android vendors might opt for the older A9500 still.

    Interesting to see how Nvidia do lag in this field though.
    Reply

Log in

Don't have an account? Sign up now