Apple iPhone 4S: Thoroughly Reviewed
by Anand Lal Shimpi & Brian Klug on October 31, 2011 7:45 PM EST- Posted in
- Smartphones
- Apple
- Mobile
- iPhone
- iPhone 4S
Camera Quality
So we’ve gone over the details of improvements on the sensor, optical system, and finally ISP, and now the question is what this translates to in terms of actual image quality. To get to the bottom of this, we’ve turned to our usual smartphone camera bench locations and taken photos with the iPhone 4S at those locales. In addition I’ve taken photos with the 4S in our light box test with the lights on and off.
Anand mentioned that the smartphone battery life test needs some tweaking, the same also applies to the smartphone camera bench. To that end, we’re doing a few new things here in addition to the same old stuff. I recently started taking video samples side by side with the device under test alongside another reference camera - we’re going to start doing that more for stills now as well, and I’ve done this with the 4S alongside the 4 and an SGS2. I’ve always felt that our photo tests could be a lot more rigorous, and we will be coming up with some much more objective tests, but for now I have a preview with three new controlled tests. These sample photos are taken in another smartphone camera mount on a tripod 1.5 feet away from a test target. If we were being really scientific we’d be using an optical track and such, this is just a tripod with the phone on top some distance away. The goal is to have some objective testing, some subjective/qualitative testing.
The first is a distortion grid which is pretty straightforward. We’re all familiar with distortion, which is a strongly field dependent magnification error. Put another way, rays at different field angles get different magnifications, and the result is either barrel or pincushion. It’s actually easy to qualitate how much distortion there is present based on a sample like this, which we’ll do in the future. In addition, it’s also possible to correct out distortion computationally.
The 4S subjectively has much less distortion than the 4, though both appear to have some barrel going on. Interestingly enough you can immediately tell that the 4S and 4 have close to the same field of view, with the 4S being just a tad wider. The SGS2’s wide field of view becomes readily apparent as well in the fourth image, and it suffers from a non-negligible amount of barrel distortion. I tossed in the other android handsets I have on hand as well as the 3GS to show how far things have come.
Another noteworthy thing is that the 4S minimizes but doesn’t entirely eliminate the colored spot in the center. The 4 had an incredibly distinctive green spot in the center that was so notable you could spot images online and instantly tell they came from an iPhone 4. You can see a magenta circle in the 4’s sample, but it’s a bit harder to detect on the 4S image. It’s an aberration that crops up whenever you’re not looking for it, but seems to elude me when I try and track it down. Oddly enough I managed to find it in my carpet, where the 4S has no such green circle, but the 4 does. We talked earlier about the improved IR filter possibly mitigating this issue, and that does seem to be the case somewhat.
iPhone 4S | iPhone 4 |
Apple spent a lot of time in the keynote discussing their auto white balance functionality in the H4 ISP - the question is how well does it stack up? Onward on to our next test, which is a GMB/Xrite color checker classic card and the Kodak color control patches. I took a reference image with my D300s and configured white balance manually using an 18% grey card for comparison purposes, and then samples with the same phones again.
It’s interesting that the iPhone images have been getting less saturated with each generation. The 4 image looks absurdly oversaturated and almost cartoonish compared to either the reference, the 4S, or the SGS2. I’d say that the SGS2 and 4S are pretty much tied here and look close to but not exactly in line with the reference. Going down the line you can see some of the other vendors have a long ways to go with their own white balance.
The third new test for right now is an industry standard ISO 12233 chart test. I see a lot of people taking pictures of this, but then offer little interpretation of the results. There are a bunch of different components in this chart - the thick 30 degree lines are for use with very popular slant MTF analysis algorithms, there are some patterns for distortion computation, and finally line pairs with ever increasing spatial frequency. Analyzing these requires looking at the full size samples, then finding the point at which the contrast between line pairs goes to zero - essentially, the point where you can’t visually distinguish the pattern from irresolvable grey - in both vertical and horizontal. The numbers on the chart simply correspond to hundreds of line widths per picture height.
The gallery images of the full size charts are good but to really make conclusions you need to look at size crops of those tangential and saggital frequency regions. These are all taken with the same illumination, unfortunately the huge differences in white balance between cameras are just a reflection on how far the industry needs to go.
The difference between the frequency response of the 4S and the 4 is pretty huge. The disclaimer before you run into all of this data and start analyzing is that choosing the cutoff frequency is something of a science in and of itself (especially because there’s a contrast reversal that tricks people up), plus unfortunately all smartphone cameras export lossy compressed images (JPEGs) and not raw data, and there’s all kinds of sharpening and processing routines at play here. That said, I’d put the 4S cutoff in tangential around 17, and the 4 at 13. I threw the 3GS in as well to show how far things have come in such a short period - that camera barely makes it to 10. The results from the SGS2 put it around 15 or 16, though that camera is doing visible sharpening as evidenced by halos at the edge and an interesting spatial frequency response plot. If you look at contrast between 14 and 16 you can see the 4S narrowly edge out the SGS2 without any sharpening.
iPhone 4S | iPhone 4 | Galaxy S 2 |
I tossed in images from HDR mode from the 4S and 4 as well. These are made from computationally recombining three differently exposed images stored in a buffer. When you tap the capture button, those last three images get recombined into an image with more dynamic range. Interestingly enough, Apple does some sharpening in HDR Mode - again you can see halos and a big uptick on an SFR plot, but it isn’t subjectively that bad, and we can distinguish lines up to arguably between 17 and 18. In the saggital direction, we can see lines down to about 17.5 on the 4S, 13 on the 4, and around 16 on the SGS2. It’s hard to pick cutoffs when sharpening and nose reduction messes with the image, but clearly the 4S performance is very good. If you want to compare yourself, the original images cropped to tangential and saggital frequency areas is here (2 MB) and the full size charts images are here (19 MB).
Now for the subjective side by sides, which were taken in a bracket holding two smartphones at a time some distance apart horizontally. It’s impossible to take the same exact photo from the same place in space and time, but we’ve done our best to offer a comparison with only a small amount of horizontal shift.
iPhone 4S | iPhone 4 |
The first 14 test images compare the iPhone 4 to the 4S and are at our test locations downtown, and from a few new angles. Then images 15–19 compare the 4 and 4S HDR performance, followed by 20–24 and 31 which compare the 4 and 4S in low light conditions. Last, 25–30 compare the 4S with the SGS2 which a lot of people have asked for.
The test charts we’ve shown so far tell the story, but seeing real world images makes the difference immediate. The 4S has vastly improved dynamic range over the 4 - you can see many more details in shadows and highlights, thanks in part to increased well depth between the two sensors. The difference between the 4 and 4S white balance is immediately visible as well in sample 4 where the 4S looks more like the actual bridge, and in 7 of a fountain.
In low light tests, the difference is even more dramatic and visible. The neon lit grill sign in 21 on the 4 is something of a blurry mess, while you can actually see the individual tubes in the 4S sample. I also shot a low light test in our light test box, number 31 where you can see a huge difference in noise between the 4S and 4.
The comparison with SGS2 is a little harder to make visually given the difference in field of view between the two. Aligning the two cameras also proved a challenge again thanks to this big difference in field of view, but you can see the effects of Samsung’s sharpening when you look for it. Subjectively, however, the two are quite close.
iPhone 4S | iPhone 4 | Galaxy S 2 |
I’ve also included the 4S images in our usual lightbox gallery with and without flash, and the normal smartphone camera bench.
I mentioned earlier that I intentionally avoided using the LED flash on the 4, and the same continues with the 4S. If you’re under 2 feet away from the subject, the tiny little fresnel lens on top of the LED flash continues to not be good enough at spreading light around evenly. There’s also a nice bleeding effect that happens on the white model that doesn’t affect the image but just casts a huge weird light pattern on the wall from light bouncing around inside the glass plate. In addition, Apple still doesn’t illuminate the scene when focusing in the dark, so often you’ll entirely miss focus if it’s too dark.
With the lights on inside the box you can see how much better the 4S’ white balance is than the 4, which has an almost red colored background in this test. Oversaturation is also gone, thankfully. I also tossed in images from HDR mode with the lights on. I haven’t touched on it as much but the 4S also shows a big improvement in brightness uniformity with essentially no unwanted vignetting.
The front facing camera on the 4S is unchanged from the 4 (still just VGA), however this offers an interesting opportunity to compare that ISP-enhanced whitebalance. If you look at the sample from the 4S and compare to the 4, the difference is pretty shocking.
To conclude the still image analysis section, we can safely say that Apple has gotten serious about image quality with the 4S. Before the iPhone 4, the iPhone camera largely felt like a commodity cameraphone solution tacked onto otherwise great hardware. With complete control over almost the entire imaging chain on the 4S - custom optics, ISP, and software - we’re starting to see some of Apple’s vertically controlled influence spill over into this arena as well. Nokia has built an incredible reputation for itself by using glass optics and building phones around high performance cameras (like the N8 which is still in a different category entirely), and for the first time we’re starting to see Apple venture into that category as well.
199 Comments
View All Comments
medi01 - Thursday, November 3, 2011 - link
Find contrast of BEAUTIFUL Galaxy phones on the charts pretty please...doobydoo - Friday, December 2, 2011 - link
Yeah the 'beautiful' screens...The Galaxy screen is what, 480 x 800? on a 4.27 inch screen?
The iPhone 4s is 640 x 960 - on a 3.5 inch screen.
A much higher resolution.
Brian Klug - Sunday, November 6, 2011 - link
"1) Ridiculous BS sentences about "improved vibration" that obviously come straight out of Apple's marketing mouth"I'm sorry you feel that way, but the vibration unit is indeed different, and lends a completely different feel from every other device out there which just uses a spinning counterweight.
I'd encourage you to try it on your own.
-Brian
Samus - Tuesday, November 1, 2011 - link
Great review, thanks Anand! If I weren't so stubborn I'd get an iPhone (because they really are great phones) but I just can't do the Apple thing. I like the openness, tweakability and choices provided by Android phones, but for the general population, the iPhone is pretty much the best option for the high-end market.zanon - Monday, October 31, 2011 - link
Hoorah, the definitive review is here at last! Thanks as always for your hard work on this.And yeah, the 543MP2 is a sick monster of a chip. Imagination Technologies really hit a home run with this one, simply amazing performance. Not just Apple either, I believe the Vita is using the MP4 version of this chip. With the show they've put on this time, I'm very much looking forward to seeing what they do for the Series 6 Rogue ones that I think are still due next year. Or for that matter even if they do an update/shrink of these ones.
Great to see so much competition between graphics in the mobile world, practically every major player has a foot in the water at least. I think this stuff will start to matter more and more too for items beyond games. Applications like further advances in augmented reality seem like they could use plenty of power, and are uniquely suited to mobile platforms. Things will get really nuts when retinal projection displays or some equivalent finally start filtering down into the main market.
Lucian Armasu - Tuesday, November 1, 2011 - link
It's not really about the architecture, though, but about the size of the GPU = more performance. It's 2x the size and has 1.5-2x the performance of Exynos' GPU. Not that surprising.I'm not entirely sure why they had to use such a powerful GPU, though. Is it to make it easier to support higher resolutions? Because it can't be about the games. Why would it get 7x the performance of the previous iPhone 4 GPU, when it can only use 2x of that anyway?
loganin - Tuesday, November 1, 2011 - link
That's a pretty weak and factually wrong claim to discredit Apple's product, not that it's surprising coming from you."Exynos SoC Same Size As Apple A5 In iPad 2"
http://www.itproportal.com/2011/06/07/exynos-soc-s...
zanon - Tuesday, November 1, 2011 - link
loganin already addressed your claptrap regarding size, so we'll just ignore that. A few other bits stand out, however. The first is that, fundamentally, even if you were right so what? You don't win any points for improving in one way vs another, what matters is the result at the end. Regardless of the method PowerVR used the fact that the 543MP2 utterly demolishes the competition, and that it's a beast, would not change.Second, you failed to mention in your "1.5x-2x" the performance bit the fact that it's also clocked *50% slower* then the Exynos. Again, even pretending you were correct, your size difference *still* wouldn't explain the kind of gap we're seeing. Unlike size, which is not perfectly correlated with performance, clock rate pretty directly is. If the 4S's A5 was running at 1.2 GHz, it would be more like 2.8x the performance of the Exynos at the high end.
>>Because it can't be about the games. Why would it get 7x the performance of the previous iPhone 4 GPU, when it can only use 2x of that anyway?
Also, this bit is just WTF. You might have noticed that PC GPUs continue to increase in power? Despite resolutions not continuing to increase? WTF do you mean "you can only use 2x of that"?? At least until the level of complete photorealism with full real time physics modeling of everything is achieved there's always room to spend more power just making the scene look better. Duh.
metafor - Tuesday, November 1, 2011 - link
Erm, GPU clocks are independent of what the CPU is clocked at. I.e. just because the A5's CPU is clocked at 800MHz doesn't mean the GPU is.Apple never really releases what the internal clocks of their various components are running at.
Lucian Armasu - Wednesday, November 2, 2011 - link
Do you even know what 50% slower means? It means half the clock speed. It's not 50% slower. It's 30% slower than Exynos CPU.. It's the Exynos CPU that is "50% faster" than the A5 one.But that's not even what we were talking about. I was talking about the GPU, not the CPU. The GPU has a difference frequency.