Camera - Low Light Evaluation

It’s hard to argue against the fact that over the last 2 years, Apple has largely fallen behind in terms of low-light photography. The advent of computational photography with new dedicated night modes, along with competitor devices which have massively more performant camera hardware, meant that the iPhone XS ended up being one of the least competitive devices in low light conditions. Some developers out there have even tried to address this gap with third-party camera applications which deliver their take on computational photography night mode capture.

Apple seems to have made note of this and the new iPhone 11 series now does address this missing feature. Let’s see how it holds up against the fierce competition:

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [ Xperia 1 ] - [ G8 ]

Starting off with a low-light, yet still artificially illuminated scenario, we encounter the first aspect of Apple’s new camera: the night mode isn’t a dedicated mode that one can manually select. Rather, it's a mode that gets triggered automatically depending on the ambient light detected by the phone. In this scene, there was too much light available, and as such the phone wasn't able to trigger Night mode.

That isn’t to day that the iPhone falls behind, the main camera is still very much able to produce some excellent results. In such medium light scenarios, the telephoto lens’ wider aperture now allows the camera to actually use the module rather than falling back to the main sensor and cropping the scene, which is what the XS did.

Unfortunately, the wide-angle lens’ results here are just bad and it’s all just blurry. Huawei and Samsung clearly both dominate here in terms of low-light quality, with either better sensors such as the Mate 30 Pro, or making use of Night Mode on the wide-angle unit, something which isn’t available for the iPhone 11.

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [Xperia 1 ] - [G8 ]

Going to a darker scene, we now finally see Apple’s Night Mode in action. Apple’s non-night mode shot is actually more representative of the actual brightness of the scene at the time, but Night Mode really improves the amount of detail throughout the scene. Apple’s implementation here is superior to Samsung’s and Google’s, as it’s able to retain more detail and has a better handling of the noise. Samsung has the odd situation that the new Night Mode on the Snapdragon variants is inferior in quality to the Exynos based models, making things quite blurry. Huawei’s specialized low light RYYB sensor still is the best low-light camera.

It’s odd to see that Apple’s algorithm doesn’t attempt to bring down the highlights, as such the signs on the left which are still very much blown out and overexposed.

I tried to capture a picture with the Night Mode exposure set to the very maximum 10 seconds as made available in Apple’s camera UI, however the end result was always repeatedly always capped at the exposure the camera automatically selected, even if it did appear as if it’s capturing a 10 second shot. I retested this on the newest iOS 13.2 and things did change, as it was indeed able to capture a very different shot – so it seems the Night Mode behavior on iOS 13.1 is still bugged.

The iPhone’s 11 series' wide-angle module continues to be pretty terrible in low-light.

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [ Xperia 1 ] - [ G8 ]

Apple’s night mode here continues to impress as it’s able to reproduce an excellent representation of the scene with a lot of detail. Google’s Night Sight is comparable, or even better, in detail, however the colors are too vivid.

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [ Xperia 1 ] - [ G8 ]

We continue to observe that in more well-lit scenarios that the night mode doesn’t engage. Even without it, the new iPhone 11 is an improvement over the XS.

The wide-angle module remains terrible and frankly I’m a bit puzzled why it does so bad even in a more well-lit scene like this one. The phone gets pretty much embarrassed by all the other devices.

Click for full image
[ iPhone 11 Pro ] - [iPhone XS ] - [iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [Xperia 1 ] - [G8 ]

One thing we notice about the new Night Mode is that it’s not really able to bring out details in areas where the sensor doesn’t see anything. For example, in this scene the roof of the abbey remains clipped to black, while other devices such as the S10 or the Pixel are able to bring out the roof’s structure and details. The darker it gets, and as long as there’s some brighter elements to the scene, we’re seemingly hitting dynamic range limitations on Apple’s night mode.

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [ Xperia 1 ] - [ G8 ]

In more uniformly dark areas, the iPhone is able to extract a ton of light, but in areas where the sensor just isn’t sensitive enough and it’s not able to provide any data for the algorithm to accumulate over time, it leads in some odd looking results such as this extremely pronounced shadow of the play castle.

Click for full image
[ iPhone 11 Pro ] - [ iPhone XS ] - [ iPhone X ]
[ S10+(S) ] - [ S10+(E) ]
[ Pixel 3 ] - [ Mate 30 Pro ]
[ P30 Pro ] - [ Xperia 1 ] - [ G8 ]

Here again, in a very uniformly lit but still extremely dim scene, the iPhone 11 is able to bring out a ton of light and the result here is significantly brighter than how the scene was in reality. The iPhone beats Google and Samsung in terms of detail and only Huawei’s devices remain as the better rivals.

Low Light Conclusion – A Much Needed Feature Added, Wide Angle Lacking

Overall, Apple’s addition of the new night mode very much elevates the camera capture ability of the iPhone 11 series. It was as solemnly needed feature given that almost all other vendors in the industry have embarked on the computational photography train.

Apple’s implementation shines in a few regards: First of all the fact that it gets selected automatically rather than it being a dedicated mode that you have to switch to is a significant plus. as well as a very large practical advantage over other vendor’s camera experiences.

Quality-wise the pictures that the iPhone 11 series is able to produce in low light is top of the line and is challenged only by Huawei’s massive specialized camera sensors in terms of detail that it’s able to capture. There are a few limitations – for example the phone isn’t able to bring out details in areas where the sensor just doesn’t see anything, particularly scenes with brighter objects requiring a wider dynamic range in the capture is where things hit a snag, although details are still excellent even in these scenarios.

The biggest disappointment was the wide-angle camera. Here it’s not only that Apple’s night mode photography isn’t available for this unit, but the module doesn’t even compete against phones without their respective night modes enabled. So the iPhone 11 series is utterly put to shame when they do enable it. I do hope Apple is able to iterate on its processing for this unit as currently it’s just outright terrible and not competitive.

I do have a feeling that we’ll be seeing further updates and improvements from Apple in improving the various aspect of the camera. Already I did notice that iOS13.2 fixes exposures longer than 3 seconds for the night mode, and there’s of course the question of how Deep Fusion behaves in low-light scenarios where the night mode doesn’t kick in.

Camera - More HDR, Indoors, Portrait, Deep Fusion Video Recording & Speaker Evaluation
Comments Locked

242 Comments

View All Comments

  • UglyFrank - Wednesday, October 16, 2019 - link

    I really did not need to see those T Rex scores, it hurt me spirit as a lifetime Android Phone user.
    My S4 would get 17fps in T-Rex and the iPhone is getting ~16-19x that after only 6 years later.
  • Death666Angel - Wednesday, October 16, 2019 - link

    "only 6 years later" Heh.
  • Pro-competition - Wednesday, October 16, 2019 - link

    Why was there no storage performance test? This affects app loading times (esp since Apple doesn't have much RAM), and app installation times, which affect real-world performance.
  • Andrei Frumusanu - Wednesday, October 16, 2019 - link

    We're lacking a better test that works properly. I prefer to skip it rather than have misleading figures.
  • Pro-competition - Wednesday, October 16, 2019 - link

    Understood. Instead of synthetic benchmarks, perhaps just have a table of app loading times of some games? What I have in mind is the following:

    1. Compare current iPhones with the previous generations of iPhones (maybe just go two generations back). And use iPhones with different storage capacities.
    2. Ensure all iPhones have the same iOS version.
    3. Select ~5 games for your test suite, ensuring that the same version is installed on all iPhones.
    4. Before loading the game, close all apps and then restart the phone, so that when the game is launched, we can be assured that are no apps already running.
    5. Do step 4 around five times.
    6. Use a video recorder to measure the time.

    What do you think of my proposal?
  • masimilianzo - Wednesday, October 16, 2019 - link

    Great review, thanks!
    Any idea on LD/ST bandwidth? Have they increase the number of AGUs?
  • Andrei Frumusanu - Wednesday, October 16, 2019 - link

    Bandwidth is included in one of the charts. It looks unchanged, and I didn't see anything different on the instruction side either.
  • masimilianzo - Wednesday, October 16, 2019 - link

    Are you measuring number of ports in the L1 RAM or number of address generation units?
    I guess it depends on having or not conflict to read ports in the RAM.
    The large uplift in h264 test in SpecInt2k6 could come from an additional LD pipe..
  • willis936 - Wednesday, October 16, 2019 - link

    "To be sure, this isn’t the very time we’ve seen this, as OnePlus, LG and Google have already introduced it in their phones over last year."

    very *first
  • eastcoast_pete - Wednesday, October 16, 2019 - link

    Andrei, thanks for your review! One question/request, both for this iPhone review, but also future phone reviews:. Please test the call quality and reception (especially in challenging situations with a single bar/ low signal strength)! I found a couple of otherwise very attractive smartphones fall flat on their phone function. Since my mobile is my main phone, which I also need for work, call quality is a non-negotiable. Unfortunately, even your otherwise excellent reviews skip that aspect. So, any words on call quality of the new iPhones? Thanks!

Log in

Don't have an account? Sign up now