Camera - Low Light Evaluation

In low-light scenarios, we should see the new iPhone XS showcase significant improvements thanks to the 50% better light capture ability of the new sensor. Apple’s still only employing a f/1.8 aperture lens on the XS - so while it will improve over past phones, at least on paper it’s still at a disadvantage to say Samsung’s latest phones, which have an extra-wide f/1.5 aperture available to them.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

In this first shot, we immediately see the new iPhone’s advantage over last year’s flagship. There is a lot more definition in the grass, less noise throughout the image, and less blown out lights in the scene.

Unfortunately, Apple is as expected still at a great disadvantage to Samsung here, as the latter is just able to give more light onto the whole scene, and the most evident, more colour to the grass. In terms of raw low light capture, the Huawei P20 Pro is still far ahead here, thanks to its massive sensor that is able to collect significantly more light.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

At first glance, the iPhone XS didn’t shoot a much brighter picture than the iPhone X in this construction scene. Opening up the full resolution images however shows that the new XS showcases much better details and lower noise. It’s not enough to compete with the S9+, and certainly not with the insane ISO25600 shot of the P20 Pro.

It’s interesting to see the improvements over the years from the iPhone 6S on – which barely manages to capture anything in this scene.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

The next shot is probably the only one that I found to be really problematic for Apple. Both on the iPhone X and the new XS, the resulting images weren’t consistent in consecutive shots. In four shots in a row, the iPhone XS kept changing the colour temperature. The same thing happened on the iPhone X, so I think this was part of Apple’s exposure / colour balance algorithm.

Colour balance aside, the exposure is similar between the X and the XS, and all the improvements of the new sensor go directly into improved detail and noise reduction throughout the scene, which is significantly better again compared to last year’s iPhone.

Here Apple is very close to Samsung, showcasing a bit better shadows, but still losing out in details in some parts of the scene. The P20 Pro is yet again the low-light kind here, as it just have that much more dynamic range work with.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

Again, the iPhone’s new sensor comes into play in these concrete trucks. The XS makes very good dealing of the blown highlights present in the iPhone X shot. Samsung is able to produce more vibrancy in the blue of the trucks. Huawei’s multi-exposure computational photography night mode is the best of all phones here as it’s just able to bring out that much more from the shadows.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

Apple's use of SmartHDR in this picture is extremely evident, as it really brings down the highlights of the lamp and brings out more shadows throughout the scene. The XS provides better detail, but it’s not as big of a difference as we’ve seen in other shots.

Apple’s usage of HDR here puts it ahead of the Samsung devices, trading blows with the P20 Pro, winning in some regards, while losing in others.

Click for full image
[ iPhone XS ] - [ iPhone X ] - [ iPhone 7 ] - [ iPhone 6S ]
[ Galaxy Note9 ] - [ Galaxy S9+ ] - [ Galaxy S8 ]
[ LG G7 ] - [ LG G6 ] - [ LG V30 ] - [ OnePlus 6 ]
[ Mi MIX2S ] - [ Pixel 2XL ] - [ P20 Pro ]

Finally, I wanted to test the iPhone XS to its limits and see what it can do in essentially impossible scenarios of low light.

Exposure-wise, the iPhone XS is no better than the X here. It provides better sharpness and less noise, however the image is still too dark to be of any use. I wish Apple would introduce a more innovative low light shooting mode, such as LG’s pixel binning mode. Huawei’s ISO51200 capture of this scene is just so beyond any other current phone, that it really raised the bar in what we’d normally expect to see in a smartphone.

Low-light conclusion

The new iPhone XS sensor is a great improvement to Apple’s lineup. Its advantages over the iPhone X are clearly evident in every single low-light shot, showcasing greater detail and sharpness while reducing noise. SmartHDR doesn’t seem to be something that’s solely for daylight shots, as Apple and the iPhone XS seem to make use of it in some low-light scenarios, giving the camera a further advantage over last year’s phones.

While Apple has showcased some really good progress, it’s can still lag behind low-light image quality of Samsung and Huawei’s P20 Pro. The former’s bigger aperture is just a sheer hardware advantage, while the latter enormous sensor makes use of innovative image processing to really raise the bar in terms of extreme low light photography. Here the iPhone XS is good; but it just can’t keep up.

Camera - Daylight - More HDR & Portrait Camera Video Recording & Speaker Evaluation
Comments Locked

253 Comments

View All Comments

  • Ansamor - Friday, October 5, 2018 - link

    Same app for Android https://play.google.com/store/apps/details?id=com....
  • tim1724 - Friday, October 5, 2018 - link

    My iPhone XS scored 2162. :)
  • DERSS - Saturday, October 6, 2018 - link

    Is it much versus Kirin and Qualcomm or not?
  • shank2001 - Saturday, October 6, 2018 - link

    2868 on my XS Max
  • name99 - Saturday, October 6, 2018 - link

    But it is unclear that the benchmark is especially useful. In particular if it's just generic C code (as opposed to making special use of the Apple NN APIs) then it is just testing the CPU, not the NPU or even NN running on GPU.

    You scored 2162. iPhone 6S scores 642 (according to the picture). That sort of 3.5x difference to me looks like a lot less than the boost I'd expect from an NPU, and may just reflect basically 2x better CPU plus availability of the small cores (not present on iPhone 6S).
  • edwpang - Friday, October 5, 2018 - link

    There are no storage, network, and phone tests. Hopefully, these tests will included in future update.
  • name99 - Friday, October 5, 2018 - link

    "Apple promised a significant performance improvement in iOS12, thanks to the way their new scheduler is accounting for the loads from individual tasks. The operating system’s kernel scheduler tracks execution time of threads, and aggregates this into an utilisation metric which is then used by for example the DVFS mechanism."

    This is not the only changes in the newest Darwin. There are also changes in GCD scheduling. There was a lot of cruft surrounding that in earlier Darwins (issues of lock implementations, how priority inversion was handled, the heuristics of when a task was so short it's cheaper to just complete it than give up the CPU "for fairness --- but everyone then pays the switching cost"). These are even more difficult to tease out (and certainly won't present in single-threaded benchmarking) but are considered to be significant. There's also been a lot of thinking inside Apple about best practices for GCD (and the generic problem of "how to use multiple cores") and this has likely been translated into new designs within at least some frameworks and Apple's tier1 apps.
    You can see this discussed here:
    https://gist.github.com/tclementdev/6af616354912b0...
  • sheltem - Friday, October 5, 2018 - link

    Can we chalk up the improvements of the 2x lens to computational HDR or is there a hardware improvement as well?
  • darkich - Friday, October 5, 2018 - link

    I just can't wait for Apple to FINALLY flesh out their in-house Mac chips.
    Not because I love Apple, but simply because I think the end result will be spectacular and outright shocking for Intel..and I do hate Intel.
    They are disgustingly overrated.
  • varase - Tuesday, October 23, 2018 - link

    I hope it's a good while ... I *need* VMWare and the ability to run Windows in a VM (for work).

    Not to mention, I'd be really disappointed if I couldn't boot Windows for game play.

Log in

Don't have an account? Sign up now