Camera - Low Light Evaluation - Night Sight

Of course one of the new exciting features about the new Pixel 3 is the promise of its Night Sight mode. As mentioned a few pages back, in order to enable this facility we’re using a modified camera application in order to get the mode working for this review, as otherwise it would have made for a pretty boring low-light comparison.

I’m also showcasing the camera differences on the original Pixel as well as Pixel 2, so that users can see what kind of improvements they can expect on their existing devices. Both of these devices also have the Night Sight enabled option for the software.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

In the first construction scene, the difference between the auto shot and the Night shot are, pardon the pun, night and day. Here the differences in processing are quite astounding and make for a major improvement in the Pixel’s low-light capture ability.

The resulting image is significantly brighter than what how the scene looked in reality. I’d even go as far that the Pixel is so aggressive with the exposure here that it even goes a bit too far, as the Mate 20 Pro’s auto mode and Mate 20’s night mode seem a lot more realistic. It’s to be noted that the Mate 20 Pro’s result is achieved with no software tricks – just relying on the ISO25600 mode of its sensor.

The Pixel 2, with the Night Sight enabled software, manages to get a near identical result to the Pixel 3, and even the original Pixel doesn’t seem too far off.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Night Sight doesn’t seem to need to be used in very dark scenes to show a benefit, as even with artificially lit objects such as the tree here we can see benefits to the scene. The result puts the Pixel phones far ahead of conventional shooters from Samsung and Apple, with only Huawei’s being able to keep up and battle Google’s new algorithm.

One characteristic of Night Sight is that it doesn’t seem to be able to actually bring down highlights – Huawei’s implementation on the other hand will do this, and that’s why the tree in Huawei’s mode is far less blown-out compared to Google’s camera.

Where Google does shine is in terms of detail retention – the Pixels are able to retain significantly more details than Huawei, and for that matter, the Pixels retain more details than all of the other phones.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20 ]
[ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ] - [ Note9 ]
[ S9+ ] - [ S8 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ]

The main benefits of Night Sight in scenarios where there is sufficient light is that it allows for better detail retention and less noise. Google competition here is again Huawei – however the Pixels are able to edge out the P20’s and Mate 20’s in terms of detail retention and less noise.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

When going into lower light scenes, again, the Pixels are able to produce images that are much brighter than how the scene was originally.

Again, the only phones able to compete in terms of light capture are Huawei’s – but again, the Pixels are able to produce a better image thanks to better detail retention. Huawei’s phones here most likely are suffering from the lack of OIS on their main cameras.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Although this is meant to be a comparison between 18 phones, the real fight here is just between the Pixel 3 and Huawei’s devices. Again the Pixels here significantly win because of the vast advantages in terms of detail retention and sharpness – far ahead of any other phone.

Extreme low-light

Extreme low light scenarios is something as early as last year we wouldn’t have expected phones to be viable in. Again I started shooting such scenes earlier in the year when Huawei made its Night mode usable without a tripod – along with vendors like LG introducing pixel binning modes that quadruple the light capture of the sensors.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

This shot is very similar to the first one in that the Pixels are able to generate such bright pictures that I’d say they’re overexposed. Again, only Huawei’s phones and as well as the LG G7’s LLS mode are able to achieve similar light capture. The latter suffers from a stark lack of details, leaving only Huawei’s phones in the competition.

What is very interesting is to see just how much colour accuracy Google is able to achieve even with such low brightness levels.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ] - [ S8 ]
[ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

The last shot I wanted to take the phones to their limits – the vast majority of phones here won’t be able to discern nearly anything and many will just produce a black picture. The scene was solely illuminated by moonlight of a full moon as well as some far as way industrial spotlights.

Even here, the Pixel’s Night Sight is able to deliver, producing a semi visible result of the object. Only the Mate 20 Pro’s ISO102400 shot was able to come near the exposure levels, but with significantly more noise.

Low-light conclusion

This conclusion of the Pixel 3 in low light would have sounded extremely differently if I had just used Google’s official camera application and not tested Night Sight. I’ve never really understood why people claimed the Pixel 2 camera to be good in low-light, because in my experience as well as visible in these sample shots, the Pixels were never really competitive and are outclassed by the better sensors from Samsung and Apple, when capturing in traditional modes.

Night Sight is very much a game-changer to this situation, and Google is able to showcase an outstanding example of computational photography that vastly beats even the wildest expectation of what a smartphone camera is able to achieve in low-light scenarios.

In a swoop, Google’s Pixels significantly climb up the ladder in terms of low-light photography ranking, even putting themselves at a comfortable distance ahead of the previous low-light champions, Huawei’s 40MP sensor phones as well as their own night mode.

Camera - Daylight Evaluation - Dynamic Range Camera Video Recording & Speaker Evaluation
Comments Locked

135 Comments

View All Comments

  • s.yu - Sunday, November 11, 2018 - link

    Oh, I don't know what happened to the site but I'm experiencing frequent problems trying to view samples in full size, I see the correct URL when I hover my cursor over the sample but when I shift-click it(any other sample) only the first sample of the group is opened.
  • s.yu - Sunday, November 11, 2018 - link

    Correction...it just gets stuck at the first sample of the group that I clicked, if I click say the XS sample then I only get the XS sample, click on another sample and I wouldn't be able to open the full sized version of that in a new tab, the new tab would load the XS sample instead.
  • Impulses - Friday, November 2, 2018 - link

    As long as you aren't photographing anything moving... The shutter speeds used will lead to more blurring.
  • Badelhas - Sunday, November 4, 2018 - link

    Andrei, didn't Google say that the "Night Shot" feature will eventually come to the Pixel 2? If so, the main advantage is gone, we can just buy a Pixel 2, which is much cheaper...
    Cheers
  • s.yu - Sunday, November 11, 2018 - link

    There's only one minor issue I'd like to bring up, I don't think Pixel3 clipped more highlight in night mode than Mate20P, all the blue areas are in fact not clipped, only, well, in highlight territory. Only pure white is clipped and from my preliminary examination of the sample with the spotlights illuminating the tree in the center, I'd say Pixel clipped a little less highlight.
    So I then downloaded the samples to view them in lightroom(the issue I mentioned seems to have been limited to page 7, I'm not having problems on page 8). When checking for clipping with the inbuilt tool I noticed that the Mate20P shot had unnatural readings, the tool only labeled two jagged streaks across the surface of the nearest spotlight, while a proper clipping of something like that should at least look remotely round, so I determined that to be software artifacts and added a slight 5 to the global highlight slider, which would just label whatever looked like pure white on that spotlight as clipped.
    On the pixel sample I did the same thing only slightly less, adding 2 to the slider already made pixel's clipping area look properly round(and the same size as Mate20P's). Then I went back to examine the clipping on the tree branches, it was too close to call. So I believe that Pixel and Mate20P retain the same amount (within 1/6 of a stop difference) of highlight DR, only Huawei's algorithm favors aggressively suppressing whatever it has available which Pixel does not.
    Adding that to the far superior detail retention I say Pixel's clearly the new night king.
  • chief-worminger - Friday, November 2, 2018 - link

    Hello Andrei,

    Thank you for the thorough review. I wonder when you say in the battery life section that "SoC efficiency can go either way", do you mean that some 845 chips might be more efficient than some 835 chips, and vice versa? If not can you please clarify?
  • Andrei Frumusanu - Friday, November 2, 2018 - link

    In synthetic tests, the S845 was about equally efficient in terms of energy usage as the S835 - so only minor factors such as software scheduling might push the efficiency in one direction or the other.
  • saleri6251 - Friday, November 2, 2018 - link

    Hello Andrei, I remember a few months ago on twitter you mentioned that a lot of people thought the S845 was going to have massive improvements on battery life, but the logic was very flawed. What was the flaw in the logic?

    Also any hopes for next year when everyone will be on the 7nm chips?
  • eurico - Friday, November 2, 2018 - link

    I'd love to see some Sony phones used in comparisons, I understand that Sony's been lagging a bit behind lately, but still they do have some decent references in battery life and camera performance.
  • Samus - Friday, November 2, 2018 - link

    Sony has one of the, if not the best, camera UI. But the phones and sensors leave a lot to be desired.

Log in

Don't have an account? Sign up now