Camera - Low Light Evaluation - Night Sight

Of course one of the new exciting features about the new Pixel 3 is the promise of its Night Sight mode. As mentioned a few pages back, in order to enable this facility we’re using a modified camera application in order to get the mode working for this review, as otherwise it would have made for a pretty boring low-light comparison.

I’m also showcasing the camera differences on the original Pixel as well as Pixel 2, so that users can see what kind of improvements they can expect on their existing devices. Both of these devices also have the Night Sight enabled option for the software.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

In the first construction scene, the difference between the auto shot and the Night shot are, pardon the pun, night and day. Here the differences in processing are quite astounding and make for a major improvement in the Pixel’s low-light capture ability.

The resulting image is significantly brighter than what how the scene looked in reality. I’d even go as far that the Pixel is so aggressive with the exposure here that it even goes a bit too far, as the Mate 20 Pro’s auto mode and Mate 20’s night mode seem a lot more realistic. It’s to be noted that the Mate 20 Pro’s result is achieved with no software tricks – just relying on the ISO25600 mode of its sensor.

The Pixel 2, with the Night Sight enabled software, manages to get a near identical result to the Pixel 3, and even the original Pixel doesn’t seem too far off.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Night Sight doesn’t seem to need to be used in very dark scenes to show a benefit, as even with artificially lit objects such as the tree here we can see benefits to the scene. The result puts the Pixel phones far ahead of conventional shooters from Samsung and Apple, with only Huawei’s being able to keep up and battle Google’s new algorithm.

One characteristic of Night Sight is that it doesn’t seem to be able to actually bring down highlights – Huawei’s implementation on the other hand will do this, and that’s why the tree in Huawei’s mode is far less blown-out compared to Google’s camera.

Where Google does shine is in terms of detail retention – the Pixels are able to retain significantly more details than Huawei, and for that matter, the Pixels retain more details than all of the other phones.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20 ]
[ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ] - [ Note9 ]
[ S9+ ] - [ S8 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ]

The main benefits of Night Sight in scenarios where there is sufficient light is that it allows for better detail retention and less noise. Google competition here is again Huawei – however the Pixels are able to edge out the P20’s and Mate 20’s in terms of detail retention and less noise.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

When going into lower light scenes, again, the Pixels are able to produce images that are much brighter than how the scene was originally.

Again, the only phones able to compete in terms of light capture are Huawei’s – but again, the Pixels are able to produce a better image thanks to better detail retention. Huawei’s phones here most likely are suffering from the lack of OIS on their main cameras.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Although this is meant to be a comparison between 18 phones, the real fight here is just between the Pixel 3 and Huawei’s devices. Again the Pixels here significantly win because of the vast advantages in terms of detail retention and sharpness – far ahead of any other phone.

Extreme low-light

Extreme low light scenarios is something as early as last year we wouldn’t have expected phones to be viable in. Again I started shooting such scenes earlier in the year when Huawei made its Night mode usable without a tripod – along with vendors like LG introducing pixel binning modes that quadruple the light capture of the sensors.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

This shot is very similar to the first one in that the Pixels are able to generate such bright pictures that I’d say they’re overexposed. Again, only Huawei’s phones and as well as the LG G7’s LLS mode are able to achieve similar light capture. The latter suffers from a stark lack of details, leaving only Huawei’s phones in the competition.

What is very interesting is to see just how much colour accuracy Google is able to achieve even with such low brightness levels.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ] - [ S8 ]
[ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

The last shot I wanted to take the phones to their limits – the vast majority of phones here won’t be able to discern nearly anything and many will just produce a black picture. The scene was solely illuminated by moonlight of a full moon as well as some far as way industrial spotlights.

Even here, the Pixel’s Night Sight is able to deliver, producing a semi visible result of the object. Only the Mate 20 Pro’s ISO102400 shot was able to come near the exposure levels, but with significantly more noise.

Low-light conclusion

This conclusion of the Pixel 3 in low light would have sounded extremely differently if I had just used Google’s official camera application and not tested Night Sight. I’ve never really understood why people claimed the Pixel 2 camera to be good in low-light, because in my experience as well as visible in these sample shots, the Pixels were never really competitive and are outclassed by the better sensors from Samsung and Apple, when capturing in traditional modes.

Night Sight is very much a game-changer to this situation, and Google is able to showcase an outstanding example of computational photography that vastly beats even the wildest expectation of what a smartphone camera is able to achieve in low-light scenarios.

In a swoop, Google’s Pixels significantly climb up the ladder in terms of low-light photography ranking, even putting themselves at a comfortable distance ahead of the previous low-light champions, Huawei’s 40MP sensor phones as well as their own night mode.

Camera - Daylight Evaluation - Dynamic Range Camera Video Recording & Speaker Evaluation
Comments Locked

135 Comments

View All Comments

  • s.yu - Thursday, November 15, 2018 - link

    You're looking at this wrong, *flash*, not night sight, should be the last resort. On axis flash is almost always ugly and detrimental to what you're trying to capture, and severely interferes with post processing, night sight saves the need for flash, which is the way to go.
  • sarangiman - Thursday, November 15, 2018 - link

    "I’ve never really understood why people claimed the Pixel 2 camera to be good in low-light, because in my experience as well as visible in these sample shots, the Pixels were never really competitive and are outclassed by the better sensors from Samsung and Apple, when capturing in traditional modes."

    It's not that Samsung or Apple used 'better sensors', they just used longer exposure times (down to 1/4s), while the Pixel 2 would try to stick to 1/25 to 1/40s to avoid motion blur in human subjects, and only reluctantly dropping to 1/15s in very very dark situations.

    The reason many were impressed by the low light performance of the Pixel 2 was that it could retain good image quality in *less* low light (but still low light - such as indoors) conditions, while not having human subjects blurred. Also, iPhone motion estimation would jack up the shutter speed (to ~1/30s) when any movement was detected (human subject or shaky hands), and image quality would drop drastically, below that of the Pixel 2 (b/c it wouldn't also average as many frames as the Pixel cameras do). Things have improved with the XS.

    So it's a question of *how* low light of a scene are you interested in, and are you photographing human subjects or still scenes.

    Thanks for the review, very nice comparisons, and great work in particular with your display evaluation. It's irksome that despite having a proper CMS in the OS, every app appears to be rendering to sRGB. Google Photos app is even color profile aware, but converts images with ICC profiles (say: P3 or even ProPhotoRGB images) to sRGB for output (which means in 'Adaptive' screen mode, the sRGB output gets stretched, yielding oversaturated inaccurate colors). This just isn't how color management is meant to work - the CMS should take the embedded ICC profile and convert to the display profile.
  • makkumatr - Saturday, November 24, 2018 - link

    Love the detailed review, Andrei.
    Could you comment on the quality of the sound recording of the videos on Pixel 3, reading a lot of complaints on that.
  • ErikSwan - Tuesday, December 18, 2018 - link

    Andrei, thank you for the thorough review, especially the display section.

    Did you evaluate display uniformity at all? A lot of users (me included) are reporting a green-to-pink gradient across the display. It's very easy to notice with a gray background at low brightness levels in low to moderate light (think: using the phone in bed with only a bedside reading lamp illuminating the room). I'm curious whether only some devices are susceptible to this or if you noticed it on your Pixel 3 sample as well.

    Going forward, I would really like to see some measurement of uniformity included in display evaluations. If the dE at the centerpoint of the display is very low, that's great, but if the display isn't also uniform it can be a misleading indication of the overall quality of the display.

    Thanks!
  • ducksu - Thursday, May 16, 2019 - link

    What's the best screen mode for pixel 3?

Log in

Don't have an account? Sign up now