Camera - Low Light Evaluation - Night Sight

Of course one of the new exciting features about the new Pixel 3 is the promise of its Night Sight mode. As mentioned a few pages back, in order to enable this facility we’re using a modified camera application in order to get the mode working for this review, as otherwise it would have made for a pretty boring low-light comparison.

I’m also showcasing the camera differences on the original Pixel as well as Pixel 2, so that users can see what kind of improvements they can expect on their existing devices. Both of these devices also have the Night Sight enabled option for the software.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

In the first construction scene, the difference between the auto shot and the Night shot are, pardon the pun, night and day. Here the differences in processing are quite astounding and make for a major improvement in the Pixel’s low-light capture ability.

The resulting image is significantly brighter than what how the scene looked in reality. I’d even go as far that the Pixel is so aggressive with the exposure here that it even goes a bit too far, as the Mate 20 Pro’s auto mode and Mate 20’s night mode seem a lot more realistic. It’s to be noted that the Mate 20 Pro’s result is achieved with no software tricks – just relying on the ISO25600 mode of its sensor.

The Pixel 2, with the Night Sight enabled software, manages to get a near identical result to the Pixel 3, and even the original Pixel doesn’t seem too far off.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Night Sight doesn’t seem to need to be used in very dark scenes to show a benefit, as even with artificially lit objects such as the tree here we can see benefits to the scene. The result puts the Pixel phones far ahead of conventional shooters from Samsung and Apple, with only Huawei’s being able to keep up and battle Google’s new algorithm.

One characteristic of Night Sight is that it doesn’t seem to be able to actually bring down highlights – Huawei’s implementation on the other hand will do this, and that’s why the tree in Huawei’s mode is far less blown-out compared to Google’s camera.

Where Google does shine is in terms of detail retention – the Pixels are able to retain significantly more details than Huawei, and for that matter, the Pixels retain more details than all of the other phones.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20 ]
[ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ] - [ Note9 ]
[ S9+ ] - [ S8 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ]

The main benefits of Night Sight in scenarios where there is sufficient light is that it allows for better detail retention and less noise. Google competition here is again Huawei – however the Pixels are able to edge out the P20’s and Mate 20’s in terms of detail retention and less noise.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

When going into lower light scenes, again, the Pixels are able to produce images that are much brighter than how the scene was originally.

Again, the only phones able to compete in terms of light capture are Huawei’s – but again, the Pixels are able to produce a better image thanks to better detail retention. Huawei’s phones here most likely are suffering from the lack of OIS on their main cameras.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

Although this is meant to be a comparison between 18 phones, the real fight here is just between the Pixel 3 and Huawei’s devices. Again the Pixels here significantly win because of the vast advantages in terms of detail retention and sharpness – far ahead of any other phone.

Extreme low-light

Extreme low light scenarios is something as early as last year we wouldn’t have expected phones to be viable in. Again I started shooting such scenes earlier in the year when Huawei made its Night mode usable without a tripod – along with vendors like LG introducing pixel binning modes that quadruple the light capture of the sensors.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

This shot is very similar to the first one in that the Pixels are able to generate such bright pictures that I’d say they’re overexposed. Again, only Huawei’s phones and as well as the LG G7’s LLS mode are able to achieve similar light capture. The latter suffers from a stark lack of details, leaving only Huawei’s phones in the competition.

What is very interesting is to see just how much colour accuracy Google is able to achieve even with such low brightness levels.

Click for full image
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ] - [ S8 ]
[ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]

The last shot I wanted to take the phones to their limits – the vast majority of phones here won’t be able to discern nearly anything and many will just produce a black picture. The scene was solely illuminated by moonlight of a full moon as well as some far as way industrial spotlights.

Even here, the Pixel’s Night Sight is able to deliver, producing a semi visible result of the object. Only the Mate 20 Pro’s ISO102400 shot was able to come near the exposure levels, but with significantly more noise.

Low-light conclusion

This conclusion of the Pixel 3 in low light would have sounded extremely differently if I had just used Google’s official camera application and not tested Night Sight. I’ve never really understood why people claimed the Pixel 2 camera to be good in low-light, because in my experience as well as visible in these sample shots, the Pixels were never really competitive and are outclassed by the better sensors from Samsung and Apple, when capturing in traditional modes.

Night Sight is very much a game-changer to this situation, and Google is able to showcase an outstanding example of computational photography that vastly beats even the wildest expectation of what a smartphone camera is able to achieve in low-light scenarios.

In a swoop, Google’s Pixels significantly climb up the ladder in terms of low-light photography ranking, even putting themselves at a comfortable distance ahead of the previous low-light champions, Huawei’s 40MP sensor phones as well as their own night mode.

Camera - Daylight Evaluation - Dynamic Range Camera Video Recording & Speaker Evaluation
Comments Locked

135 Comments

View All Comments

  • buxe2quec - Sunday, November 4, 2018 - link

    When I buy a phone I go to DxO Mobile and from the top ranking I go down until I find a phone within my budget.
    DxO however is sometimes controversial, so I would like to see a synthetic number from Anandtech, so that I can quickly do the same here as well.
  • misaki - Sunday, November 4, 2018 - link

    The Pixel3 4k EIS video is linked to the Pixel 2 video and the Pixel2 1080p30 is labeled incorrectly.
    I don't know if it shows up in the original video or if it's a Youtube encoding issue but the unstabilized Pixel 3 4k video retains a lot more detail than both of the the Pixel 2 4k videos, stabilized and unstabilized. I see it plainly without even needing to pixel peep. Pixel 2 video capture had good stabilization but was always disappointing in all other ways and behind other flagship phones. If they at least improved their encoder for the Pixel 3 like what I'm seeing then it's a good start.
  • cwolf78 - Monday, November 5, 2018 - link

    Thanks for the thorough review. One question I have is that there are many other reviewers out there that have praised the included ear buds and even had separate reviews for them they were so impressed. I don't think anyone has claimed the sound quality is top-tier by any means, but they were supposed to sound decent and have excellent Google Assistant support. Just curious if maybe you have a defective set or your standards are unrealistically high?
  • Andrei Frumusanu - Monday, November 5, 2018 - link

    I wouldn't say my standards are that high - and *maybe* my units are defective. Compared to any other bundled units they sound as if they're covered by tape and very muffled. A quick frequency response comparison ( https://twitter.com/andreif7/status/10586681768783... and yes I know this isn't an absolute measurement, but a relative one to the Apple ones ) represented what I heard, with insanely weaker mid-ranges.
  • Fluffywings - Monday, November 5, 2018 - link

    Hi Andrei,

    Great review and clearly a lot of effort. As you mention in the camera review, excerpt below, the shadows are darker than should be, which is something I noticed with the Pixel 2 back in 2017. I have found a simple solution that changed how I use my Pixel 2 camera. When setting up the picture, click on a darker area for focus. It will bring up the shadows and the picture will look better than before but with much detail in the shadows. I will take usually 2 pictures, one clicking on the darkest portion of a scene, and the second, clicking on a slighter less darkest portion of the scene.
    Can you give it a try and let me know what you think?

    "A characteristic of Google’s phones we’ll see throughout the pictures is that the processing likes to darken the shadows more than what the sensor actually sees, and this most visible in the trees in these pictures, as the pines in the middle picture lose a lot of detail compared to any other phone, also something that happens throughout darker objects of the whole scene."
  • Andrei Frumusanu - Monday, November 5, 2018 - link

    I mean, sure, that's a way to do it, but then I'm no longer testing the default capabilities of the phone. I also said this year Samsung overexposes too much in many scenes, and I'm also not going around to adjust that for every shot.
  • Fluffywings - Sunday, November 11, 2018 - link

    Makes sense. Most people will use the phone in the same way.
  • s.yu - Thursday, November 15, 2018 - link

    I also notice that in my Gcam port to Note8, I set everything to max for maximum IQ but still sometimes shadows drop to pitch black too fast. Switching to the default camera app with the exact same framing I could get a much finer gradient in the shadows.
    The reason I still use GCam is higher DR in most instances and less noise, less smearing. Also the slight HDR effect applied works better with snapseed's set of adjustment sliders, especially ambience. The default camera works better with LR, snapseed's often a little quirky and counterintuitive.
  • stacey94 - Monday, November 5, 2018 - link

    Great review! I really wanted to see the display results.

    I don't know that you guys ever test this stuff, but it would be nice to see audio output comparisons between phones for the 3.5mm jack. (As it seems like a lot of digital dongles shipping with phones have lower quality than the Qualcomm DAC built into the phones).

    And some level of Bluetooth performance analysis would be helpful, whether that's through LDAC bitrate or signal strength. I know the original Pixel had an "antennagate" problem where touching the band on the top right of the phone would immediately cause BT audio to garble and cut. My Pixel 2 was also hit or miss with several BT devices compared to an iPhone 8.

    On another note, is testing the Surface Laptop 2 on the agenda at all? I'm mainly looking to see the color accuracy of the display and find out if they're still using that awful SSD the first gen shipped with.
  • dgtangman - Monday, November 5, 2018 - link

    I'm seeing a very strange behavior with the sample images and would like to know if anyone else has encountered it. If I right-click and select "Open Link in New Window" I get a new window that shows the full-size version of the currently displayed sample the first time I click on the image. If I then pick a different sample the in-page sample image changes and the link name shown when I hover on the sample image changes, but if I right click and open in a new window again I get the same image I saw the first time; the URL displayed in the new window is the same as for the first sample image and is not the URL that was displayed when I right clicked on the sample image. To see a different full-size image from a given set of samples I have to reload that page of the review.

    Has anyone else seen anything like this? I've been trying to figure out anything that could be wrong on my end to get these results, and I haven't had any luck. I'd like to blame it on my Comcast connection, but I can't figure out how they could accomplish this either.

    I've tried this on Firefox 63 with all add-ons disabled and on Chromium 70 with identical results.

Log in

Don't have an account? Sign up now