The Google Pixel 3 Review: The Ultimate Camera Test
by Andrei Frumusanu on November 2, 2018 11:00 AM EST- Posted in
- Smartphones
- camera
- Mobile
- Pixel
- Snapdragon 845
- Pixel 3
The Pixel 3 Camera - Computational Photography
The Pixel 3 makes big promises in regards to its camera: Google staunchly claims it to be the best camera on a smartphone, without a doubt. On the hardware side of things, the Pixel 3 doesn’t seem to bring all that many upgrades, as we’re still seeing a 12.2MP sensor in the form of a Sony IMX363, a seemingly generational update to last year’s IMX362. The sensor is supported by a f/1.8 aperture lens and the module supports OIS. A difference to last year’s Pixels is that we no longer find a laser-autofocus mechanism on the new phone, so the new sensor must’ve improved its phase-detection focus capabilities.
Google promises two big new features that aim to actually improve the picture quality of still pictures: Super Res Zoom, and Night Sight.
Super Res Zoom is an application of the geometrical super resolution image processing technique: Google captures multiple quick succession frames in this mode and infers a higher resolution image of the picture. Google doesn’t explain exactly where this processing is done, but it’s possible it’s a NN algorithm running on the Pixel Visual Core (Which on the Pixel 3 is the same silicon as on the Pixel 2). Google actually isn’t the first to introduce such a zoom method, as Huawei uses similar algorithms to achieve its hybrid 2x and 5x zoom modes, with the difference being that Huawei uses differing image inputs from its different sensors, while Google uses temporally different image from the same sensor. The resulting image should be superior to a simple digital zoom – however there’s diminishing returns on the amount of spatial resolution that can be reconstructed using this method.
Night Sight uses very much a similar algorithm to super resolution, with the difference being that instead of using multiple captures to achieve a higher spatial resolution, it can vastly increase the resulting image exposure while having significant noise reduction applied. Again, Huawei was the first to employ a multi-frame stacking algorithm some generations ago, but only this year with the P20’s were they also first to employ the critical combination of multi-frame stacking along with the ability to stack them correctly with spatial offsets to objects on each frame, in order to avoid blurring. Google’s mechanism inherently doesn’t seem to differ much from Huawei’s in what it does, but the implementation itself and results might obviously differ from each other. I expect we’ll be seeing a lot more vendors introduce similar techniques in upcoming devices, as it can bring greatly improved low-light imaging.
Night Sight pre-release APK credits
Officially, Google has to date not released Night Sight for public usage on the Pixel 3 family – this was something of great annoyance to me as the camera testing is a very major part of our reviews that takes significant time investment. Luckily, XDA member cstark27 was able to figure out that the module could be enabled in the camera APK by a simple flip of a settings flag. The timing was perfect as I was heading out with 18 devices in my pockets the very next day – and for this review I used the supplied modified camera APK alongside the stock camera, which spares me a lot of headaches in having to revisit the camera in the near future!
It’s also important to note that the resulting pictures might not be representative of the final camera that Google is planning to publicly release – however in the testing I found minor issues with it and the resulting pictures should be very close to the final product.
Camera - Daylight Evaluation - Superzoom and Scenic
I’m taking advantage of this review to essentially review all major cameras released this year along with some of their predecessors of last year. This involves a major 18-device shootout in various capturing modes. Included along the new Pixel 3 units are also the new Huawei Mate 20 and Mate 20 Pro which we’ll do a follow-up review shortly after this piece. Unfortunately the LG V40 didn’t make in time for the camera shootout, so we’ll revisit that one in a smaller scope in a few weeks’ time.
In the first round of scenarios I’m focusing on the Pixel 3’s new “Super Res Zoom” and how that stacks up to past generation Pixels, as well as the nearest competitors with optical zoom modules.
[ Pixel 3 ]
[ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ]
[ P20Pro ] - [ P20 ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ]
[ S8 ] - [ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ]
[ OPPO FindX ] - [ MIX2S ]
In this first set we see the Pixel 3’s zoom notably improve detail compared to just a digital crop of the full-frame image. The edges are more defined and the phone even manages to resolve some details that weren’t visible in the full-frame crop.
The comparison to the Pixel 2 reveals the crucial differences between just having a crop of the full resolution frame and the Super Res Zoom algorithm applied: The 5x zoom shot is the easiest to dissect in this regard – the details on the clock face visibly look improved and we see new edges on the Pixel 3 image that weren’t present on the Pixel 2.
Comparing to the zoomed in results to any of the optical zoom module competition, we however see that there’s still a major difference in quality: even though the Pixel 3 improves on its spatial resolution, I’d say it only manages to do so up to an equivalent level of a 1.5x zoom. Here the actual gains will depend on the granularity of the sub-pixel image localisation that Google uses. If it’s actually just on a sub-pixel level, then a 1.5x / 50% increase in spatial resolution is the logical limit of what we should be expecting of such an implementation, and further “sub-sub-pixel” increases would require more complex algorithms and more frame captures.
In the wide-angle shot, the Pixel 3 doesn’t differ too much from the Pixel 2. The only notable change is a slight difference in colour temperature, producing a colder image than the Pixel 2, a characteristic of the new camera we’ll see prevalent throughout all of the upcoming scenes.
[ Pixel 3 ]
[ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ]
[ P20Pro ] - [ P20 ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ]
[ S8 ] - [ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ]
[ OPPO FindX ] - [ MIX2S ]
In the next scene, we can apply the same zoom conclusions as on the first shot. The Pixel 3’s Super Res Zoom is a definite improvement over just a digital zoom, however again the spatial resolution increases are limited and cannot compete with optical zoom modules.
In the wide shot, the Pixel 3 again produces a colder image than the Pixel 2, but overall the processing and image are pretty much identical. A characteristic of Google’s phones we’ll see throughout the pictures is that the processing likes to darken the shadows more than what the sensor actually sees, and this most visible in the trees in these pictures, as the pines in the middle picture lose a lot of detail compared to any other phone, also something that happens throughout darker objects of the whole scene.
Here the Pixel 3 achieves nice contrast in the picture, but it’s just a tad darker than how the scene was in reality, with the iPhone XS’s result being much closer to an accurate representation of the actual scene, with many of the competing phones falling in-between these two comparisons in terms of their HDR results.
[ Pixel 3 ]
[ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ]
[ P20Pro ] - [ P20 ] - [ Mate 10Pro ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]
The next scene again we have a good opportunity to compare the super zoom in the Pixel 3 to the results of the Pixel 2: We see again a definitive improvement, but again this is somewhat limited to a 50% in spatial resolution. Beyond this, the optical zoom competition again manages to vastly outpace the Pixel 3 in terms of clarity.
The wide shot here is actually quite tough as we have major shadow-cast in half of the scene, while the top half is sun-lit. For fun and testing, I tested the Night Sight mode in many of the daylight pictures to see if there was any major difference in processing. The one difference I can see is that there’s a change in colour temperature, with the Pixel 3’s auto mode again producing ever so slightly colder images.
The P20 Pro in its 10MP mode clearly has the best dynamic range in the resulting shot, followed by the MIX2S, OP6, and FindX. The Pixel phone’s shots offer very good contrast and are doing very well in bringing out highlights in the dark areas, but this comes at a great cost in terms of very dark shadows nearly clipping into black on many parts of the scene.
Detail-wise, while the Pixel 3 isn’t doing well in the shadows, it is able to outclass many other devices in terms of overall detail in the rest of the scene, and has absolutely no issues with loss of detail on the frame edges, pointing out to a high quality lens.
[ Pixel 3 ]
[ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ]
[ P20Pro ] - [ P20 ] - [ Mate 10Pro ]
[ iPhone XS ] - [ iPhone X ] - [ Note9 ] - [ S9+ ]
[ S8 ] - [ LG G7 ] - [ LG V30 ] - [ OnePlus 6 ]
[ OPPO FindX ] - [ MIX2S ]
The Pixel 3’s tendency to clip shadows to black and just being too under-exposed is again visible in this scene where part of the valley is shadow-cast. Google does excellently in the foreground trees and maintains a great amount of contrast, but other devices just have a significantly better dynamic range in big parts of the picture.
[ Pixel 3 ] - [ Pixel 2 ] - [ Pixel XL ]
[ Mate 20Pro ] - [ Mate 20 ] - [ P20Pro ]
[ P20 ] - [ Mate 10Pro ] - [ iPhone XS ] - [ iPhone X ]
[ Note9 ] - [ S9+ ] - [ S8 ] - [ LG G7 ] - [ LG V30 ]
[ OnePlus 6 ] - [ OPPO FindX ] - [ MIX2S ]
In less demanding lighting conditions, the Pixel phones fare significantly better with shadows, and actually perform very well. A tendency that is continuously present is that Google likes to bring down the sky’s brightness – this could be a reason why dynamic range on the lower end isn’t quite as good as other phones who tend to have brighter or even blown out sky exposures.
In terms of detail, the Pixel 3 is among the top performers – only outclassed by Samsung’s recent Note9 and S9 sensors whose improved deep trench isolation is a step above other phones, and manage to retain much more of the stone’s grain as well as fine details of the statues. Of course, when the lighting conditions allow it, Huawei’s 40MP cameras always win detail wise because of their enormous resolution advantage.
135 Comments
View All Comments
s.yu - Sunday, November 11, 2018 - link
Oh, I don't know what happened to the site but I'm experiencing frequent problems trying to view samples in full size, I see the correct URL when I hover my cursor over the sample but when I shift-click it(any other sample) only the first sample of the group is opened.s.yu - Sunday, November 11, 2018 - link
Correction...it just gets stuck at the first sample of the group that I clicked, if I click say the XS sample then I only get the XS sample, click on another sample and I wouldn't be able to open the full sized version of that in a new tab, the new tab would load the XS sample instead.Impulses - Friday, November 2, 2018 - link
As long as you aren't photographing anything moving... The shutter speeds used will lead to more blurring.Badelhas - Sunday, November 4, 2018 - link
Andrei, didn't Google say that the "Night Shot" feature will eventually come to the Pixel 2? If so, the main advantage is gone, we can just buy a Pixel 2, which is much cheaper...Cheers
s.yu - Sunday, November 11, 2018 - link
There's only one minor issue I'd like to bring up, I don't think Pixel3 clipped more highlight in night mode than Mate20P, all the blue areas are in fact not clipped, only, well, in highlight territory. Only pure white is clipped and from my preliminary examination of the sample with the spotlights illuminating the tree in the center, I'd say Pixel clipped a little less highlight.So I then downloaded the samples to view them in lightroom(the issue I mentioned seems to have been limited to page 7, I'm not having problems on page 8). When checking for clipping with the inbuilt tool I noticed that the Mate20P shot had unnatural readings, the tool only labeled two jagged streaks across the surface of the nearest spotlight, while a proper clipping of something like that should at least look remotely round, so I determined that to be software artifacts and added a slight 5 to the global highlight slider, which would just label whatever looked like pure white on that spotlight as clipped.
On the pixel sample I did the same thing only slightly less, adding 2 to the slider already made pixel's clipping area look properly round(and the same size as Mate20P's). Then I went back to examine the clipping on the tree branches, it was too close to call. So I believe that Pixel and Mate20P retain the same amount (within 1/6 of a stop difference) of highlight DR, only Huawei's algorithm favors aggressively suppressing whatever it has available which Pixel does not.
Adding that to the far superior detail retention I say Pixel's clearly the new night king.
chief-worminger - Friday, November 2, 2018 - link
Hello Andrei,Thank you for the thorough review. I wonder when you say in the battery life section that "SoC efficiency can go either way", do you mean that some 845 chips might be more efficient than some 835 chips, and vice versa? If not can you please clarify?
Andrei Frumusanu - Friday, November 2, 2018 - link
In synthetic tests, the S845 was about equally efficient in terms of energy usage as the S835 - so only minor factors such as software scheduling might push the efficiency in one direction or the other.saleri6251 - Friday, November 2, 2018 - link
Hello Andrei, I remember a few months ago on twitter you mentioned that a lot of people thought the S845 was going to have massive improvements on battery life, but the logic was very flawed. What was the flaw in the logic?Also any hopes for next year when everyone will be on the 7nm chips?
eurico - Friday, November 2, 2018 - link
I'd love to see some Sony phones used in comparisons, I understand that Sony's been lagging a bit behind lately, but still they do have some decent references in battery life and camera performance.Samus - Friday, November 2, 2018 - link
Sony has one of the, if not the best, camera UI. But the phones and sensors leave a lot to be desired.