Camera - Daylight Evaluation

Continuing on with more traditional comparison shots we’re off for a tour around a few scenic shots.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ] - [ Pixel 2 XL ]
[ Pixel XL ] - [ P10 ] - [ Mate 9 ] - [ Mate 10 ]
 [ G6 ] - [ V30 ] - [ iPhone 7 ] - [ iPhone 8 ]
[ iPhone 8 Plus ] - [ iPhone X

In the first location there’s something very obvious about the Galaxy S9 over its predecessor: we find a lot less processing in the resulting image. The S9 lacks the contrast of the S8 which I think it would have needed it, however this is counteracted by the much more natural look of the trees in the S9. There’s a lot less sharpening on the Galaxy S9 which in this scenario is a good thing as the camera sensor is able to catch even one pixel wide tails such as tree branches. The S9 also seems to have less chromatic aberrations – this is most visible on the outer edges of the picture such as on the right tree or the far crane on the horizon.

The iPhones again offer a more picture with better contrast, however the processing makes a mess of details throughout the picture. Colour balance aside, the new iPhones make quite a mess of the texture of the grass. The Pixel 2 in basic mode does a good job of colour tones but lacks details and blows out the sky. This is solved in HDR+e mode, however I find the processing to be a bit too exaggerated again, especially on the trees. The Mate 10 does good in its normal mode, but even at 20MP resolution it doesn’t capture as much detail as the S9 & S8. In HDR mode the picture is just far too dark. The LG V30 does a very good job in creating a very pleasing exposure and tone for the image and is among the best devices in this scenario, however when it comes to detail its 16MP sensor seems to be able to actually catch less than the 12MP shooters from Samsung and Apple.

Overall the trend here is that the Galaxy S9 sees significant upgrades in terms of ability to capture detail and natural sharpness. I find that the S9 lacked just a touch of contrast but otherwise it offers the best quality image.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ] - [ Pixel 2 XL ]
[ Pixel XL ] - [ P10 ] - [ Mate 9 ]
[ Mate 10 ] - [ G6 ] - [ V30 ] - [ iPhone 7 ]
[ iPhone 8 ] - [ iPhone 8 Plus ] - [ iPhone X

The Galaxy S9 fared well in the first comparison, but this second one doesn’t end up that well. Among the series of shots I captured on the S9 in this view I had the phone do some pictures with an automatic F/1.5 and then an F/2.4 aperture setting. The difference between the two shots was enormous. The F/1.5 was overall very good but the F/2.4 shot is outright horrible. The difference between the two shots was a 1/2128s vs a 1/471s exposure. The F/2.4 vastly overexposed the scene and had to rely on HDR processing to bring down the levels, resulting in an overall image with much less natural dynamic range. The trees in the picture particularly suffer.

The iPhones also tend to behave the same by applying the more visible HDR processing which I don’t think works that well in this scenario. Huawei and especially LG do a lot better in terms of exposure, and the V30 provides overall one of the best shots here, as even though it sharpens more than the S9, the bigger resolution sensor does seem to capture more overall detail, especially on the brickwork of the bridge. The Pixel’s processing comes in too strong here and isn’t nearly as natural as the LG and Samsung phones.

The S9 using such different processing between its automatic F/1.8 and F/2.4 modes seems problematic in terms of shot consistency, so while the camera can do good shots, you’ll need to ensure it actually does so, which is a big minus in terms of experience.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ]
 [ Pixel 2 XL ] - [ Pixel XL ] - [ P10 ]
[ Mate 9 ] - [ Mate 10 ] - [ G6 ] - [ V30 ]
[ iPhone 7 ] - [ iPhone 8 ] - [ iPhone 8 Plus ] - [ iPhone X ]

The next and last scenic scenario is again very challenging in terms of daylight exposure. Here nearly all phones produced different results depending on the metering mode. I provided shots in simple point & shoot mode which resulted in centred or pattern metering, and as well spot metered on the same spot of the abbey roof to compare how they fare.

While the Galaxy S7 and S8 had huge differences in dynamic range between the two metering modes and their resulting HDR processing, the S9 is more consistent between the two modes, with only bringing out a bit more of the shadows in the spot metered shot. I apologise for the large lens flare on the S9 – I hadn’t noticed it until sorting out the pictures on the PC.

Taking the spot metered shot of the S9 as the better variant, it is hard to compare against the S8 as the latter does far better in shadow detail in its spot metered shot, however loses out in blown highlights and natural detail because of higher sharpening processing. Compared to the S8’s centre metered shot the S9 actually does better in retaining detail in the shadows, especially in the front. I wonder if the increased detail on the S9 here is actually a direct effect of the deeper depth of field of the F/2.4 mode aperture as objects along the river bank and even the foreground right side rocks, as well as the horizon are very sharp compared to the S8 where it has to choose between what it focuses on.

In terms of exposure while the S9 is very bright again, the S8’s centre shot is a lot more natural in terms of tones and far more representative, so like in the last scenario, the S9 seems to overexpose at a 1/391s exposure while the S8 uses a 1/3480s exposure. Had the S9 used a slower exposure it wouldn’t have needed as much processing to bring down the levels back to where they should be.

The new iPhones can’t retain as much detail along the whole focal field as the S9, however they do a noticeably better job in terms of exposure and tones, beating the S9 in retaining shadow detail. The Pixel phones differed wildly depending on capturing and metring mode, the shots with the best detail I feel lacked brightness on the Pixel 2 XL compared to say the Pixel XL’s HDR+ shot. The LG V30 has good exposure however a too warm tone compared to the other phones and its sibling the G6. The V30 doesn’t seem to have a sharpness advantage due to its 16MP sensor here and loses out in detail to the G6 and Samsung and Apples phones.

Overall the S9 is able to retain the most amount of detail, likely thanks to the high aperture lens and lack of artificial sharpening, however the S9 doesn’t do as well in terms of tones and exposure. Here I think the new iPhones did a better consistent job. The Pixel 2 and Pixel can also do a good job in terms of exposure, but especially on the Pixel 2 you have to hit the mark in terms of settings.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ] - [ Pixel 2 XL ]
[ Pixel XL ] - [ P10 ] - [ Mate 9 ]
[ Mate 10 ] - [ G6 ] - [ V30 ]
[ iPhone 7 ] - [ iPhone 8 ] - [ iPhone 8 Plus ] - [ iPhone X ]

The next shot is a more medium range shot. Here again the Galaxy S9 does an excellent job at retaining detail and has overall the sharpest shot out of all devices by what I think is a noticeable margin, with only the Pixel 2 XL coming in at a close second.

Exposure wise I think the Galaxy S9 suppressed the high-lights a bit too much here and actually produces less dynamic range than the S8 and other phones. Looking at the EXIF data again the S9 exposes for longer – although the difference here isn’t as dramatic as in previous shots as is in line with the aperture difference. The shop sign in particular is too toned down compared to how it really was, which is visible on the shots of the other phones.

Overall the S9 did well and wins in detail but loses out in overall tones compared to the S8, Pixel 2, LG’s and iPhones so the end result might be a choice of preference depending what you value more.

I want to add that I encountered an interesting phenomenon among the V30 shots here. I caught the phone actually using its wide angle camera in a cropped fashion in auto mode. In terms of exposure and tones this resulted in a very close image to the main camera sensor, however it’s blatantly visible once you open the full resolution shots that there’s a world of different in resolution and detail. I didn’t encounter this again on the V30 but the fact that it happened is odd as one would think the software would be hard-coded to prevent this from happening.

Click for full image

Galaxy S9  ] - Galaxy S8   ] - Galaxy S7    Pixel 2 XL   
Pixel XL   ] - Mate 9   ] - Mate 10   ] - G6    ]
V30    ] - iPhone 7  ] - iPhone 8  ] - iPhone 8 Plus   
iPhone X   

The next scene is a darker day-light scenario still testing out detail and dynamic range. The Galaxy S9 provided the brightest image out of all phones in this comparison. While the S9 really manages to bring out lots of detail out of the shadows and seemingly has a very wide dynamic range, the overall result is less representative of the actual scene than other phones. Backing off on the exposure might have been a good thing for the S9.

The V30, iPhone8 and Pixel 2 XL provided the best overall average exposures of the scene although there’s obvious difference in the shadows between these phones. The Pixel was in my opinion too cold in terms of temperature and the LGs and Samsungs provided a warmer scene. The iPhone 8 falls in-between in terms of colour tone and likely is a bit more natural if you ignore exposure differences.

Which phone does the better results is going to be subjective depending on preference. The Pixels, iPhone 8’s and the S9 have the most dynamic range although the latter can be considered too bright. The Mate 10 HDR, S8, S7 and LG phones offer better natural exposure and softer, warmer tones.

The iPhone X’s picture is different because a cloud had come into the scene, so it’s not a valid comparison and should be ignored.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ]
[ Pixel 2 XL ] - [ Pixel XL ] - [ P10 ]
[ Mate 9 ] - [ Mate 10 ] - [ G6 ] - [ V30 ]
[ iPhone 7 ] - [ iPhone 8 ] - [ iPhone 8 Plus ] - [ iPhone X ]

To better demonstrate the difference between the two apertures in terms of depth of field, we result to macro shots where the difference is best showcased. The subject here is a tree stump with some leaves and moss – also a good subject in terms of detail.

To manually switch between the apertures, you have to use the Pro mode on the Galaxy S9. Here among the exposure settings you’ll find a switch allowing you to change between the apertures. The S9 does a really good job at maintaining the same overall picture exposure between the two aperture modes. In this shot the difference between the apertures and depth of field is also very visible as the F/2.4 mode allows for more of the scene to be in focus, while the F/1.5 aperture results in a more pronounced bokeh blur in the foreground and background.

Because the close-up scene is very sensitive based on the lens configuration we do get quite varied results between all the phones. The Galaxy S9 gives a pleasing picture in terms of contrast and colour balance. The iPhones did far too warm colour temperatures which don’t represent the scene well at all. The Pixels do a very good job in bringing out details out of the highlights but I feel’s it a tad too dark compared to the scene which was in direct sunlight. Overall it’s not a great scene to make judgements on but rather to showcase the differences between the depth of field of the phones.

Click for full image

[ Galaxy S9 ] - [ Galaxy S8 ] - [ Galaxy S7 ]
 [ Pixel 2 XL ] - [ Pixel XL ] - [ P10 ]
[ Mate 9 ] - [ Mate 10 ] - [ G6 ] - [ V30 ]
 [ iPhone 7 ] - [ iPhone 8 ] - [ iPhone 8 Plus ] - [ iPhone X ]

The next shot is going to be very challenging for all phones as it stresses the exposure and colour calibrations of the cameras. There’s also a very wide dynamic range between the shadows and bright sun lit spots of the picture.

The Galaxy S9 here fell flat on its face and was just unable to get a reasonable exposure not matter how many times I tried. The S8, S7, Huawei phones and the G6 were the ones who were able to most accurately represent the lightning of the scene while still preserving shadows and highlights.

The V30 regressed compared to the G6 as it blew out the highlights of the flowers. The Pixel 2 XL did well in preserving the dynamic range in the petals, however lacked sharpness. The HDR+e returned a lot of detail however toned down the highlights too much while having too dark shadows. The Pixel XL fared a bit better than its newer sibling. The iPhones by default were too dark and the processing lost almost all the highlights from the flower petals.

Click for full image

[ Galaxy S9 ]
[ Galaxy S8 ] - [ Galaxy S7 ] - [ iPhone 8 Plus ]

I was so disappointed with the results of the S9 here that I tried to retake some shots and see what is needed to replicate the much better results of the S8.

Again in full auto mode the S9 produced an extremely overexposed yet flat image, being consistently off the mark. While still in auto mode I changed the exposure compensation to its lowest settings and it helps regain some dynamic range. It’s not until we switch to Pro mode that the S9 finally manages to shed off the heavy processing and far too long exposures of the Auto mode. This is where it managed to get closest to the S8 result, but still fell short in terms of shadow contrast. On the other end of the spectrum using maximum exposure compensation on the iPhone 8 resulted in regaining a lot of the lost highlights, and colour tones aside, it's much closer to what it should be.

This last shot again served as a good example of the advantage of the F/2.4 aperture option on the S9 as the small aperture resulted in a noticeably sharper and more in focus image both in front and behind the focus object.

Overall the Galaxy S9’s camera has two distinct characteristics: great overall detail and sharpness, and a large tendency to have issues with exposure. In terms of detail the Galaxy S9’s new sensor really shines and is able to get what I could call the most pixel-perfect shots among smartphones today. Samsung’s decision to tone down sharpening is very visible in the resulting pictures and produces a more natural look. The F/2.4 aperture in day-light shots is not a gimmick and very much an advantage to the S9 as its deeper depth of field is noticeable in shots, producing sharper images than the F/1.5 aperture.

What the Galaxy S9 isn’t good at is exposure. Too often did I see the camera overexposing shots and then try to compensate with too much HDR processing to bring the highlights back down, resulting in overall flatter images in some cases. The Auto mode seems suspiciously prone to this while the Pro mode was much closer to the S8’s overall better and consistent exposure decisions. Particularly the issues with the flower scene gave me a bad opinion of the S9’s camera – Samsung needs to work on tuning its exposure algorithms and give users a more consistent experience as right now with the current settings it lags behind the S8 and competition. That being said, when the S9 does manage to get a good exposure, its advantages in detail put it at the top of smartphones cameras when it comes to quality.

Camera Architecture & Video Performance Camera - Low Light Evaluation
Comments Locked

190 Comments

View All Comments

  • peevee - Friday, April 6, 2018 - link

    Essential 2?
    Given small real-life difference between 845 and 835, Essential PH-1 is still a great device. And very appropriately priced. Nothing to wait there.
  • StrangerGuy - Tuesday, March 27, 2018 - link

    All the S9 did was made me appreciate my S8+ more, of which I only bought because of generous employer benefits. Without which I wouldn't even have cared about these overpriced flagships.
  • Valantar - Tuesday, March 27, 2018 - link

    I pointed this out in your S9 launch article, and apparently I have to make my point again: neither light nor depth of field is the reason for the aperture change - it's purely to combat distortions and lack of sharpness in the image due to the combination of a large aperture and tiny, tiny glass.

    Why? When it comes to depth of field, one needs to factor in not only the aperture, but also the crop factor (sensor size relative to standard 35mm film). As such, f/1.5 on a standard cell phone 1/2.3" sensor is roughly equal to f/8.4 on a 35mm sensor, or f/5.6 on an APS-C sensor. This is one of the main photographic advantages of large-sensor cameras: that you can get shallow depth of field with lenses that are actually possible to manufacture.

    An example: https://dofsimulator.net/en/?x=EAyAeuF3AAAIJEwkAAA...
    As you can see here, with a 1/2.3" f/1.5 sensor, focusing on a subject 3m away gives you an in-focus area of ~43m - this is NOT too little, not by any measure. Moving the subject to 5m gives you effectively infinite focus, with everything from 1.9 to infinity being in the focal plane. You'd need your subject at less than .5 meters for DoF to be an issue - which it would be with most cameras at that distance.

    On the other hand, it's well known that for large apertures, anything but the best glass will lead to aberrations and distortions in the image, and a general loss of sharpness across the frame. Look at even a single DSLR lens review - they're _always_ sharper when stopped down. With a lens stack this tiny, there's no feasible way to control this - it's likely physically impossible to avoid aberrations and distortions at an aperture number like this. Hence, the variable aperture.

    Now, AT is usually very accurate in their reporting. Could you PLEASE correct this? Pretty please? Since you claim to be doing a deep-dive into the camera, this is not a good look.
  • Valantar - Tuesday, March 27, 2018 - link

    To clarify: You say that "The F/2.4 aperture in day-light shots is not a gimmick and very much an advantage to the S9 as its deeper depth of field is noticeable in shots, producing sharper images than the F/1.5 aperture." This is a misunderstood conclusion. The added sharpness is largely not due to a deeper depth of field, but rather due to the stopped-down aperture resulting in a generally sharper image. This conflates two different characteristics, focus depth and lens/optical sharpness. These are not the same. If you did a more rigorous test where both cameras focused on the same spot (ideally not in the centre of the image) in a scene with sufficient depth, or conversely shot against a flat target with a lot of detail, you'd likely see this pretty clearly, as _even the focal point_ would be sharper at f/2.4. If this was due to depth of field, both settings would be equally sharp at the focus point, while what you're saying here is that f/2.4 is sharper _across the image_. That's a typical effect of a smaller aperture improving sharpness, not of the smaller aperture restricting DoF.
  • peevee - Friday, April 6, 2018 - link

    " _even the focal point_ would be sharper at f/2.4"

    If it is the center, it might not be so because with such tiny sensor, at f/2.4 maximum resolution is diffraction-limited. Need the exact size of the sensor to confirm, but I am almost sure than even at f/1.5 Airy disk is bigger than a pixel.
  • Takethis - Tuesday, March 27, 2018 - link

    Any chance they Samsung could fix their “slow-and-steady” DVFS approach with software updates? Given the actual state of things, Snapdragon 845 phones are the one to buy this year (I'm thinking Oneplus 6)
  • Ankurg - Tuesday, March 27, 2018 - link

    With due respect to the author and the site, I have to believe that most of the extensive tests and their results will not affect the avg day-to-day usage of this device.

    I am already seeing the panic this review has created on reddit, with many people now re-thinking whether to purchase or not...

    Yes, most youtube/site reviewers don't go as deep as this, but a problem so steep would have been felt.

    I would advice my fellow mates here not to lose sight of the fact that this is the best android phone you can buy right now.....irrespective of the choice of chip.
  • SirCanealot - Tuesday, March 27, 2018 - link

    "With due respect to the author and the site, I have to believe that most of the extensive tests and their results will not affect the avg day-to-day usage of this device."

    While I'm happy to have a super-fast phone with crappy battery life, I'm not happy to have an average-speed phone with crappy battery life. IE, I have a Exynos Note 4 which is fast with crappy battery life and it still does the job...

    The crappy battery life is going to effect every single user and every one of your friends in America is going to get a better performing phone with better battery life. Day-to-day I'm getting worse performance and battery life; this means I can re-consider my options now I have all the data.

    Why shouldn't this review make you reconsider? That's what it's meant to do. Unless you're a Samsung shareholder, I wouldn't pay any attention to this completely normal thing of human society...
  • id4andrei - Tuesday, March 27, 2018 - link

    The author himself stated that you will not see any difference as an ordinary consumer. Some slight circumstantial scrolling stutters are all he noticed.

    Still the Exynos underperforms relative to its advances in chip design.
  • peevee - Friday, April 6, 2018 - link

    "The author himself stated that you will not see any difference as an ordinary consumer."

    Nope. The fast core only winding up after 0.4s is VERY noticeable as good phones will already finish launching an app or rendering a local HTML in Webview by this time, some time ago.

Log in

Don't have an account? Sign up now