Camera Architecture & Video Performance

Samsung’s marketing for the S9 is strongly focused on the camera, and indeed that is where we see the most impressive improvements. The Galaxy S9’s new main rear camera sees large changes in the optics while also employing a brand new sensor. The resolution of the new sensor remains at 12MP and the pixel pitch should still be 1.4µm (to be confirmed depending on the exact sensor size). We are talking about a new sensor but Samsung hasn’t disclosed if and what kind of improvements have been made to the pixel array itself.

What has changed is the sensor structure. First launched last year by Sony and implemented in the Xperia XZ’s – the Galaxy S9’s also implement tri-stack sensor structures.

Traditional two-stack sensors are comprised of the pixel array layer (which is the CMOS image sensor itself), and an image signal processing stack which takes care of various pre-processing tasks before the data is forwarded to the SoC’s camera pipelines. The new tri-stack sensor modules introduce a DRAM layer into the mix which serves as a temporary data buffer for readouts from the CMOS sensor pixel array.


Diagram source: Sony Xperia Blog 

As digital cameras lack any mechanical shutter, light exposure to the sensor is constant. What this means for traditional sensors, which have to scan the pixel array line-by-line and forward it to the image-processing layer, is that there is a significant time difference between the first upper left pixel’s exposure and the last lower right pixel’s exposure. This in turn creates the effect of focal plane distortion in fast-moving objects.

The DRAM layer serves as an intermediary buffer. It enables readout of each of each individual pixel ADC value from the CMOS sensor at a much faster rate before forwarding it to the processing layer. While this is not a true global shutter, the enormously faster readout rate is able to very much mimic one in practice.

Samsung uses this for two major advantages: high framerate video recording as well as very fast multi-frame noise reduction.


Super slow-mo capture at 960fps - Apologies for the bad YouTube compression

For the first, Samsung is now able to match Sony’s devices with up to 720p960 high-framerate recording. Other modes available are 1080p240 and 4K60. The S9’s allows up to 0.2s of real-time recording in this high-frame rate mode, which expands for up to 6s slow-motion footage in the resulting recording. Samsung also differentiates itself from Sony’s implementation as it uses “AI” for automatic triggering of the high-framerate capture as it’s able to detect very fast moving objects. We still have to experiment more with the feature before coming to a verdict. The camera also allows for manual triggering – but for the highest framerate bursts correct timing will be critical in capturing the subject.

The second feature enhanced by the new sensor (as well as the SoC imaging pipelines) is the multi-frame noise reduction. Google’s Pixel’s devices and HDR+ algorithm were the first to use a software implementation of this feature. The camera captures a series of short-exposure shots and the individual captures are interpolated into a single image that has less noise. Samsung claims a noise-reduction of up to 30% through this method – in theory this also will improve sharpness as there is less detail lost to algorithmically applied noise reduction, something we’ll have to verify in more thorough hands-on testing.

The new sensor is only part of the improvements to the camera as the module has also seen a very large change in its optics. The maximum aperture of the lens has risen from f/1.7 to f/1.5 which by itself allows for 30% more light to fall onto the sensor.


Aperture change at 960fps

An aperture this high can also lead to overexposure, and also has a very shallow depth of field. For this reason Samsung has pioneered, for the first time in a mobile device, the introduction of an adjustable aperture lens. The S9’s main rear camera is able to switch between a wide f/1.5 aperture and a narrower f/2.4 aperture. The smaller aperture allows for two things: less light in bright conditions, and a deeper depth of field. Arguably the first isn’t a proper reason to switch to a narrower aperture, as unless there are some issues with the sensor or imaging pipeline of if the camera has issues with overexposures for some reason, the more light the better for the shooter.

The second effect of a narrower aperture however is a deeper depth of field. This can have a considerable impact on pictures – especially when considering the maximum aperture of f/1.5 which allows for an incredibly shallow depth of field. In theory this could lead to focusing issues in some scene compositions where you want to have more objects in the plane to be in focus, but being able to switch apertures could be extremely useful and it is a compromise for some of the disadvantages that a wide aperture brings. The S9 only supports switching between f/1.5 and f/2.4 – I suspect that having a more fine-grained control to allow for a more variable aperture would vastly increase complexity of the camera module and the aperture blade actuators.

The Galaxy Note8 introduced dual-cameras for Samsung flagships and the S9 follows suit – sort of. Unfortunately only the bigger Galaxy S9+ employs a secondary camera module equipped with a 2x zoom telephoto lens. The specifications of this module match that of the telephoto camera of the Note8: a 12MP sensor with an f/2.4 aperture lens equipped with OIS. The layout of the cameras does change in comparison to the Note8 as the S9+’s telephoto lens is located between the main camera and the fingerprint sensor in a vertical instead of horizontal arrangement. The software functionality remains the same as that of the Note8.

Video Evaluation

The regular video recording modes of the Galaxy S9 offer a variety of modes reaching up to 4K recording at 60fps. Beyond the addition of an official 4K60 mode, the Galaxy S9 also for the first time offers the option to encode videos in HEVC instead of AVC, which greatly reduces video file sizes.

Depending on the video mode selected the Galaxy S9 select a variety of encoding profiles and bit-rates. The quality of the HEVC encodings should in theory be equal than the equivalent settings on AVC – and in the above table the bit-rate advantage for HEVC is very clear.

Recording Mode AVC / H.264 HEVC / H.265
3840p 60fps High@L5.1 - 71.5 Mbps Main@L5.1 - 41.3Mbps
3840p 30fps High@L5.1 - 48.4 Mbps Main@L5.1 - 28.4Mbps
1080p 60fps High@L4.2 - 28.4 Mbps Main@L4 - 16.3 Mbps
1080p 30fps High@L4 - 14.6 Mbps Main@L4 - 8.5 Mbps

I haven’t had sufficient time to test the video encoding quality of the Galaxy S9 variants in-depth, but above are four excerpts in the most popular modes. The phone did very well in terms of stabilisation, focus response and exposure response. YouTube re-encodes the video so it doesn’t quite make it justice, especially at the higher bitrates.

We’ll follow up with a more in-depth video quality article in the future, as I’ve spent more time focusing on still image evaluation for this article.

Panorama Quality Evaluation

First of all I’d like to go over the methodology for the still image evaluation. We’re posting a very large range of comparison devices for this review from Samsung, Google, Huawei, LG and Apple to serve for the best possible evaluation of not only the Galaxy S9 against its predecessor but also against the existing high-end competition. The comparison included a total of 1144 unsorted shots across all devices and scenarios. Each device took several shots and I filtered them out for their best takes. I also found that to be most fair to the individual processing and exposure types of each device camera to post a variety of capturing modes if warranted, and also multiple exposure types (auto vs manual spot metering) in scenarios which showed differences.

To view the pictures in their full unedited resolutions you can open them by clicking on the link on the thumbnails of each scenario. To change the thumbnails between the devices, you can click in the button list underneath each scenario thumbnail for the respective device. The button label will also contain a short description of the photo type – either capturing mode or metering mode. There are also associated galleries for each scenario, but due to limitations in our CMS that might not be the best way to browse quick phone-to-phone comparisons.

The Galaxy S9 captures were done on the Exynos variant as I had already finished the full camera comparison before I received a Snapdragon variant. I’m not expecting large differences as Samsung traditionally tunes both variants very closely. I will follow-up with a dedicated article if I find notable differences.

Click for full image

Galaxy S9  ] - Galaxy S8  ] - Galaxy S7  ] - Pixel 2 XL  ] - Pixel XL  ]
P10  ] - Mate 9  ] - Mate 10  ] - G6  ] - V30   ]
iPhone 7  ] - iPhone 8  ] - iPhone 8 Plus  ] - iPhone X  ]

Starting off with an evaluation of the panorama modes of each device we see that the Galaxy S9 provides a significant upgrade over the Galaxy S8 as it maintains a wider dynamic range and constant exposure in this very difficult scenario against the overhead sun in the middle of the panorama. It’s especially the colour balance consistency that is very visible against the S8. The Galaxy S9 also manages to capture more detail than the S8, either through the new lens system and sensor or through the new processing which does less sharpening. Samsung goes quite overboard in terms of file size as the S7 to S9 all generate 37-40MB images that I had to recompress without noticeable loss in order to upload onto our CMS.

The S9 doesn’t really have proper competition here as other phones have noticeable drawbacks. The iPhones, while providing an image with more contrast, also have to make due with heavier processing that loses out on details. They also lack in dynamic range compared to the Galaxy S9 and partly the S8 as features in the dark part of the valley are essentially not picked up at all. The LG V30 does well and posts better colour temperature than the G6 – but both seem to underexpose the scene a bit too much. Among Huawei’s devices the Mate 10 goes a very good job in terms of dynamic range but again like LG it ends up with a rather darker image than I had preferred.

One of these devices is not like the other and that’s the Pixel 2 XL which does an extreme amount of HDR processing on the shot. Google here tries to extract the maximum amount of detail, and while it looks intriguing in the thumbnail, it looks quite fake when looking closer up. It’s also visible that this isn’t a true high dynamic range shot from the sensor as the camera doesn’t pick up details such as the stairs in the dark part in the middle of the valley.

Battery Life - A Stark Contrast Camera - Daylight Evaluation
Comments Locked

190 Comments

View All Comments

  • peevee - Friday, April 6, 2018 - link

    Essential 2?
    Given small real-life difference between 845 and 835, Essential PH-1 is still a great device. And very appropriately priced. Nothing to wait there.
  • StrangerGuy - Tuesday, March 27, 2018 - link

    All the S9 did was made me appreciate my S8+ more, of which I only bought because of generous employer benefits. Without which I wouldn't even have cared about these overpriced flagships.
  • Valantar - Tuesday, March 27, 2018 - link

    I pointed this out in your S9 launch article, and apparently I have to make my point again: neither light nor depth of field is the reason for the aperture change - it's purely to combat distortions and lack of sharpness in the image due to the combination of a large aperture and tiny, tiny glass.

    Why? When it comes to depth of field, one needs to factor in not only the aperture, but also the crop factor (sensor size relative to standard 35mm film). As such, f/1.5 on a standard cell phone 1/2.3" sensor is roughly equal to f/8.4 on a 35mm sensor, or f/5.6 on an APS-C sensor. This is one of the main photographic advantages of large-sensor cameras: that you can get shallow depth of field with lenses that are actually possible to manufacture.

    An example: https://dofsimulator.net/en/?x=EAyAeuF3AAAIJEwkAAA...
    As you can see here, with a 1/2.3" f/1.5 sensor, focusing on a subject 3m away gives you an in-focus area of ~43m - this is NOT too little, not by any measure. Moving the subject to 5m gives you effectively infinite focus, with everything from 1.9 to infinity being in the focal plane. You'd need your subject at less than .5 meters for DoF to be an issue - which it would be with most cameras at that distance.

    On the other hand, it's well known that for large apertures, anything but the best glass will lead to aberrations and distortions in the image, and a general loss of sharpness across the frame. Look at even a single DSLR lens review - they're _always_ sharper when stopped down. With a lens stack this tiny, there's no feasible way to control this - it's likely physically impossible to avoid aberrations and distortions at an aperture number like this. Hence, the variable aperture.

    Now, AT is usually very accurate in their reporting. Could you PLEASE correct this? Pretty please? Since you claim to be doing a deep-dive into the camera, this is not a good look.
  • Valantar - Tuesday, March 27, 2018 - link

    To clarify: You say that "The F/2.4 aperture in day-light shots is not a gimmick and very much an advantage to the S9 as its deeper depth of field is noticeable in shots, producing sharper images than the F/1.5 aperture." This is a misunderstood conclusion. The added sharpness is largely not due to a deeper depth of field, but rather due to the stopped-down aperture resulting in a generally sharper image. This conflates two different characteristics, focus depth and lens/optical sharpness. These are not the same. If you did a more rigorous test where both cameras focused on the same spot (ideally not in the centre of the image) in a scene with sufficient depth, or conversely shot against a flat target with a lot of detail, you'd likely see this pretty clearly, as _even the focal point_ would be sharper at f/2.4. If this was due to depth of field, both settings would be equally sharp at the focus point, while what you're saying here is that f/2.4 is sharper _across the image_. That's a typical effect of a smaller aperture improving sharpness, not of the smaller aperture restricting DoF.
  • peevee - Friday, April 6, 2018 - link

    " _even the focal point_ would be sharper at f/2.4"

    If it is the center, it might not be so because with such tiny sensor, at f/2.4 maximum resolution is diffraction-limited. Need the exact size of the sensor to confirm, but I am almost sure than even at f/1.5 Airy disk is bigger than a pixel.
  • Takethis - Tuesday, March 27, 2018 - link

    Any chance they Samsung could fix their “slow-and-steady” DVFS approach with software updates? Given the actual state of things, Snapdragon 845 phones are the one to buy this year (I'm thinking Oneplus 6)
  • Ankurg - Tuesday, March 27, 2018 - link

    With due respect to the author and the site, I have to believe that most of the extensive tests and their results will not affect the avg day-to-day usage of this device.

    I am already seeing the panic this review has created on reddit, with many people now re-thinking whether to purchase or not...

    Yes, most youtube/site reviewers don't go as deep as this, but a problem so steep would have been felt.

    I would advice my fellow mates here not to lose sight of the fact that this is the best android phone you can buy right now.....irrespective of the choice of chip.
  • SirCanealot - Tuesday, March 27, 2018 - link

    "With due respect to the author and the site, I have to believe that most of the extensive tests and their results will not affect the avg day-to-day usage of this device."

    While I'm happy to have a super-fast phone with crappy battery life, I'm not happy to have an average-speed phone with crappy battery life. IE, I have a Exynos Note 4 which is fast with crappy battery life and it still does the job...

    The crappy battery life is going to effect every single user and every one of your friends in America is going to get a better performing phone with better battery life. Day-to-day I'm getting worse performance and battery life; this means I can re-consider my options now I have all the data.

    Why shouldn't this review make you reconsider? That's what it's meant to do. Unless you're a Samsung shareholder, I wouldn't pay any attention to this completely normal thing of human society...
  • id4andrei - Tuesday, March 27, 2018 - link

    The author himself stated that you will not see any difference as an ordinary consumer. Some slight circumstantial scrolling stutters are all he noticed.

    Still the Exynos underperforms relative to its advances in chip design.
  • peevee - Friday, April 6, 2018 - link

    "The author himself stated that you will not see any difference as an ordinary consumer."

    Nope. The fast core only winding up after 0.4s is VERY noticeable as good phones will already finish launching an app or rendering a local HTML in Webview by this time, some time ago.

Log in

Don't have an account? Sign up now