Camera Architecture: Huge New Sensors

As we move on to the camera evaluation of the S20 series, I think it would be good to recap the new sensor architectures that Samsung is deploying in its new flagships. To say that this is the biggest camera hardware upgrade that Samsung has ever embarked on is a bit of an understatement, as the new modules on the S20 series, and in particular the S20 Ultra, have seen some fundamental shifts in terms of their designs and specifications.

Samsung Galaxy S20 Series Cameras
  Galaxy S20 Galaxy S20+ Galaxy S20 Ultra
Primary Rear Camera 79° Wide Angle
12MP 1.8µm Dual Pixel PDAF



 
79° Wide Angle
108MP 0.8µm DP-PDAF


3x3 Pixel Binning to 12MP
8K24 Video Recording
fixed f/1.8 optics
OIS, auto HDR, LED flash
4K60, 1080p240, 720p960 high-speed recording
Secondary
Rear Camera
76° Wide Angle
(Cropping / digital zooming telephoto)
64MP 0.8µm

F/2.0 optics, OIS

8K24 Video Recording
24° Telephoto
(5x optical magnification)
48MP 0.8µm

2x2 Pixel Binning to 12MP
F/3.5 prism optics, OIS
Tertiary
Rear Camera
120° Ultra-Wide Angle
12MP 1.4µm f/2.2
Extra
Camera
- Time of Flight (ToF) 3D Sensor

Starting off with the elephant in the room, that’s the new S20 Ultra. Last year we first saw talk of Samsung LSI introducing a new 108MP camera sensor that had been developed in collaboration with Xiaomi. Although closely related to that design, the HM1 sensor is a bit different to the HMX sensor that’s employed in the Xiaomi phones. What’s special about these new sensors is their sheer size: at 1/1.33”, it’s over double the sensor area of previous generation units found in past Galaxy phones. A lot of people will criticize the 108MP count as being a gimmick, but in light of the huge new sensor the actual pixel pitches aren’t exactly all that smaller than what we’ve seen from previous generation high-megapixel sensors from the last year or two, still falling in at 0.8µm.

Source: TechInsights

What’s rather peculiar about the HM1 sensor in the S20 Ultra though is that this isn’t just another quad-Bayer sensor like those seen in other designs over the year, but rather a “Nonacell” design, with the color filter array covering up 9 subpixels. Just like quad-Bayer designs, the new nona-Bayer  sensor is able to demosaic chroma information to be able to actually achieve the advertised 108MP resolutions. Physically, chroma resolution still is only 12MP on the sensor, and that’s something that you’ll want to keep in mind when we’ll later on investigate the 108MP samples of the phone.


Source: iFixit

As seen in the above teardown shot, the 108MP unit dwarfs the other sensors in the phone, but this does come with some complications. On the optics side, Samsung has now opted for a fixed f/1.8 aperture and has dropped the dual-aperture f/1.5-2.4 system we’ve seen on the S9 and S10 series. Because the new sensor is so huge, it actually becomes an issue to design proper optics that actually fit into the z-height of the phone. Even though the S20 Ultra has a thick camera bump now, it still has to make do with a smaller aperture optical lens than previous generations. The new bigger sensor also has another side-effect, that being a shallower depth of field when focusing on objects. I do find it a very big pity that Samsung opted to drop the dual-aperture system as that would have been the perfect fit for such a big sensor design and essentially eliminate any potential drawbacks on the optics side. Unfortunately, as it’s gone, I do expect the optics to not perform quite as optimally as we’ve seen on the S10 series.

Below the 108MP sensor, we find another unique design that’s exclusive to Samsung at this moment, and that’s the new periscope design telephoto module. Such modules were pioneered by Huawei as we first saw the P30 Pro last year bring it to the mass market, however Samsung goes way beyond what any other vendors is currently brining to the market. The optical magnification of Samsung’s design isn’t too special, only reaching a factor of 4x and a resulting 24° field of view or 103mm equivalent focal length. What is special though is that Samsung has crammed in a full 48MP IMX586 into the module, going far beyond the smaller 12 or 8MP sensors that are being deployed by other vendors such as Huawei. It’s the usage of such a big sensor that lies perpendicular to the body of the phone that actually forces the S20 Ultra to have such a huge camera bump on the back – as it’s being limited by the thickness and the footprint of the telephoto camera module.

To square off the trio of cameras on the S20 Ultra, we see a new ultra-wide-angle module. Samsung here opted to go for a lower megapixel count sensor at 12MP compared to 16MP on the S10 series, but the pixel pitch increases from 1.0µm to 1.4µm, which should allow it go achieve better per-pixel sharpness and low-light capturing abilities. It remains quite wide at a 120° viewing angle, just a tad tighter than 123° unit on the S10 series.

When looking at the different viewing angles of the S20 Ultra, we see some big discrete steps between what the different sensors are able to natively capture at their fullest. The main sensor on the S20 Ultra is actually a tad wider than what Samsung is marketing, and it produces 25mm equivalent focal length images, a little wider than the 26mm of the S10 series and the other S20 phones. Of course, the telephoto lens will have a small field of view of only 24°, but that’s precisely what allows it to achieve such high magnification levels, also thanks to the high resolution captured within this frame.


Source: ITSub

While the S20 Ultra’s camera design is fascinating, the design that actually excited me a lot more when the phones were first introduced is the camera trio that’s found on the regular S20 and S20+. Here Samsung is using a completely different approach that’s pretty much unique in the industry.

Starting off with the main sensor, this is seemingly a pretty straightforward design that really only differentiates itself through the fact that’s it’s now a bigger sensor falling in at 1/1.76”. The resolution still is 12MP and it’s a regular Bayer sensor, so pixel pitches now grow to 1.8µm. The optics remain similar to the S20 Ultra’s, coming with a fixed f/1.8 aperture lacking the dual-aperture system and of course also includes OIS. The Ultra-Wide-Angle is also the same as on the S20 Ultra.

What’s really exciting about the S20 and S20+ is the “telephoto” module. The weird part is that this isn’t a telephoto module at all, but it’s an actual secondary wide-angle lens that’s only slightly tighter than the main camera. The sensor here is also large at 1/1.76”, but it comes a 64MP resolution with 0.8µm pixels. I actually haven’t heard confirmation of the color filter array of the unit, whether it’s quad-Bayer with remosaic or whether it’s a true 64MP Bayer sensor.

Why Samsung is able to call this a 3x telephoto module is that when cropping a 1:1 12MP picture out of it, it does end up at a 3x magnification in relation to the main camera sensor. The question you’re of course posing, is why would Samsung go for such a camera configuration? The first answer, possibly the most obvious one, is 8K video recording. As the main camera unit’s 12MP native resolution isn’t sufficient for 8K video recording, Samsung needed to find a way to include this into the regular S20 series as well – and obviously if you had an actual telephoto module for this then you’d end up with a pretty useless setup. Going for a secondary wide-angle module kills two birds with one stone, as you have one module being able to serve as the 8K video recording unit as well as taking advantage of the high-megapixel count of the unit to be able to achieve respectable crop-zooming.

I was most excited about this setup, more-so than that of the S20 Ultra, because it opens up a lot of possibilities in terms of sensor fusion and computational photography that’s physically just not possible on the S20U. Without spoiling the camera evaluations too much, this also means that the S20 and S20+ have quite high quality zoom capabilities in the 1-3x range as well, and it doesn’t behave as a “normal“ telephoto module at these intermediate levels.

Battery Life: Good (60Hz) to Average (120Hz) Camera: Daylight Evaluation
Comments Locked

137 Comments

View All Comments

  • MAGAover9000 - Tuesday, April 7, 2020 - link

    I have the s10+. Fantastic device. Very happy
  • id4andrei - Friday, April 3, 2020 - link

    No need for me to praise this review any longer. Still, I must nitpick. The 3dmark GPU test always has caveats in your reviews. Drop it if you feel it is detected by OEMs or it's a false GPU test like the physics one.

    On web tests. I read on wiki that JetStream is an Apple made test, literally. Wouldn't you say that's a big caveat when testing against ios? Similarly Speedometer is developed by the webkit team at Apple. With Android webview based on Blink, not webkit, wouldn't Android smartphones be at a disadvantage against iphones? I don't see Kraken(Firefox) or Octane(Google) being used.

    Kraken would actually be neutral to both. Other 3rd party tests might be Testdrive(Microsoft) or Basemark.
  • Andrei Frumusanu - Friday, April 3, 2020 - link

    I don't think that the fact that the WebKit team made those tests is a valid argument against using them. You can go and read the source JS yourself if you wish, and they're industry accepted benchmarks. Both Kraken and Octane are ancient and outdated and we dropped them just like we dropped SunSpider of the early days.
  • id4andrei - Friday, April 3, 2020 - link

    Thank you for the prompt answer.
  • s.yu - Friday, April 3, 2020 - link

    Thank you Andrei, again the most comprehensive and reliable set of samples anywhere!
    There seems to be considerable sample variation again (last time with Samsung was the main module since S9 with the variable aperture) in the UWA, S20+E and S20UE should have absolutely identical UWA performance but the S20UE seems to have far worse sagittal resolution than the S20+E, and Samsung's processing isn't that good in the first place, considering the 12MP 1.4μm could produce incredibly sharp pictures as that been the specs of the Pixels' main module for generations.
    I don't regret their switch to f/1.8 because the old module that went up to f/1.5 wasn't sharp wide open, especially in the corners, but a further two stops' variation to f/3.3 could be useful for more DoF in closeups provided inserting that physical aperture into the tiny module doesn't compromise the optical design otherwise.
    This time around the E seems to generally outperform the S, except in color as E doesn't seem to have proper color fidelity...almost as if chroma NR is set too high even in broad daylight, and the "hybridization" of the digital zoom, in which the E clearly uses a smaller portion from the periscope's readout than the S in the resulting merge. Speaking of the zoom, S20+ still performs slightly worse at 2x(16MP readout) than S10's native 12MP, though the difference is small and could be down to lens variation. Considering S10U's Z height, they could've easily fixed the S20U like Xiaomi, going 1/2.3" f/2 12MP with the 2x. Xiaomi used it despite a 4-1 bin, all the more reason to use it with a 9-1 bin. S20U's corner performance at 3x would also be much improved.
    Regarding the comparison with the Fuji though, I suspect your unit has trouble focusing to infinity correctly, because the train and forest samples show clear superiority of the Fuji's zoom. I especially recognize that kind of slight haziness as being very responsive to dehaze and low radius sharpening in LR and would result in far more detail with extraction in post. Also, with an ILC, there's always stopping down a little for more sharpness and more DoF.
    Regarding the full res modes, it's not worth storing 108MP of data with the CFA asking for a 9-1 bin, of course the 64MP would be better, without the RAW it's hard to say for sure, but the 64MP seems to be quad bayer.
  • s.yu - Friday, April 3, 2020 - link

    I don't agree with your remark about the night comparison with Mate30P though, the UWA is not "UW" so it has better image quality, that's true, and the night mode of the Mate30P is far superior, that's also true, but not auto mode, nor any aspect of the telephoto as it's clearly using a crop of the main for 3x. Samsung does attempt to use the 4x for telephoto and although there's a significant issue of chroma noise, it's far sharper than Mate30P's crop, with at least twice 3 times the effective resolution in night mode. With S20U you could also crop out a single shot 3-4x of similar brightness to the Mate30P crop, but it's just a crop.
    As for the potential of P40P surpassing S20U, that model operates on a 9.4MP crop by default, interpolated to 12.5MP which clearly has consequences. In daylight it's often a regression compared to P30P (much less match Mate30P), and in night shots using the current firmware it has severe color issues of rendering large portions of the scene as a crimson red, so it's hard to say at this point too.
  • s.yu - Friday, April 3, 2020 - link

    Oh, there's exception of the Mate30P auto mode in the last sample, but the night mode isn't constantly superior either.
  • RealBeast - Friday, April 3, 2020 - link

    I've been looking forward to getting one of these, not sure which yet. The fly in the ointment now is that I won't see my Mom (who gets my old S9+) until the Fall due to the whole COVID problem, not to mention less income. That will weigh heavily on sales of what is otherwise an amazing looking phone for me.
  • 29a - Friday, April 3, 2020 - link

    How large are the picture file sizes created by this thing?
  • BedfordTim - Sunday, April 5, 2020 - link

    The same size as any other 12MP camera. They will depend on content, hdr, motion and compression options but I would expect about 36MB for a raw image and 8MB for a high quality jpeg.

Log in

Don't have an account? Sign up now