Conclusion & End Remarks

The conclusion for the Galaxy S9 is always the toughest part to write as it’s where we have to reconcile all the pros and cons of the device and making a verdict on its value as a product to customers.

In terms of design, the S9 iterates on the S8 and I think that’s definitely a positive until Samsung somehow produces a better design overhaul. The changes we find here aren’t exactly ground-breaking and most people will get used to them very fast. The fingerprint scanner location is among the biggest ergonomics changes and while for me personally it didn’t do much, there’s plenty of people who find it an improvement.

The speaker sound quality of the Galaxy S9 is a massive improvement and this is now by far the best sounding smartphone device. The stereo speakers as well as the audio processing tuning along with the improved main speaker design all just provide a much better experience. I may not have covered this in the introduction, but Samsung’s choice to retain the 3.5mm jack is absolutely the right thing to do. I’ve got very strong feelings about companies’ rationales behind removing the headphone jack and find their reasoning either misguided or outright misleading, and just very anti-consumer choice. Here’s to hoping that Samsung sticks with it in the future, and as absurd as this is that I have to praise them for it, I have to do it to ensure that companies listen.

The screen of the Galaxy S9 holds very little surprises as it has only marginal improvements over the S8. It’s still among one of the best screens on smartphones, and honestly there’s not much more to say.

The camera of the Galaxy S9 for me had some high points and some low points. The high points are that the variable aperture of the S9 has real benefits and direct advantages in picture quality in day-light shots. The S9’s reduced usage of sharpening provided the cleanest pictures among all smartphones and thanks to its improved sensor its effective spatial resolution is actually higher than some higher resolution camera devices. The low-light shots also come with a quality improvement over the S8 – although it will depend on the lightning and scene to notice them at their full effect. Right now the S9 has the best low-light camera.

While the hardware of the S9’s camera definitely deserves praise, the software has notable issues in daylight shots. The Galaxy S9 has a very bad tendency to overexpose and compress the image’s dynamic range. In Pro mode these issues largely go away, but for the Galaxy S9 to offer a better point-and-shoot experience than the S8 or the new iPhones, Samsung needs to rework its camera calibration in Auto mode as right now it can be the odd one out in terms of results.

Finally, the biggest story for the Galaxy S9 is its big contrast in terms of SoC hardware. Ever since we first heard about the Exynos 9810 we had very large expectations and we knew there would be some tangible differences between Exynos and Snapdragon variants. The expectations couldn’t be more shattered than the results we got. While the Snapdragon 845 variant of the Galaxy S9 performed largely as advertised and as we had been told to expect by Qualcomm, the Exynos 9810 failed to live up to its hype in real-world scenarios. Effectively, the Exynos 9810 variant and as evidenced by all the data we collected, is the slower variant of the two. The root cause here has been identified as the extremely conservative scheduler and DVFS mechanisms which essentially nullify any advantage the new M3 cores have in synthetic benchmarks.

In 3D benchmarks, the Exynos 9810 posted very healthy efficiency improvements and even sometimes managed to catch up to last year’s Adreno 540 – something I hadn’t expected. Qualcomm’s new Adreno 630 raises the bar in terms of peak performance, however the promises of increased efficiency have not materialised in the commercial hardware as the performance boost comes at a cost of increased power. Effectively, when looking at sustained workloads, the Snapdragon 845 isn’t any faster than the Snapdragon 835 in its GPU department. Fortunately for Qualcomm, they’re still in the lead and this is not a deal-breaker for the Galaxy S9.

While the performance advantage of the Snapdragon 845 variant over the Exynos 9810 variant is something we could live with, the battery life results of the Exynos is definitely a deal-breaker. I’m not sure of the root cause here and whether it’s something that can be fixed by software, but showcasing such a battery runtime regression over its predecessor is universally something that we can all agree on as not acceptable for a flagship device. Based on our testing, it’s especially in heavy use-cases where this will most evident. The Snapdragon 845 variant performed as expected in the battery life tests.

Finally the recommendation of the Galaxy S9 will be based on which market you are in and which variant you’ll be able to purchase. The Snapdragon 845 variant in the US, China and Japan is a healthy upgrade over its predecessors and I don’t really have much to say against it as a phone, besides the camera exposure issues. Here Samsung iterated and perfected over the S8, and whether the S9 is worth to you as an upgrade is something you’ll need to decide based on its individual parts, because as a package, the Snapdragon S9s don’t disappoint.

For readers in markets with the Exynos variant I need to take a slightly different tone. Make no mistake as I say that the Exynos S9 is by far not a bad phone. If you come from older generation devices you will see significant upgrades, but as a flagship coming at a price premium we expect a no-compromise device, and here is where the Exynos S9 doesn’t tick all boxes. The battery life regression that we measured is the single most concerning aspect of the device. Here buyers will need to consider the device with caution and well-thought out consideration and should maybe apply a wait & see approach over the coming months – for one to see if Samsung resolves the issues via software, and secondly, to await the release of competitor’s new product lines for possible better alternatives.

Camera - Low Light Evaluation
Comments Locked

190 Comments

View All Comments

  • lopri - Monday, March 26, 2018 - link

    Oh and there is no Fraps on Android or (gasp) iOS as far as I know. One that actually works.
  • jjj - Tuesday, March 27, 2018 - link

    Anything is better than synthetic.
    What happens in this review is a great example because judgements are made about how perf and power are balanced, without any testing in appropriate workloads. The SoC needs to be tuned for actual workloads, and aside from anecdotal evidence, there is no data. AT loves to say that it's data driven but if you don't have the relevant data.... You can't determine the color of the sky by licking a wall.
    Synthetic benchmarks are a best effort from a developer but they can never match real world apps. PCMark for example, some phones with 8xA53 at 2GHz can score over 5k points so almost as much as the Exynos here.
    It's been 10 years and nobody makes any effort to review phones. Even battery life, it's either synthetic or browsing with nothing else going on, utterly unrealistic.
  • ZolaIII - Tuesday, March 27, 2018 - link

    You can profile individual apps & use them while doing so but the results will vary to much even if your usage is minor like for instance video player & same video. Simply Android platformom has to much back processes and noise for reliable measuring especially if those are lite tasks.
  • techconc - Tuesday, April 17, 2018 - link

    Do you understand the sub tests in something like Geekbench for example? Are you going to claim that they are not representative of real world functions that your phone uses on a regular basis? Screaming no synthetic benchmarks like a lunatic without offering a better and generally accepted alternative is not helpful.
  • peevee - Friday, April 6, 2018 - link

    Firefox. With an adblocker installed.
  • name99 - Tuesday, March 27, 2018 - link

    Oh FFS.
    Different benchmarks test DIFFERENT THINGS. What you call a synthetic benchmark is a great test of very specific parts of the CPU or memory system.
    If you don't care about details, don't freaking look at the synthetic benchmarks and go straight to whatever whole system benchmark it is that floats your boat.

    But don't throw a hissy fit because the guys who ARE interested in **CPU** performance don't want to see numbers that are fscked up by the OS behavior, the performance of the flash, or whatever other random nonsense gets it to confuse the issue.
  • lilmoe - Wednesday, March 28, 2018 - link

    Of course, synthetics at constant max load have never reflected real world performance of mobile devices. We know this. What I like about these deep dives is the fact that you can evaluate the data yourself and make educated assumptions about what one might expect. Here's a rough summary of what I believe is applicable to both chips in the S9 with the current firmware:

    - Exynos is the faster chip. But it's handicapped for feature and performance parity with the SD. Optimizations in Oreo might have contributed to how such a conservative scheduler passed QC.
    - Snapdragon will be snappier (no pun intended) in certain workloads and general app load times.
    - Exynos will last longer in games, video playback and streaming.
    - Snapdragon might last longer in web browsing.
    - Snapdragon Will last longer in video and voice calls in unoptimized messaging apps.

    These are examples I thought of quickly. It's funny, but I also watch some youtubers doing their "tests". Combine these tests with the data presented here and there you go.
  • eastcoast_pete - Monday, March 26, 2018 - link

    For me, the winner is - the one that didn't compete here: the S8+ (with the 835 chipset). Seriously. With the S9/9+ now out, an S8 or S8+ can be had for hundreds of $ less than the corresponding S9 or S9+ , and that makes the S8 or S8+ right now the best value for money among higher-end Sammys. To boot, nobody will notice it's last year's model, as the S8 and S9 look almost identical. IMO, the main upside for an S9+ is the camera, especially the video capabilities, but, at what a price -ouch!

    Processors: Progress - What progress? The 845 did a bit better than the 835, mostly by being clocked higher (and eating a bit more power), while the new M3-based Exynos was really disappointing. I am also disappointed with Qualcomm's 845, and here is why: the 845 is manufactured in the (supposedly) more energy efficient 10 nm LPP (Samsung's newest and hottest), so - where are the power savings? I can't help but wonder how an 835 manufactured in 10 nm LPP would have fared? As is, the 835 mostly holds it's own where it counts (real life situations), and is far from being outclassed by the 845 (or the M3 Exynos, but that is kicking a chip when it's down).
    Lastly, regarding Andrei's comment on Samsung's software: right on. Samsung has pretty consistently made the best or among the best Android smartphones out there - I have owned a few of them. But, while Samsung's hardware generally get's a A or A- , the software that Samsung loads (burdens) their phones with has ranged between annoying to debilitating; apparently, that carelessness on the software side extends all the way down to low-level programming this time - not good.
    Several years ago and for a short time, one could buy a Samsung phone with stock Android from Google directly. While I realize that won't happen again any time soon, I would love to see an S8+ (835) with just plain-vanilla Android 8.1 (or 9?), no skin, no bloatware. I might even buy one, before they're gone.
  • BigDH01 - Monday, March 26, 2018 - link

    The perf/W graph is confusing to me as it's measured in fps/W. This breaks down into (frames/sec)/(J/s). Why not just frames/joule?
  • Andrei Frumusanu - Monday, March 26, 2018 - link

    Because Watts are important to note as a thermal indicator. It gives more information than frames/J.

Log in

Don't have an account? Sign up now