The Samsung Galaxy S20+, S20 Ultra Exynos & Snapdragon Review: Megalomania Devices
by Andrei Frumusanu on April 3, 2020 9:30 AM ESTMachine Learning Inference Performance
The new SoC generations also bring with them new AI capabilities, however things are quite different in terms of their capabilities. We saw the Snapdragon 865 add to the table a whole lot of new Tensor core performance which should accelerate ML workloads, but the software still plays a big role in being able to extract that capability out of the hardware.
Samsung’s Exynos 990 is quite odd here in this regard, the company quoted the SoC’s NPU and DSP being able to deliver a 10TOPs but it’s not clear how this figure is broken down. SLSI has also been able to take advantage of the new Mali-G77 GPU and its ML abilities, exposing them through NNAPI.
We’re skipping AIMark for today’s test as the benchmark couldn’t support hardware acceleration for either device, lacking updated support for neither Qualcomm’s or SLSI’s ML SDK’s. We thus fall back to AIBenchmark 3, which uses NNAPI acceleration.
AIBenchmark 3
AIBenchmark takes a different approach to benchmarking. Here the test uses the hardware agnostic NNAPI in order to accelerate inferencing, meaning it doesn’t use any proprietary aspects of a given hardware except for the drivers that actually enable the abstraction between software and hardware. This approach is more apples-to-apples, but also means that we can’t do cross-platform comparisons, like testing iPhones.
We’re publishing one-shot inference times. The difference here to sustained performance inference times is that these figures have more timing overhead on the part of the software stack from initializing the test to actually executing the computation.
AIBenchmark 3 - NNAPI CPU
We’re segregating the AIBenchmark scores by execution block, starting off with the regular CPU workloads that simply use TensorFlow libraries and do not attempt to run on specialized hardware blocks.
In the purely CPU accelerated workloads, we’re seeing both phones performing very well, but the Snapdragon 865’s A77 cores here are evidently in the lead by a good margin. It’s to be noted that the scores are also updated for the S10 phones – I noted a big performance boost with the Android 10 updates and the newer NNAPI versions of the test.
AIBenchmark 3 - NNAPI INT8
Integer ML workloads on both phones is good, but because the Snapdragon 865 leverages the Hexagon DSP cores for such workload types, it’s much in lead ahead of the Exynos 990 S20. This latter variant however also showcases some very big performance improvements compared to its predecessor. I still think that Samsung here is only exposing the GPU of the SoC for NNAPI, but because of the new microarchitecture being able to accelerate ML workloads, we’re seeing a big performance improvement compared to the Exynos 9820.
AIBenchmark 3 - NNAPI FP16
In FP16 workloads, the Exynos 990’s GPU actually manages to more often outperform the Snapdragon 865’s Adreno unit. In workloads that allow it, HiSilicon’s NPU still is far in the lead in workloads as it support FP16 acceleration which isn’t present on either the Snapdragon or Exynos SoCs – both falling back to their GPUs.
AIBenchmark 3 - NNAPI FP32
Finally, FP32 also again uses the GPU of each SoC, and again the Exynos 990 presents quite a large performance lead ahead of the Snapdragon 865 unit.
It’s certainly encouraging to see the Samsung SoC keep up with the Snapdragon variant of the S20, pointing out that other vendors now finally are paying better attention to their ML capabilities. We don’t know much at all about the DSP or the NPU of the Exynos 990 as Samsung’s EDEN AI SDK is still not public – I hope that they finally open up more and allow third-party developers to take advantage of the available hardware.
Facebook
Twitter
RSS
137 Comments
View All Comments
crimson117 - Friday, April 3, 2020 - link
$1400 is absurd. There's no way they're worth more than twice as much as a brand new S10.Andrei Frumusanu - Friday, April 3, 2020 - link
Probably one of the reasons Samsung still continues to sell the S10 series. They're really excellent value right now, and you're not missing out on too much.cha0z_ - Monday, April 6, 2020 - link
You are literally getting just one more year of software support going for s10 series... samsung software support policy is abysmal with less than two years of real support and from there just security. I got both iphone 11 pro max and exynos note 9, if I put aside the cr*ppy 9810 - it will not receive even the oneUI 2.1 as an update, while samsung will soon release it for s10 line. Enough said, note 9 is year and a half old.How can you recommend someone 1000 euro or 1400 euro phone if it will be supported for 1.5 years and from there 1.5 more security updates next to apple with 5 years FULL support with major, minor, day one, betas + security update for old iphones like 4s and 5 (2011 and 2012 respectably)?
goatfajitas - Monday, April 6, 2020 - link
You do realize the phone doesn't stop working when it doesn't get an OS update right? TBH, neither Android or IOS has added a whole lot in the past few years, its just a yearly cadence of very minor updates and not getting them means almost zero in actual use.Featherinmycap - Monday, April 6, 2020 - link
I think there have been a lot of added features to IOS in the last 3 years that I use a great deal. Not saying that Android didnt already have some of these features, but for IOS users we got with IOS 11; a file manager (finally), Messages sync with iCloud, screen recording, useful improvements to Siri and ApplePay. IOS12; lots of performance improvements (lots), Screentime, Shortcuts (scripting), CarPlay, Animoji Memoji, Tracking prevention, IOS13; Single Sign on, external storage, Dark Mode, better support for keyboards, trackpads/mice, etc.Famorcan007 - Tuesday, April 7, 2020 - link
I think it's because Android mostly has offered those features(file manager,screen recording, external storage,support for mice etc.) since way back compared to iOS' slow but steady trickle of features that's why iOS users feel every OS update is huge and significant. I'm using a Note 4(my backup device) right now to comment which doesn't feel too crippled compared to my Android 9 P20 pro.cha0z_ - Tuesday, April 7, 2020 - link
Let's not find an excuse - software support is software support. Security is security - some of us keep all their personal info on their device (most of us) + bank accounts and whatnot, risking compromise on your phone is not that innocent compared to what was like back in the days. IOS adds rapidly more features for sure compared to android that recently starts to look more and more like IOS (and I personally totally don't like that), but still added some good stuff under the hood and some new features.It's not serious to sell 1400 euro phone that is supported for one year and a half. I own exynos note 9 - it's 1.5 years old and already samsung dropped the support, s10 line received oneUI 2.1, note 9 will not. How is that for my 1000 euro phone + double served with that cr*ppy exynos 9810 in it. Now it's in my GF and I am rolling iphone 11 pro max. I prefer android and love oneUI, but I am tired to be a second hand customer.
s.yu - Tuesday, April 7, 2020 - link
Don't know what you're talking about. My Note8 just got another update days ago, one that I preferred not to have because each update comes with a risk of bricking the device while potential changes to the UI are not always welcome either. I also got it ~30% off retail a few months after release, such has always been the state of Samsung, at least for S and Note.I'm no longer buying Samsung but the main reason is lack of the 3.5mm port, if I have to name another then it's between the questionable choice of telephoto in the smaller variants or the oversized device with a mediocre battery(I regard 5000mah to be mediocre for the size). I still do like the UI but I'm willing to look around.
Psyside - Tuesday, April 7, 2020 - link
"It's not serious to sell 1400 euro phone that is supported for one year and a half. I own exynos note 9 - it's 1.5 years old and already samsung dropped the support, s10 line received oneUI 2.1, note 9 will not. How is that for my 1000 euro phone"Very easy, with those "very old software features" Samsung can do what MAC can't, and don't get me start it on the utter crap IOS.
Also don't spin it, Samsung offer 4 (four) years of security updates, so do your research before you type something.
cha0z_ - Wednesday, April 8, 2020 - link
fanboy. Security update hahahahah iphone 4s and 5 still receives security updates - 9 years old phone for 4s. What you will say now?iphone receive FULL support with MAJOR ios versions, updates, minor updates, BETA versions, DAY ONE as their newest and most expensive phone - for 5-6 years and you are talking about 4 years of security updates roflmao. Samsung released note 9 with android 8 when android 9 was already released from more than a months. Oooo, it's enough time, because you can dev your skin and features on top of the dev previews, especially the later ones that are closer to final (for the more tricky/deeply integrated code) - so no excuse for what they did. Basically they gave me one major update - android 10 as android 9 should had been on the note 9 from the start. Even if we count 2, how is that next to 5-6 versions of ios?
And before you talk some more fanboy bs that never used recent years iphones - ios brings a lot more in every new versions (adding features that was missing for no reason, like external USB flash support, file browser for the files on the phone, etc) while android 10 brings you what? More lockdown ios style, iphones gestures and pixel device that is a cheap iphone wannabe.
Because of people like you samsung don't want to change their software support policy. Why should they? It costs money or now you will start with the argument how the phone hardware is not supporting oneUI 2.1 (for the note 9 that is 1.5 years old, but will not receive it most likely ;) ). Or maybe android 11 will be too much for the phone, right? :D
Also I agree - my note 9 can do more than my iphone 11 pro max, but everything that the phones do both (and that's 99.9% of what you will end up using constantly) - the iphone 11 pro max makes the exynos note 9 look like a total utter joke - faster, smoother with NOT A SINGLE frame drop no matter what you do, gaming is insanely good with surprise - NOT A SINGLE frame drop, battery life is x3 times better, apps have MORE features and runs super smooth and great, speakers destroys the note 9 one, camera too is times better, materials are a lot better too, faceid is super good and fast - feels like I don't have any security on - never failed or gave me any issue. Fun fact, note 9 came with fortnite and recommended as gaming phone for that game. My exynos variant can't run smoothly the game even with 30fps cap medium settings and !1080p! while iphone XS max runs it 60fps high 2688x1242 without a single frame drop. Same goes for the 11 pro max, obviously.
As for ios - it improves massively and adds more and more missing features/drops restrictions with every version. ios 14 is already known to drop more. I prefer android, because I can do more + I love oneUI, but that doesn't change the fact that in my country I will receive exynos and 1.5 years of decent support. And in the end of the day - I spend my time in apps, not in the settings menu and apps on ios are better, with more features, smoother, a lot of them exclusive to the platform. Can you play dead cells on your android device? No? Yeah, the port is expected around the end of the year, I have it from June 2019. Full blown civilization 6 on your android device? Yeah, will never come, I have it and it's 1:1 port that runs great. Can go on and on and on. If you spend your time tweaking settings, options, UI - good for you, I spend my time in games and apps.