The Apple iPhone 11, 11 Pro & 11 Pro Max Review: Performance, Battery, & Camera Elevatedby Andrei Frumusanu on October 16, 2019 8:30 AM EST
SPEC2006 Perf: Desktop Levels, New Mobile Power Heights
Given that the we didn’t see too many major changes in the microarchitecture of the large Lighting CPU cores, we wouldn’t expect a particularly large performance increase over the A12. However, the 6% clock increase alongside with a few percent improvement in IPC – thanks to improvements in the memory subsystems and core front-end – could, should, and does end up delivering around a 20% performance boost, which is consistent with what Apple is advertising.
I’m still falling back to SPEC2006 for the time being as I hadn’t had time to port and test 2017 for mobile devices yet – it’s something that’s in the pipeline for the near future.
In SPECint2006, the improvements in performance are relatively evenly distributed. On average we’re seeing a 17% increase in performance. The biggest gains were had in 471.omnetpp which is latency bound, and 403.gcc which puts more pressure onto the caches; these tests saw respective increases of 25 and 24%, which is quite significant.
The 456.hmmer score increases are the lowest at 9%. That workload is highly execution backend-bound, and, given that the Lightning cores didn’t see much changes in that regard, we’re mostly seeing minor IPC increases here along with the 6% increase in clock.
While the performance figures are quite straightforward and not revealing anything surprising, the power and efficiency figures on the other hand are extremely unexpected. In virtually all of the SPECint2006 tests, Apple has gone and increased the peak power draw of the A13 SoC; and so in many cases we’re almost 1W above the A12. Here at peak performance it seems the power increase was greater than the performance increase, and that’s why in almost all workloads the A13 ends up as less efficient than the A12.
In the SPECfp2006 workloads, we’re seeing a similar story. The performance increases by the A13 are respectable and average at 19% for the suite, with individual increases between 14 and 25%.
The total power use is quite alarming here, as we’re exceeding 5W for many workloads. In 470.lbm the chip went even higher, averaging 6.27W. If I had not been actively cooling the phone and purposefully attempting it not to throttle, it would be impossible for the chip to maintain this performance for prolonged periods.
Here we saw a few workloads that were more kind in terms of efficiency, so while power consumption is still notably increased, it’s more linear with performance. However in others, we’re still seeing an efficiency regression.
Above is a more detailed historical overview of performance across the SPEC workloads and our past tested SoCs. We’ve now included the latest high-end desktop CPUs as well to give context as to where the mobile is at in terms of absolute performance.
Overall, in terms of performance, the A13 and the Lightning cores are extremely fast. In the mobile space, there’s really no competition as the A13 posts almost double the performance of the next best non-Apple SoC. The difference is a little bit less in the floating-point suite, but again we’re not expecting any proper competition for at least another 2-3 years, and Apple isn’t standing still either.
Last year I’ve noted that the A12 was margins off the best desktop CPU cores. This year, the A13 has essentially matched best that AMD and Intel have to offer – in SPECint2006 at least. In SPECfp2006 the A13 is still roughly 15% behind.
In terms of power and efficiency, the A13 seemingly wasn’t a very successful iteration for Apple, at least when it comes to the efficiency at the chip’s peak performance state. The higher power draw should mean that the SoC and phone will be more prone to throttling and sensitive to temperatures.
One possible explanation for the quite shocking power figures is that for the A13, Apple is riding the far end of the frequency/voltage curve at the peak frequencies of the new Lightning cores. In the above graph we have an estimated power curve for last year’s A12 – here we can see that Apple is very conservative with voltage up until to the last few hundred MHz. It’s possible that for the A13 Apple was even more aggressive in the later frequency states.
The good news about such a hypothesis is that the A13, on average and in daily workloads, should be operating at significantly more efficient operating points. Apple’s marketing materials describe the A13 as being 20% faster along with also stating that it uses 30% less power than the A12, which unfortunately is phrased in a deceiving (or at least unclear) manner. While we suspect that a lot of people will interpret it to mean that A13 is 20% faster while simultaneously using 30% less power, it’s actually either one or the other. In effect what this means is that at the performance point equivalent to the peak performance of the A12, the A13 would use 30% less power. Given the steepness of Apple’s power curves, I can easily imagine this to be accurate.
Nevertheless, I do question why Apple decided to be so aggressive in terms of power this generation. The N7P process node used in this generation didn’t bring any major improvements, so it’s possible they were in a tough spot of deciding between increasing power or making due with more meager performance increases. Whatever the reason, in the end it doesn’t cause any practical issues for the iPhone 11’s as the chip’s thermal management is top notch.
Post Your CommentPlease log in or sign up to comment.
View All Comments
FunBunny2 - Wednesday, October 16, 2019 - link" also future phone reviews:. Please test the call quality and reception "
such a Luddite!!!! you actually expect a mobile phone to actually make land-line quality calls????? where have you been for the last decade???? :):) don't worry, though. real 5G will require a receiver on your house's roof and a super-duper wifi thingee to get it to work. real 5G won't work anywhere else, of course. wait... doesn't that sound like a land-line????
FreckledTrout - Wednesday, October 16, 2019 - linkShh, adults are talking.
eastcoast_pete - Wednesday, October 16, 2019 - linkWhat can I say? I'm old-fashioned that way: for me, a smartPHONE has to work as a phone to justify its name. As I wrote, I tried out some otherwise capable mobiles, great screen and all, but they really tanked on call quality and reception.
eastcoast_pete - Wednesday, October 16, 2019 - linkForgot to add: And, I'm not even expecting landline quality, just a bit better than Armstrong's voice from the moon 50 years ago. Plus, his call to Earth wasn't dropped. Not too much to ask, is it?
Drumsticks - Wednesday, October 16, 2019 - linkMy guess is this is too hard to measure repeatably and precisely. I wouldn't mind some anecdotal opinions, but at that point you might as well get those from a different website anyways.
eastcoast_pete - Thursday, October 17, 2019 - linkAn anecdotal or purely qualitative statement would suffice. No fancy analysis. "Loud and clear" vs. "hard to understand", spotty, dropped words etc is plenty to go on, and takes only a few minutes of testing.
Pro-competition - Friday, October 18, 2019 - linkInternet calls such as Whatsapp / FB calls for me have mostly been inferior to "normal calls" which use the Public Switched Telephone Network. For this reason, I still pay telcos an additional fee to make such "normal calls".
PS: This is from someone who lives in a country where 1Gbps home fibre and 4G+ has been prevalent for many years now, and is about to roll-out 5G next year.
shompa - Thursday, October 17, 2019 - linkSignal strength? The only situation that is plausible is in the woods. Otherwise: just enable WiFi calling. Signal strength is no issue then.
eastcoast_pete - Thursday, October 17, 2019 - linkFor performance with low signal strength, my building's basement is another, reproducible example (1-2 bars of 5 max), so no walk in the forest required. I believe that Andrei could find a convenient location where his carrier of choice has low signal, and just test it there. I am not looking for dB levels, just a qualitative statement.
Someguyperson - Wednesday, October 16, 2019 - linkYour iPhone 11 Pro GPU efficiency numbers are off. The "warm" values aren't even on the chart. You need to take the sustained values from the chart and redo the calculations in the tables.