Microsoft Surface Review
by Anand Lal Shimpi on October 23, 2012 9:01 PM EST- Posted in
- Tablets
- Microsoft
- Mobile
- Surface
- Windows RT
Performance
There are two aspects to Surface’s performance that we need to discuss: the user experience and then quantitative performance metrics.
User experience is equal parts hardware and software, and this is one area where Microsoft really delivered with Windows RT. Frame rates are solid and stable, easily delivering what appears to be 60 fps for UI transitions. If you try to push the hardware too much, RT seems to completely drop animations vs. animating choppily which seems to be the right tradeoff to make. Overall that doesn’t seem to happen all that frequently.
Scrolling down web pages is also very smooth, although you can get IE to behave very jittery if you hold your finger in the wrong place on the screen while scrolling. There are some rough edges with the RT UI but overall it’s still very good.
I’d say in terms of smoothness of UI, Windows RT on Surface is much more like the iPad (or Windows Phone 7.5) than most Android tablets. Jelly Bean does complicate things as it really fixes a lot of the UI performance issues that hampered Android. Even then I’d say Surface’s UI responsiveness is among the best.
Application launch times are another thing entirely. Nearly every application I launched took longer than I would’ve liked on Surface. I can’t tell if this is a hardware issue or a software optimization problem, but application launches on Surface/Windows RT clearly take more time than on an iPad. I timed a few just to put this in perspective:
| Application Launch Time Comparison | |||||||
| Boot | Web Browser | Maps | Games Center / Xbox | ||||
| Apple iPad (3rd gen) | 32.0s | 1.0s | 2.4s | 1.1s | 1.9s | ||
| Microsoft Surface | 27.7s | 2.6s | 7.1s | 5.0s | 5.0s | ||
Now once apps have been launched, switching between them using Windows RT’s excellent multitasking system is just awesome. Apps fly in with little to no lag and the process is just great.
.png)
The only other user experience issue I have with Surface has to do with CPU utilization when using Office 2013. Surface, like all Windows RT tablets, comes with a free installation of Office 2013 Student & Home Edition. Surface also happens to use a quad-core NVIDIA Tegra 3 SoC, featuring four ARM Cortex A9 cores running at up to 1.3GHz. At least for the Cortex A9 generation, I don’t know that Microsoft could’ve used anything slower. Simply typing quickly in Microsoft Word maxes the single threaded performance of Tegra 3’s ARM Cortex A9 cores. I’ve seen CPU usage a high as 50% when typing very quickly, but mostly it tends to sit between 20 – 40%. Switch to notepad and max CPU utilization drops to sub 10%. This says more about Office 2013 than the performance of NVIDIA’s Tegra 3, but there are not a whole lot of spare CPU cycles to go around with Surface.
This brings us to the next part of the performance discussion: quantitative performance analysis. Windows RT/8 will likely bring balance to the tablet benchmark scene, but all of the folks currently working on benchmarks are targeting a late 2012/early 2013 release. We will eventually see everything from PCMark to GLBenchmark ported to Windows RT, but until then we’re left in the same situation we have under iOS: relying on JavaScript benchmarks to characterize performance.
With only two Windows RT tablets in our possession (ASUS’ VivoTab RT and Surface), this section would be pretty bare. To rectify this problem I phoned a friend who let me borrow a soon to be released Clovertrail (Atom Z2760) based Windows 8 tablet. To avoid getting in trouble with the specific manufacturer of this tablet I’ll refrain from posting photos or calling out the device by name, but we’ve talked about it on the site before.
As a recap, Clovertrail is the x86 alternative to ARM for Windows 8 tablets. The Atom Z2760 integrates two 32nm Saltwell cores running at up to 1.8GHz. Each core is Hyper Threaded so the entire SoC can work on four threads at a time, similar to NVIDIA’s Tegra 3. The GPU is Imagination’s PowerVR SGX 545 running at 533MHz. The SoC features a dual-channel LPDDR2 memory interface. NVIDIA’s Tegra 3 has a single channel LPDDR2 interface running at a 1500MHz data rate in Surface.
On the user experience side alone, the Clovertrail tablet is noticeably quicker than Surface. Surface isn’t slow by any means, but had it used Atom hardware it would’ve been even more responsive.
Putting all of this into numbers, we have a collection of JavaScript performance tests, some of which were used in the iPhone 5 review. Note that all of these tests were run using IE10 in Windows RT/8 thus making the comparison less about software and more about hardware differences:
| JavaScript Performance | |||||||
| Time in ms (Lower is Better) | Kraken | SunSpider | RIA Bench Focus | ||||
| Intel Atom Z2760 | 33855.7ms | 714.9ms | 3872ms | ||||
| Microsoft Surface (Tegra 3 1.3GHz) | 49595.5ms | 981.1ms | 5880ms | ||||
Across the board Clovertrail manages a 30 - 50% advantage over Tegra 3. Granted we’re not looking at power consumption here, but the Clovertrail tablet I’m comparing is even smaller/lighter than Surface for what it’s worth. We’ll have battery life numbers for it in the coming weeks.
.png)
Principled Technologies, apparently featuring some of the same folks who were responsible for building the old Winstone benchmarks from over a decade ago, actually put out the first cross platform Windows RT/8 benchmark with some help from Intel. Despite Intel’s influence the test appears to have no native code, instead relying on just a heavy workload of large images and videos for its tests.
| TouchXPRT 2013 | |||||||
| Time in Seconds (Lower is Better) | Photo Enhance | Photo Export | Video Transcode | MP3 Transcode | Photo Slideshow Creation | ||
| Intel Atom Z2760 | 210.83s | 73.93s | 53.91s | 98.66s | 85.81s | ||
| Microsoft Surface (Tegra 3 1.3GHz) | 306.12s | 116.36s | 87.27s | 160.99s | 125.06s | ||
| ASUS VivoTab RT (Tegra 3 1.3GHz) | 312.14s | 109.89s | 89.69s | 155.84s | 122.65s | ||
The large files used in the workload do a great job of showing Atom’s memory controller advantages over that used by the Cortex A9. The results here likely overstate the Clovertrail performance advantage a bit (I’m not sure how much 1080p video transcoding you’re going to be doing on Surface as compared to web browsing) but the results tend to agree with what our browser based JavaScript tests show: Intel’s Atom Z2760 is considerably faster than Tegra 3 here.
I understand that Microsoft needed a good launch vehicle for Windows RT, however I really would have liked to have seen an Atom version of Surface. An Ivy Bridge version is in the works, but it’s also a bit larger. An Atom version could retain the same chassis size/weight, but deliver tangibly better CPU performance. Again we’ll have to wait to see what battery life looks like for these Clovertrail tablets before really deciding whether or not Atom would’ve been a better fit.
Facebook
Twitter
RSS
235 Comments
View All Comments
Netscorer - Wednesday, October 24, 2012 - link
For a corporate customer RT will never be a solution. And that touch keyboard is non-usable, period. Anand was going round and round about how you must strike with fore and precision to make it count, how you must go through the prolonged learning curve, how you don't have any tactile response. Just trying not to sound too negative on the keyboard. The only positive he said about keyboard (if you remove all the colored words) is that at the end of he day it is better then typing on glass. Big deal. Anything is better then typing on glass.As for the Surface being a hybrid between laptop and tablet and how this is a perfect match, let me agree to disagree with you. In concept, taken abstract device that can work for me in my 9 to 5 life and 6 to 10 life, yes it would be great. This particular implementation of Windows 8 RT with strained hardware and lousy screen (in part because higher res screen would strain that hardware even more) - the answer is no.
xype - Wednesday, October 24, 2012 - link
Yeah, it felt a bit that way, didn’t it? But then, AnandTech reviews often feel like they’re written by someone who’s just excited about their newest toy and go a lot into hardware, too. While for other kinds of hardware that isn’t as big of a deal, reviewing smartphones and tablets should go into a different direction, I think.That tablet manufacturers can put in decent hardware and that a company like Microsoft is actually competent enough to produce a well designed tablet should be a given by now.
But a tablet or smartphone are not something you stuff into your PC tower and forget about it, like a graphics card or CPU fan. Is it comfortable to use on the lap, is the lack of USB charging annoying in day to day use, is Excel really usable for something like bookkeeping without being annoying after 5 minutes, does it work well as an ebook reading device, etc?
To be fair, ArsTechnica’s review is a bit better but still doesn’t go into software _at all_. That’s not confidence inspiring to me…
phexac - Wednesday, October 24, 2012 - link
Agreed. Just look at iPad reviews. They ALL state "it's a pleasure to use" and then go into zillion reasons for why. This review spent more time raving about a kickstand (btw how do you kickstand it in your lap? so this is desktop only portable device???) than about the experience of actually using Surface. Could always be because using it is actually pretty meh and nothing to write about.phexac - Wednesday, October 24, 2012 - link
Definitely agree with this. Anand's negative points seemed to be pretty close to deal breakers, and yet they were completely skimmed over. As was the fact that apps take 2.5-5 times longer to start than on a tablet. And a complete omission of actually using software on the tablet. Just looking at the pictures with typical desktop tiny menus in the programs and desktop interface makes you wonder how practical it is to it is as a touch device wen anything bigger than a mouse pointer would be too big for those menus.seapeople - Saturday, October 27, 2012 - link
So what is it then? Is Anand an Apple fanboi because he made the Surface seem boring, or is he a Windows schill because he glossed over the down falls of Surface?It's got to be one or the other, right? It's not possible that this review is actually accurate to the product?
WP7Mango - Wednesday, October 24, 2012 - link
Why should you care who Microsoft are targeting with this device? Think about it for a second...If you don't know who it's for, then it's clearly not for you. But it might fit someone else's requirements perfectly, and if it does then that is of no consequence to you - so don't worry about it.
B3an - Wednesday, October 24, 2012 - link
I had a good feeling about this tablet, and it was right. Surface RT is clearly an excellent tablet.But i would have prefered one with Intel Clover Trail. As mentioned, we need to see battery life with this SoC, but i very much expect it to be close to the ARM based Surface.
Surface would be perfect with Clover Trail. Same form factor, fanless, better performance than ARM, and the full blown Win 8. And yes i know theres the Pro version of Surface in 3 months time, but the Core i5 is overkill for many, it needs a fan too, and obviously will have much lower battery life. Clover Trail would have been the perfect balance for most people.
Such a shame, so close to my perfect idea of a tablet, but i'd happily still have ARM + Surface RT over a iPad or Android tablet for so many reasons.
Netscorer - Wednesday, October 24, 2012 - link
Completely agree with you. Good and usable Atom-based Intel CPU, which is x86 compatible, married with Windows 8 and all that effort that Microsoft clearly made to make you feel like you own a premium product with Surface - this would have been wonderful. This is what Microsoft should have released at the beginning, leaving Windows 8 RT to the sub $300 bargain tablets from 3-rd party vendors.Clearly, Intel could not commit to the Oct.26 release date and it forced Microsoft's hand at developing this half-baked solution. We also don't know how good Clover Trail Atom will be. Because if it's really going to be good, this will be the first actually usable Intel Atom processor. Especially if they will marry it with HD4000 GPU.
karasaj - Wednesday, October 24, 2012 - link
Honestly, if Surface had launched with Tegra 4 (not possible sadly) or S4 Pro (should have been possible) or even S4 Krait, it would be insanely nice. Performance is only barely "below" what it really needs to be to be unnoticeable - a tablet/notebook that runs office, netflix, and the occasional game (and internet browsing). An ARM cpu with better IPC would have been a better choice over 4 cores, imo.I wish Surface would re-release with the S4 Pro or something. I would completely buy that. Atm, I'm deciding whether or not it's worth it. I certainly like the idea of it, it just seems like it -might- be a tad under powered.
beginner99 - Wednesday, October 24, 2012 - link
$699. Thats more I paid for my already overpriced Asus T91 netbook (has touchscreen and can be used in tablet form) over 3 years ago. While Surface sure has better battery life and Win RT is better suited for touch device, I don't see a reason to replace it with surface. but then I hardly ever use it anyway.$699 is the price I would pay for the version with real windows and more capable CPU. Wasn't following the rumors so don't know if that actually will be made at all?