Performance Testing

When we first mentioned plans for performance testing of netbooks we encountered stiff resistance from some manufacturers. They expressed concern that performance comparisons defeated the whole idea of a netbook, which is a cheap portable computer based on cheaper processors that provided competent performance for basic computing tasks like web search and writing. While we agree that it would be a mistake to evaluate netbooks on performance alone, the facts are that netbook performance is increasing rapidly, as is the definition of what represents a "basic" computing task.

If the first netbooks represent all that is needed in a netbook there would be no reason at all for any future models. In fact people are doing more and more with netbooks - and the more that is demanded of these little computers the more that is demanded in raw computing power. The caveat, of course, is that it is unfair to compare the performance of a $300 to $400 netbook to a $2000 state-of-the-art notebook. They are aimed at different users and tasks. However, with the growth of computing power in recent years it is truly remarkable how very much the tiny netbook is actually able to do today.

Determining the best method for testing netbook performance proved quite a challenge. Of the readily available test suites PCMark Vantage seemed the ideal tool for testing overall computing capabilities. The problem is that Vantage only runs on Windows Vista and none of the current netbooks available for testing even offer Vista as an OS option. In addition Vantage requires a 1280x1024 minimum screen configuration which is far beyond resolution capabilities of current netbooks, so we would need to attach an external display.

Serious consideration was given to testing netbooks with Linux or a Linux variant OS like Ubuntu. In staff discussions at AnandTech we looked at benchmark issues with testing Linux notebooks, and we also considered the fact that all of the netbooks in house for testing had arrived with the Windows XP Home OS installed.  We do plan to compare "Linux" and Microsoft OS options on netbooks in a future article.

With Windows XP Home already installed on all five netbooks that became our current OS choice for performance comparisons. Even that choice presents testing problems. PCMark05 runs fine on Windows XP, but the test suite still requires a minimum screen resolution of 1024x768 and several test modules fail at any lower resolution. The best current netbooks can do is 1024x600. After considering various options PCMark05 testing was standardized on an external monitor fed by the netbook being tested at a 1024x768 resolution. On some netbooks the screen output at 1024x768 is hardly ideal, but using a standard resolution removed a variable from the performance testing.

With the continuing growth in computing power in netbooks we fully expect to add additional tests to our netbook test suite. It is common knowledge that current netbooks can handle Flash and streaming videos present on the web without much difficulty. We confirmed this in our own internal testing. We also concur with other reports that current netbooks can handle up to 720p video playback with relative ease. However 1080p and BD playback is definitely beyond current capabilities.

In the future there is no doubt netbooks will be able to smoothly handle higher resolution video playback, Blu-ray, and perhaps even mid-level gaming. As those capabilities appear we will add relevant tests to the netbook test suite.

Battery Life Comparison Performance Comparison
Comments Locked

42 Comments

View All Comments

  • fuberwil - Tuesday, September 15, 2009 - link

    I think this is just showing the evolution of the netbooks. A relatively recent device that now has everyone clamoring for one due to the size and portability of it. I think MSI is onto something especially with the option of the 9cell battery which can offer up to 10 hours of work time (from what i've read). Partner that with a low price tag with amazing specs then you have the new best friend of every student and businessman. Yea i think they all have their shortcomings such as the mouse track or the keyboard but like any good electronical device give it some time then it will meet consumers needs on almost every level.
  • Hrel - Thursday, August 6, 2009 - link

    A device like that would NEVER be worth more than 200 bucks to me, and I'd feel a little rotten about paying anything more than 100. Not to mention it's not really much more portable than a laptop. Laptops just need better battery life so we don't have to chug around with the ac adapter, If my laptop got 12 hours of battery life I'd take EVERYWHERE!!!
  • afkrotch - Thursday, July 30, 2009 - link

    I can't see how anyone can recommend these pieces of crap. I've owned an Asus EeePC Seashell and I would never recommend these to anyone I know. I don't care about battery life, size, or weight. The pieces of crap run so freaking slow. On a straight up HTML page, it flies, but once you get into something that's heavy in java, php, etc is lags. It lags when you scroll, move to a new page, etc.

    For simple websurfing, it fails. If all you plan on doing is typing up on notepad, ya. Go ahead. Have Office 2k7? Play with lag. It lags when I type.

    FYI, I cleaned off the XP Home they had on there and installed a clean copy of XP Pro. I thought it would help with the lagging, but needless to say. It didn't.
  • MamiyaOtaru - Monday, July 20, 2009 - link

    stop making glossy bodied netbooks. They look like trash as soon as someone touches them. Also never make glossy screened netbooks. I want to see what I'm working on, not my reflection. WOn't buy any eee past the original 900 because of this.
  • kawatwo - Sunday, July 19, 2009 - link

    Futisu and Sony both have 2 Ghz atoms overseas now in the P and the u820. It shouldn' be long before they make there way here. Also, it costs a little more but people always forget Asus own N10J mmodel with the gforce 9300m which makes it a pretty well rounded machine. A 2 Ghz N10 would be pretty remarkable I would think.

    I'm waiting for the 2 Ghz U820 though as I travel by motorcycle whenever possible.
  • AstroGuardian - Sunday, July 19, 2009 - link

    Hmmm.. 2Hhz? Like 5% more horsepower? Not feeling like waiting for it lol.

    I think the netbook future will be pushing the limits to portable CPUs and GPUs. Nowdays netbook CPUs are useless except for bare computer needs. Right?
  • Wesleyrpg - Saturday, July 18, 2009 - link

    hey guys, i know the MSI Wind 123 already has an impressive battery life, but how would it perform with an Intel SSD and would there be any better battery life?
  • richwenzel - Saturday, July 18, 2009 - link

    The lenovo s12 and the samsung nc20 both have the new via nano. I believe asus has a netbook and possibly dell as well with the nano.

    the nano supposedly can do blue ray. It would have been nice to see the differences between the two.

    the nc20 is a bit pricier, at $500-$550 or so, but the lenovo can be had for around $400.

    there is another company call top crown, www.tct.hk that looks they have some interesting developments with the nano
  • piasabird - Saturday, July 18, 2009 - link

    What is the appeal of a miniature laptop which is slow and underpowered? Better yet, just build a small nettop with a real processor. One thing I tend to wonder is why these Atom motherboards are so inexpensive, yet the via Mini-ITX motherboards are so expensive. Maybe it is just mass production fueled by the want of people for a smaller computer. Myself, I think you could just as easily hook it up to an external HD widescreen monitor. This would give such a device more appeal.

    You could just make a phone that could plug into a monitor. Why carry around a big nettop? I think it is just as possible.
  • SilthDraeth - Friday, July 17, 2009 - link

    My brother bought an EEE specifically to run some DJing software on it, so he didn't have to lug around his Macbook. Unfortunately it couldn't handle it. He then couldn't sell it on Ebay, only scammers tried to buy it.

    Not blaming the netbook, and he had the money to throw away, and still makes use of it. But something with a bit more horsepower than a slight processor clock speed increase would be very welcome.

    Looks like we may have to wait a bit longer though.

Log in

Don't have an account? Sign up now