Performance Testing

When we first mentioned plans for performance testing of netbooks we encountered stiff resistance from some manufacturers. They expressed concern that performance comparisons defeated the whole idea of a netbook, which is a cheap portable computer based on cheaper processors that provided competent performance for basic computing tasks like web search and writing. While we agree that it would be a mistake to evaluate netbooks on performance alone, the facts are that netbook performance is increasing rapidly, as is the definition of what represents a "basic" computing task.

If the first netbooks represent all that is needed in a netbook there would be no reason at all for any future models. In fact people are doing more and more with netbooks - and the more that is demanded of these little computers the more that is demanded in raw computing power. The caveat, of course, is that it is unfair to compare the performance of a $300 to $400 netbook to a $2000 state-of-the-art notebook. They are aimed at different users and tasks. However, with the growth of computing power in recent years it is truly remarkable how very much the tiny netbook is actually able to do today.

Determining the best method for testing netbook performance proved quite a challenge. Of the readily available test suites PCMark Vantage seemed the ideal tool for testing overall computing capabilities. The problem is that Vantage only runs on Windows Vista and none of the current netbooks available for testing even offer Vista as an OS option. In addition Vantage requires a 1280x1024 minimum screen configuration which is far beyond resolution capabilities of current netbooks, so we would need to attach an external display.

Serious consideration was given to testing netbooks with Linux or a Linux variant OS like Ubuntu. In staff discussions at AnandTech we looked at benchmark issues with testing Linux notebooks, and we also considered the fact that all of the netbooks in house for testing had arrived with the Windows XP Home OS installed.  We do plan to compare "Linux" and Microsoft OS options on netbooks in a future article.

With Windows XP Home already installed on all five netbooks that became our current OS choice for performance comparisons. Even that choice presents testing problems. PCMark05 runs fine on Windows XP, but the test suite still requires a minimum screen resolution of 1024x768 and several test modules fail at any lower resolution. The best current netbooks can do is 1024x600. After considering various options PCMark05 testing was standardized on an external monitor fed by the netbook being tested at a 1024x768 resolution. On some netbooks the screen output at 1024x768 is hardly ideal, but using a standard resolution removed a variable from the performance testing.

With the continuing growth in computing power in netbooks we fully expect to add additional tests to our netbook test suite. It is common knowledge that current netbooks can handle Flash and streaming videos present on the web without much difficulty. We confirmed this in our own internal testing. We also concur with other reports that current netbooks can handle up to 720p video playback with relative ease. However 1080p and BD playback is definitely beyond current capabilities.

In the future there is no doubt netbooks will be able to smoothly handle higher resolution video playback, Blu-ray, and perhaps even mid-level gaming. As those capabilities appear we will add relevant tests to the netbook test suite.

Battery Life Comparison Performance Comparison
Comments Locked

42 Comments

View All Comments

  • Ruark - Friday, July 17, 2009 - link

    I have an MSI notebook with buttons that seem to be much like those of the Wind.

    Many buttons (keyboard and touchpad) have to be pressed beyond the "click" in order for the press to register.
  • strikeback03 - Friday, July 17, 2009 - link

    When I saw this article I was hoping for a comparison to some of the low-end larger-screened notebooks available. I have been seeing Newegg deals on 14 and 15 inch notebooks for $350-400, I'd expect these to provide 3-4 times the performance of the tested netbooks but it would be a nice point of reference for those who are looking for a cheap system that doesn't need to be as portable. If you are buying for your 6th grader to do their homework, size and weight are less important than if you are flying cross-country.

    Also, i wouldn't say BluRay playback and gaming are the only areas unsuited for netbooks. After all, a netbook with Ion would be able play BluRay files (off a hard drive at least), but nothing short of a much after processor is going to make tasks like photo editing or video transcoding tolerable on a netbook.
  • KeypoX - Sunday, July 19, 2009 - link

    I dont see the difference between 3 pounds and 6 pounds... Netbooks are cute but have no more functionality than a cell phone.

    I have seen people in school with them, they generally disappear and have a 15" laptop very soon.
  • jeff486 - Friday, July 17, 2009 - link

    Just some general comments as I agree with the above post. This article did not really answer the question about whether or not a Netbook can replace a low end Notebook you can pickup on clearance at places like newegg or tigerdirect. I am just looking for an inexpensive second system to toss in the bag when I travel and maybe something the kids can use while I am at home. The size of these would be perfect as the company I work for has our notebooks so locked down that even windows media player is no longer active. I will be lugging two systems around so weight and size is very important.

    I want to know how well it handles office applications, can it play movies/tv shows I transcoded for travel and how well does the wireless connection work. If I want to watch a TV show on Hulu does it offer decent enough playback quality via the wired or wireless connection. I watch most of my TV shows this way when traveling. How is battery playback when watching movies as those four hour flights showing the same movie over and over get boring.

    Someone already mentioned this but do the webcams work and is skype video supported as I like to see my kids after getting back to the hotel room. How is the audio quality with a pair of headphones attached? I do not game so that is not important but it would be nice to know if Peggle or Disney Toon Town or other kids games play on it. At home I could probably trust a couple of seven year olds with the machine.

    Most of the articles around here answer my questions and it is why I like visiting the website but this article left me with more questions than it answered.
  • AstroGuardian - Sunday, July 19, 2009 - link

    So, the webcams work as intended with descent perfs. I tested a MSI U100 6 month back and webcam was great. The audio is also with standard quality and there is nothing to cry about. Most of 2D games will work on it. Even Counter Strike 1.6 works flawless with 800x600.
  • bgold2005 - Friday, July 17, 2009 - link

    The image seems to show the 1000HE with an illuminated keyboard, yet no text in the article refers to this. I like this feature; shouldn't it have been at least briefly touched upon/ added to the comparisons?
    After all, netbooks are ultra-portable and mat be in some very shady, or porrly-lit, locales.
    (although it did lead me to a merry search involving stick-on keys, glow-paint, etc). Apparently this will be a feature in upcoming Asus models (unclear whether just notebooks or also netbooks)

  • JackPack - Friday, July 17, 2009 - link

    The keys on the 1000HE do not illuminate or glow.
  • Bolas - Friday, July 17, 2009 - link

    I assume this is a typo?

    "The N280 is essentially the same CPU as the N280"

    You could have a much more thorough article if you didn't stop with just the N280 comparison... Why not compare all the CPU's to themselves?

    The Core-i7 is essentially the same CPU as the Core-i7.
    The Pentium 4 is essentially the same CPU as the Pentium 4.
    The Phenom II is essentially the same CPU as the Phenom II.

    *grin*
  • Bolas - Friday, July 17, 2009 - link

    I assume this is a typo?

    "The N280 is essentially the same CPU as the N280"

    You could have a much more thorough article if you didn't stop with just the N280 comparison... Why not compare all the CPU's to themselves?

    The Core-i7 is essentially the same CPU as the Core-i7.
    The Pentium 4 is essentially the same CPU as the Pentium 4.
    The Phenom II is essentially the same CPU as the Phenom II.

    *grin*
  • Wesley Fink - Friday, July 17, 2009 - link

    Typo corrected. Thanks for letting us know.

Log in

Don't have an account? Sign up now