Problem 2: Why did things get slower?

In our initial look at Santa Rosa and Intel's Turbo Memory we generally found that performance wasn't improved and in some cases it got significantly worse. Take for example the amount of time the notebook took to go into hibernate mode:

With Turbo Memory enabled, the system took another 11 seconds to hibernate. Going back to our explanation of what Turbo Memory is supposed to do, it isn't supposed to reduce hibernate time at all. At best, the ReadyBoost portion of Turbo Memory can make data available a little quicker after waking up from hibernation but that's it. Needless to say, the technology isn't designed to make hibernation times any slower. Clearly we needed to do some digging.

In our first article we showed no performance difference between Turbo Memory enabled vs. disabled in the PCMark '05 HDD test. Given that we disabled Turbo Memory using the console it appears that it remained enabled in both tests, making the scores useless. Armed with our new found information on how to properly test with Turbo Memory, we took another look at PCMark '05.

The PCMark '05 HDD test is composed of real world disk usage, played back in a manner similar to what we do in our hard drive reviews. The individual tests are as follows:

Windows XP Startup: This is the Windows® XP start trace, which contains disk activities occurring at operating system start-up. The test is 90% reading and 10% writes. This trace contains no user activity.

Application Loading: This is a trace containing disk activities from loading various applications. It includes opening and closing of the following applications:

- Microsoft® Word

- Adobe® Acrobat® Reader 5

- Windows® Media Player

- 3DMark®2001SE

- Leadtek® Winfast® DVD

- Mozilla Internet Browser

The application loading trace is 83% reads and 17% writes.

General Hard Disk Drive Usage: This trace contains disk activities from using several common applications. These are:

- Opening a Microsoft® Word document, performing grammar check, saving and closing

- Compression and decompression using Winzip

- Encrypting and decrypting a file using PowerCrypt

- Scanning files for viruses using F-Secure® AntivirusTM.

- Playing an MP3 file with Winamp

- Playing a WAV file with Winamp

- Playing a DivX video using DivX codec and Windows® Media Player

- Playing a WMV video file using Windows® Media Player

- Viewing pictures using Windows® Picture Viewer

- Browsing the internet using Microsoft® Internet Explorer

- Loading, playing and exiting a game using UbisoftTM Tom Clancy's Ghost Recon

The General Usage trace is 60% reads and 40% writes.

Virus Scanning: Virus scanning is a critical task in today's PC usage. As the major bottleneck of scanning viruses is in hard disk activity, it is reasonable to include virus scanning as a HDD test. The test consists of HDD activity of scanning 600MB of files for viruses. The Virus Scanning test is mostly disk reading (99.5%).

File Write: This trace contains disk activities from writing 680MB files on the hard disk and no read operations are involved in this test.

Disk idle times have been compressed to 50 milliseconds to speed up the playback time. Our studies showed that 50 milliseconds was the smallest idle time interval that didn't affect the test results. The results of the HDD tests are reported in Megabytes processed per second.

Basically PCMark takes the disk accesses from these various usage patterns and plays them back as fast as possible. The tests are grounded in the real world but the actual performance metrics that result are skewed to favor very fast disk subsystems. In the case of Turbo Memory, we're testing its prefetching algorithms for getting data into the cache.

Turbo Memory State XP Startup Application Loading General Usage Virus Scan File Write
Disabled 6.286 MB/s 5.109 MB/s 4.314 MB/s 47.496 MB/s 28.739 MB/s
Enabled 12.209 MB/s 10.437 MB/s 10.1043 MB/s 47.806 MB/s 18.657 MB/s

The results are particularly impressive, performance in the XP Startup, Application Launch and General Usage tests is at worst double with Turbo Memory enabled. Clearly the same isn't true in the real world as we weren't able to measure any improvements in system boot or application start times, but the technology is working at least in this controlled environment.

The numbers that are most intriguing are the file write numbers, because this is the only test were performance goes down when Turbo Memory is enabled. The write speed to the flash memory isn't nearly as good as to our 7K100 test drive, which echoes what we saw with the hibernate entry test, which is fairly write intensive.

According to Intel, the system hibernating shouldn't be slowed down by Turbo Memory but Intel engineers have duplicated the test results we're seeing. It seems like the write speed of the flash memory is to blame here, causing performance degradation when there's a lot of writing (e.g. hibernating). Whether or not this behavior can be seen on all Santa Rosa laptops has yet to be determined, but it is a definite issue we've encountered with Turbo Memory.

Problem 1: A Poorly Written Control Panel Problem 3: Keeping that drive spun down
Comments Locked

31 Comments

View All Comments

  • casket - Wednesday, June 20, 2007 - link

    "If you add more memory to laptop, you use more power, emit more heat, etc"
    -- Using this logic... adding ReadyBoost (which is memory) would also use more power, emit more heat, etc...

    The key here is that either readyboost or memory uses less power than a spinning hard drive. I would suspect you get the same power savings with more memory as well.
  • yyrkoon - Wednesday, June 20, 2007 - link

    I dont know about anyone else, but I am starting to resent Intel using town names of the area I grew up in as a kid. You would think they could be a little more original.
  • PrinceGaz - Wednesday, June 20, 2007 - link

    quote:

    The only issue with WorldBench is that each test has a reboot before and after it runs, which makes the benchmark less real world since you don't normally reboot your notebook every 6 minutes; that being said, it's still worth a look.


    I'd say that if it reboots every 6 minutes or so to re-run the test, it isn't worth a look and is totally useless as a notebook baterry-life benchmark as it in now ay reflects real-world usage, and all results using it should be discarded. Surely a better benchmark could be found than that. Unfortunately, removing the WorldBench results make Turbo Memory seem next to useless, which is understandable as it is likely to have been mainly the reduced HD activity when rebooting that the Turbo Memory was helping with.
  • JarredWalton - Wednesday, June 20, 2007 - link

    And yet, the mocked up WorldBench 6 test shows a rather impressive 12% increase in battery life. It seems that the startup/shutdown process at the very least gets a decent benefit (in terms of battery life) from Turbo Memory. That indicates that the power savings from putting the hard drive to sleep are definitely tangible.
  • redly1 - Wednesday, June 20, 2007 - link

    I would like to buy this and test it out with my tablet PC. Anyone know where I can buy one of these mini-PCIe cards?
  • skaaman - Monday, June 25, 2007 - link

    Here is the part# NVCPEMWR001G110

    You can pick them up for under $35
  • BD2003 - Wednesday, June 20, 2007 - link

    The problem I have with the article is that in general, they are still running benchmarks that do not reflect how an actual user interacts with their laptop, and do not really reflect the benefits that turbo memory/readydrive/readyboost would have.

    PCMark is supposed to give a number as to how fast your computer can run a barrage of application tests - but looping it over and over does not even come close to reflecting an actual usage pattern.

    Now granted, they need a *repeatable* test to have numbers that are comparable, but that does not necessarily speak of the validity of the numbers.

    For the average office laptop, you'll be running outlook, word, excel etc - the amount of data actually being loaded and saved is VERY small vs. large amounts from a benchmark, and in that very common scenario, the drive would rarely have to spin up, and the battery savings would probably be much closer to the ideal of 30 mins than what their benches showed.

    I do agree with them on their final conclusion - 1gb is just not enough for more than basic office tasks. In order for this to really take off, to be able to cache an entire movie, they're going to need cache on the order of 4gb. Then I think it'll really make a difference battery/performance wise.

    And they really, really need to fix the driver issues.
  • BikeDude - Wednesday, June 20, 2007 - link

    If the movie is 4GB, a 1GB cache means (ideally) you will spin up the hard drive four times to load the next GB. I doubt you'll see much benefit from a 4GB cache in such a scenario.

    That said, the test didn't do any read ahead tests. All the descriptions so far seem to say the technology caches stuff already read. I.e. if streaming a movie from the hard disk there's nothing that will suck it all into a cache... (grrrr, this reminds me that my Hauppague TV tuner streams everything to a 7MB file which it then plays back -- works fine as long as I don't hit the same drive with heavy IO)
  • sorr - Wednesday, June 20, 2007 - link

    i'd just use another Gigabyte of memory i.e, 2 GB in total and hybrid drive for now, then after 2~3 years just use the SSD when it comes down in price and goes up in capacity
  • SilthDraeth - Wednesday, June 20, 2007 - link

    Page 4 mentions Windows XP. I thought I read the article, but maybe I am missing something. I thought it was purely for Vista, but XP is mentioned several times.

    Please explain, because I am confused. Thanks.

Log in

Don't have an account? Sign up now