Software

With the variety of disk drive benchmarks available, we needed a means of comparing the true performance of the hard drives in real world applications. While we will continue to utilize HDTach and PCMark05 for comparative benchmarks our logical choice for application benchmarking is the Intel iPEAK Storage Performance Toolkit version 3. We originally started using this storage benchmark application in our Q2 2004 Desktop Hard Drive Comparison: WD Raptor vs. the World article. The iPEAK test can be designed to measure "pure" hard disk performance, and in this case, we kept the host adaptor consistent while varying the hard drive models. The idea is to measure the performance of individual hard drives with a consistent host adaptor.

We utilize the iPEAK WinTrace32 program to record precise I/O operations when running real world benchmarks. We then utilize the iPEAK AnalyzeTrace program to review the disk trace file for integrity and ensure our trace files have properly captured the activities we required. Intel's RankDisk utility is used to play back the workload of all I/O operations that took place during the recording.

RankDisk generates results in a mean service time in milliseconds format; in other words, the average time that each drive took to fulfill each I/O operation. In order to make the data more understandable, we report the scores as an average number of I/O operations per second so that higher scores translate into better performance in all of our iPEAK results. While these measurements will provide a score representing "pure" hard drive performance, the actual impact on the real world applications can and will be different.

The drive is formatted before each test run and three tests are completed on each drive in order to ensure consistency in the benchmark results. The high and low scores are removed with the remaining score representing our reported result. We utilize the NVIDIA nF4 SATA ports along with the NVIDIA IDE-SW driver to ensure consistency in our playback results when utilizing NCQ, TCQ, or RAID settings.

Our iPEAK tests represent a fairly extensive cross section of applications and usage patterns for both the general and enthusiast user. We will continually tailor these benchmarks with an eye towards the drive's intended usage and feature set when compared to similar drives. In essence, although we will report results from our test suite for all drives, it is important to realize a drive designed for PVR duty will generate significantly different scores in our gaming benchmarks than a drive designed with gaming in mind such as the WD Raptor. This does not necessarily make the PVR drive a bad choice for those who capture and manipulate video while also gaming. Hopefully our comments in the results sections will offer proper guidance for making a purchasing decision in these situations.

Our iPEAK Test Suite consists of the following benchmarks

VeriTest Business Winstone 2004 - trace file of the entire test suite that includes applications such as Microsoft Office XP, WinZip 8.1, and Norton Antivirus 2003.

VeriTest Multimedia Content Creation 2004 - trace file of the entire test suite that includes applications such as Adobe Photoshop 7.01, Macromedia Director MX 9.0, Microsoft Windows Media Encoder 9.0, Newtek Lightwave 3D 7.5b, and others.

AVG Antivirus 7.1.392 - trace file of a complete antivirus scan on our test bed hard drive.

Microsoft Disk Defragmenter - trace file of the complete defragmentation process after the operating system and all applications were installed on our test bed hard drive.

WinRAR 3.51 - trace file of creating a single compressed folder consisting of 444 files in 10 different folders totaling 602MB. The test is split into the time it takes to compress the files and the time it takes to decompress the files.

File Transfer - individual trace files of transferring the Office Space DVD files to our source drive and transferring the files back to our test drive. The content being transferred consists of 29 files with a data content of 7.55GB.

AnyDVD 5.9.6 - trace file of the time it takes to "rip" the Office Space DVD. We first copy the entire DVD over to our Seagate 7200.10 750GB source drive, defragment this drive, and then measure the time it takes for AnyDVD to "rip" the contents to our test drive. While this is not ideal, it does remove the optical drive as a potential bottleneck during the extraction process and allows us to track the write performance of the drive.

Nero Recode 2 - trace file of the time it takes to shrink the entire Office Space DVD that was extracted in the AnyDVD process into a single 4.5GB DVD image.

Video Streaming - trace file of the time it takes to capture and record Chapter 11 of Office Space with our NVIDIA DualTV MCE tuner card while viewing Chapter 10 utilizing PowerDVD 6. Chapter 10 has already been recorded and is playing from our source drive while Chapter 11 is being streamed from our Media Server.

Audio Encoding / Video Capture - trace file of the time it takes Nero Digital Audio to extract all 16 tracks from the INXS Greatest Hits CD and convert them into an mp4 format while capturing and recording Chapter 11 of Office Space with our NVIDIA tuner card. We changed the Nero default quality settings to transcoder-ultra, variable bit rate, encoder quality to high, and the AAC profile to LC.

Game Installation - individual trace files of the time it takes to install Oblivion, Sims2, and Battlefield 2. We copy each DVD to our secondary Seagate 750GB drive, defragment the drive, and then install each game to our source drive.

Game Play - individual trace files that capture the startup and about 15 minutes of game play in each game. Our Oblivion trace file consists of visiting 16 different areas within the game, interacting with individual characters, and passing through three different gates. The Sims2 trace file consists of the time it takes to select a pre-configured character, setup a university, downtown, business from each expansion pack (pre-loaded), and then visit each section before returning home. Our final trace file utilizes Battlefield 2 and we play the Daquing Oilfield map in both single and multiplayer mode.

Feature Set and Hardware Testbed Features and Low Level Comparisons
Comments Locked

11 Comments

View All Comments

  • driveguy - Monday, June 26, 2006 - link

    I do not understand why the YD family was reviewed so late in it's life.

    The YS familily has been introduced from 160-500GB on a common platform.

    It would make much more sense to review the current product.
  • Gary Key - Monday, June 26, 2006 - link

    quote:

    I do not understand why the YD family was reviewed so late in it's life.


    We reviewed the recent product life update to the YD family that changed it to the RE16 family with 16MB cache and 3GB/s SATA support. The YS family (160GB~320GB range) just started shipping in volume earlier this month and samples are arriving shortly in the 160GB and 250GB sizes. We received the 320GB YS today that will be tested against the other 320GB drives from Western Digital and Seagate in the near future. Thank you for the comments.
  • driveguy - Tuesday, June 27, 2006 - link

    Hi Gary,

    Thank you for your response.

    YS goes from 160GB to 500GB. The real attraction for the RE products is reliability more than performance. This is really not something you can review because you will not have access to field failure rates but these drives have done quite well in high duty cycle envirements. They have crushed STX NL models in the market with the absolute lion's share of this market.
  • Gary Key - Wednesday, June 28, 2006 - link

    Hi,

    I could have been a little clearer in my 160GB~320GB statement, my point was those drive sizes just started shipping in volume this month. The 400GB and 500GB drives were shipping in May although we have not received the 400GB sample yet. I think with the YS series WD has brought the nearline performance up to and at times exceeding the SE16 line now. I think it will be interesting comparing the NL35.2 to the WD YS series since both are new product releases. We are implementing a 16 drive RAID chassis for enterprise/benchmark testing shortly so we should be able to look at some failure rate information this time next year in this market segment.

    Thanks...
  • Squidward - Monday, June 26, 2006 - link

    By looking at this article and others I've seen the Raptor is hands down the best drive you can get without going into SCSI drives. How does that apply to real usage, is the difference that notable versus the other drives in this article? I've been considering buying one if the difference is truly noticable, particularly as it applies to game loading times and recording tv programs.
  • tallman45 - Saturday, June 24, 2006 - link

    Nice job as always with the review.

    A more valuable comparison IMHO though would have been like cost competitors such as the new 74GB 16mb cache Raptor and the 7200.10 320gb Seagate. It stands to reason that a $300 150GB Raptor had better outperform a $90 250gb YD
  • Gary Key - Saturday, June 24, 2006 - link

    Hi,

    We have the new 74GB 16MB cache Raptor arriving in about 10 days. We have completed our testing on the Seagate 320GB 7200.10 and are in the process of completing several other 200GB~320GB drives for a desktop roundup shortly in what we believe is the best price to performance range at this time. Our 500GB roundup and PVR article will be available in late July. As stated in the article we will also do a separate review on RAID performance with both nearline enterprise and desktop drives in the near future. The process of adding additional multi-tasking benchmarks along with doing both hardware (Areca) RAID and soft (nF500) RAID is painstakingly slow. ;->
    The other process we have setup is an additional test bench that is currently running previously reviewed drives 24/7 with varying stress tests so we can start reporting on reliability and doing a quick follow-up on the drives performance every few months. In about two weeks, you should start seeing storage articles from us about every 10 days.

    Thank you for the comments.
  • Gary Key - Saturday, June 24, 2006 - link

    Where is the edit button? :) I meant to end my reply with "storage reviews from us about every 10 days or less."
  • dhei - Saturday, June 24, 2006 - link

    150gig raptor is around $200 now...
  • dhei - Saturday, June 24, 2006 - link

    forgot to add the 75gig Raptor is only $130. In terms of pure performance most people would go for the little premium in price for Raptor than more hd space. They just get a 200+gig drive for backup and install main apps on raptor.

Log in

Don't have an account? Sign up now