AnandTech Storage Bench

To avoid any potential optimizations for industry standard benchmarks and to provide another example of real world performance we've assembled our own storage benchmarks that we've creatively named the AnandTech Storage Bench.

The first in our benchmark suite is a light/typical usage case. The Windows 7 system is loaded with Firefox, Office 2007 and Adobe Reader among other applications. With Firefox we browse web pages like Facebook, AnandTech, Digg and other sites. Outlook is also running and we use it to check emails, create and send a message with a PDF attachment. Adobe Reader is used to view some PDFs. Excel 2007 is used to create a spreadsheet, graphs and save the document. The same goes for Word 2007. We open and step through a presentation in PowerPoint 2007 received as an email attachment before saving it to the desktop. Finally we watch a bit of a Firefly episode in Windows Media Player 11.

There’s some level of multitasking going on here but it’s not unreasonable by any means. Generally the application tasks proceed linearly, with the exception of things like web browsing which may happen in between one of the other tasks.

The recording is played back on all of our drives here today. Remember that we’re isolating disk performance, all we’re doing is playing back every single disk access that happened in that ~5 minute period of usage. The light workload is composed of 37,501 reads and 20,268 writes. Over 30% of the IOs are 4KB, 11% are 16KB, 22% are 32KB and approximately 13% are 64KB in size. Less than 30% of the operations are absolutely sequential in nature. Average queue depth is 6.09 IOs.

The performance results are reported in average I/O Operations per Second (IOPS):

AnandTech Storage Bench - Typical Workload

The higher capacity SandForce drives rule the roost here, but the C300, X25-M G2 and V+100 are not too far behind. Despite its age, Intel's X25-M G2 performs very well in our light usage test. The V+100 isn't far behind thanks to its 8.5% improvement over the original V+.

As far as small capacity drives go, the Corsair Force F40 and other similarly sized SandForce drives are the clear winners here. Crucial's 64GB RealSSD C300 is quicker than the X25-V, but no match for the 40GB SF drive.

If there’s a light usage case there’s bound to be a heavy one. In this test we have Microsoft Security Essentials running in the background with real time virus scanning enabled. We also perform a quick scan in the middle of the test. Firefox, Outlook, Excel, Word and Powerpoint are all used the same as they were in the light test. We add Photoshop CS4 to the mix, opening a bunch of 12MP images, editing them, then saving them as highly compressed JPGs for web publishing. Windows 7’s picture viewer is used to view a bunch of pictures on the hard drive. We use 7-zip to create and extract .7z archives. Downloading is also prominently featured in our heavy test; we download large files from the Internet during portions of the benchmark, as well as use uTorrent to grab a couple of torrents. Some of the applications in use are installed during the benchmark, Windows updates are also installed. Towards the end of the test we launch World of Warcraft, play for a few minutes, then delete the folder. This test also takes into account all of the disk accesses that happen while the OS is booting.

The benchmark is 22 minutes long and it consists of 128,895 read operations and 72,411 write operations. Roughly 44% of all IOs were sequential. Approximately 30% of all accesses were 4KB in size, 12% were 16KB in size, 14% were 32KB and 20% were 64KB. Average queue depth was 3.59.

AnandTech Storage Bench - Heavy Multitasking Workload

This is another one of those SYSMark-like situations. The old Toshiba controller did just awesome in our heavy multitasking workload and the new update does even better. At 1135 IOPS, the V+100 is 55% faster than the Indilinx based Corsair Nova. Thanks to the incompressible nature of much of the data we're moving around in this benchmark the SandForce drives don't do so well. Although not pictured here, the 256GB C300 would be #2 - still outperformed by the V+100.

The gaming workload is made up of 75,206 read operations and only 4,592 write operations. Only 20% of the accesses are 4KB in size, nearly 40% are 64KB and 20% are 32KB. A whopping 69% of the IOs are sequential, meaning this is predominantly a sequential read benchmark. The average queue depth is 7.76 IOs.

AnandTech Storage Bench - Gaming Workload

The perplexing nature of the V+100 continues here. While it boasts great sequential read numbers, the smaller and somewhat random accesses drop the V+100 behind the SandForce and Crucial SSDs.

Overall System Performance using SYSMark 2007 Power Consumption
Comments Locked

96 Comments

View All Comments

  • 7Enigma - Friday, November 12, 2010 - link

    I've ready your other posts and you are selecting a very specific situation which most people will not encounter (that is copy/paste using XP with no SSD tweaks). That's like putting in an NVIDIA video card and not installing the drivers and complaining about performance. The XP OS was designed so far before SSD's were even available to enterprise markets let alone the consumer space its no wonder they don't perform well.

    The vast majority of people are no longer on XP (trust me I was one of the last to hold out due to my dispise for Vista). But you are artificially setting limitations on a product and then using it to generalize performance in all situations that are to you "real world".

    I have real concerns about the Sandforce drives due to variable performance. I have an Intel 80gig G2 SSD and am still amazed at how well it does (to me) in the most important benchmarks, that is random read/write and sequential read. Even with the cheap(er) pricing of SSD's and the *hopefully* significant decrease once we get to the next node with Intel's 3rd generation these are still not capable of storing the majority of our data (unless you think 1-2 grand is chump change). That being said these are mainly going to be access drives and rarely used for moving large amounts of data around (which is why the sequential write becomes much less important for day to day use, besides the odd large install such as a video game).

    I keep my 80gig with about 45GB free. Win7 install (including User data), a couple programs, the current 1-3 games I'm playing and that's it. I have a 250GB secondary 7200rpm drive for music/movies/etc. and a larger external HDD for backup and infrequently used data.
  • Out of Box Experience - Friday, November 12, 2010 - link

    Quote:
    these are mainly going to be access drives and rarely used for moving large amounts of data around (which is why the sequential write becomes much less important for day to day use, besides the odd large install such as a video game).
    ---------------------------------------------------------------------------------------

    In that case, I'd grab a Crucial Real SSD
    Best read speeds now on Sata 2 and reasonable for Sata 3

    64GB is very reasonably priced for the read speeds you will get
  • Out of Box Experience - Monday, November 15, 2010 - link

    Quote:
    The vast majority of people are no longer on XP (trust me I was one of the last to hold out due to my dispise for Vista). But you are artificially setting limitations on a product and then using it to generalize performance in all situations that are to you "real world".
    -------------------------------------------------

    Where did you get that incorrect data?
    It will be a few years before Windows 7 sells more copies than XP

    XP is still used on more computers than Vista and Windows 7 combined!

    Any SSD manufacturer who misleads their customers into thinking that their SSD's are plug and play compatible with XP by omission of pertinent information should go into spam marketing!

    Why should the consumer spend another $200 for a new OS to use a Vertex when Intel SSD's work just fine with XP without all the tweaks?
  • ceomrman - Friday, November 12, 2010 - link

    I can't stand all the SSD articles with no real world benchies at all. I don't care about transfer speed or even IOPS. I care about how fast it boots, how fast it loads my work, displays my porn, plays my games, etc.
  • slickr - Friday, November 12, 2010 - link

    I only see theoretical performances of the drives, while this is some indication of how it would perform in real case scenarios, its not the most accurate and its hard to translate into real world.

    I would like some tests that test all of the SDD's abilities at once.
    For example running a virus scan while pasting 2GB or big and small data, while moving hundreds of pictures into a image viewer, all on top while downloading a torrent and surfing the web.
  • B - Friday, November 12, 2010 - link

    Great Table. Would be nice if there was a column identifying which controller was used in each of the drives.
  • snakyjake - Friday, November 12, 2010 - link

    Objective performance measurements are good to have, however these comments are suggesting some difficulties in interpretation because the majority of us don't know how to relate to a synthetic benchmark. My recommendation is to create some user profiles (gamer, video artists, graphics artist, serious web surfer, media PC, low power, etc). Have some people utilize the machines and ask for their feedback.

    Because here's my bottom line: I don't want to pay for more than I'll notice. If PEOPLE can't tell the difference between a top synthetic rated drive versus middle of the pack....then I don't want to pay extra.

    For example: If a more expensive SSD drive will not speed up my Media Center PC, I don't want to pay the extra. I want to know what a real person thinks and experiences. Rather talk to my buddies than get comments from a robot performing synthetic tests.
  • GullLars - Friday, November 12, 2010 - link

    Dear Anand, I would love a reply here, since I've raised these points in the past, and been ignored.
    "Concerned enough to recommend running it with 20% free space at all times (at least). The more free space you have, the better job the controller can do wear leveling."
    I feel the need to critique this statement. If TRIM is not active, there is no difference whatsoever if you use 10% or 100% of the LBAs avalible to the user, since the drive can't tell the difference.
    The only way you could make sure 20% of the NAND is free at all times is to not partition it in the first place (or not include it in a partition after a secure erase).

    Also, you've included 4KB random write at QD 32, but still not 4KB random read. If you compare your results, you will see a much larger difference between read performance as QD scales than you do for write. This is due to write coalessing and attenuation, while reads don't have this benefit.
    I feel both random read and write @ QD 32 should be included to show what the drives are capable of within the NCQ spec. Ideally would be a graph showing IOPS by QD scaling, but i understand that it may be a bit much work.
    When benchmarking my own SSDs, i scale 4 dimentions in IOmeter; Read:write ratio, seq:ran ratio, block size, and QD. Due to size of the data set, i only scale them against each other at 4KB and a couple of larger sizes. A few thousand data points is enough pr drive :P
  • Ao1 - Saturday, November 13, 2010 - link

    Quote:
    “SandForce's partners who have to pay a big chunk of their margins to SandForce as well as the NAND vendor are actually delivering the best value in SSDs. Kingston and Western Digital also deliver a great value. Not Crucial/Micron and not Intel, which is not only disappointing but inexcusable. These companies actually own the fabs where the NAND is made and in the case of Intel, they actually produce the controller itself”.

    Are you forgetting that Intel spent over 2 billion on the JV with Micron? They are the ones carrying the investment risk, not the likes of OCZ.

    Also Intel spend money and time on getting their products right before market and use much higher quality components throughout, not least better QA’d NAND. (Intel do not sell SSD grade NAND. They sell NAND that has to be further processed by whoever buys it).

    You have consistently ignored these facts and they make a big difference.

    Whilst I’m at it I can’t understand your assertion that SF drives are so good. There are countless problems with them even now after numerous f/w updates. They degrade badly with uncompressible data, they have weak GC and they don’t trim in the same way as other drives. It’s quite easy to see performance drop by 50%, even OCZ have admitted that. Read performance, without writing also degrades.

    I used to look forward to your reviews but it seems your objectivity when it comes to the X25 and C300 in favour of SF drives is seriously lacking.
  • Ao1 - Saturday, November 13, 2010 - link

    From OCZ's forum:

    "Here is the thing, if you hammer the driver with say enough writes that the drive would under normal use/see in 7 days within a few hrs, the drive will slow down for 7 days, maybe longer. It does this to protect the nand life. So your guys seeing a 50% drop may actually see 30% which is the normal drop, then a further 20% because at some stage they have hammered the drive and then not realised its going to take 5 days or longer for the speed to creep back up. Also remember this write quantity slowdown is further impacted by how you use the drive after you have hammered it."

    http://www.ocztechnologyforum.com/fo...l=1#post528...

Log in

Don't have an account? Sign up now