AnandTech Storage Bench 2011

Two years ago we introduced our AnandTech Storage Bench, a suite of benchmarks that took traces of real OS/application usage and played them back in a repeatable manner. I assembled the traces myself out of frustration with the majority of what we have today in terms of SSD benchmarks.

Although the AnandTech Storage Bench tests did a good job of characterizing SSD performance, they weren't stressful enough. All of the tests performed less than 10GB of reads/writes and typically involved only 4GB of writes specifically. That's not even enough exceed the spare area on most SSDs. Most canned SSD benchmarks don't even come close to writing a single gigabyte of data, but that doesn't mean that simply writing 4GB is acceptable.

Originally I kept the benchmarks short enough that they wouldn't be a burden to run (~30 minutes) but long enough that they were representative of what a power user might do with their system.

Not too long ago I tweeted that I had created what I referred to as the Mother of All SSD Benchmarks (MOASB). Rather than only writing 4GB of data to the drive, this benchmark writes 106.32GB. It's the load you'd put on a drive after nearly two weeks of constant usage. And it takes a *long* time to run.

1) The MOASB, officially called AnandTech Storage Bench 2011 - Heavy Workload, mainly focuses on the times when your I/O activity is the highest. There is a lot of downloading and application installing that happens during the course of this test. My thinking was that it's during application installs, file copies, downloading and multitasking with all of this that you can really notice performance differences between drives.

2) I tried to cover as many bases as possible with the software I incorporated into this test. There's a lot of photo editing in Photoshop, HTML editing in Dreamweaver, web browsing, game playing/level loading (Starcraft II & WoW are both a part of the test) as well as general use stuff (application installing, virus scanning). I included a large amount of email downloading, document creation and editing as well. To top it all off I even use Visual Studio 2008 to build Chromium during the test.

The test has 2,168,893 read operations and 1,783,447 write operations. The IO breakdown is as follows:

AnandTech Storage Bench 2011 - Heavy Workload IO Breakdown
IO Size % of Total
4KB 28%
16KB 10%
32KB 10%
64KB 4%

Only 42% of all operations are sequential, the rest range from pseudo to fully random (with most falling in the pseudo-random category). Average queue depth is 4.625 IOs, with 59% of operations taking place in an IO queue of 1.

Many of you have asked for a better way to really characterize performance. Simply looking at IOPS doesn't really say much. As a result I'm going to be presenting Storage Bench 2011 data in a slightly different way. We'll have performance represented as Average MB/s, with higher numbers being better. At the same time I'll be reporting how long the SSD was busy while running this test. These disk busy graphs will show you exactly how much time was shaved off by using a faster drive vs. a slower one during the course of this test. Finally, I will also break out performance into reads, writes and combined. The reason I do this is to help balance out the fact that this test is unusually write intensive, which can often hide the benefits of a drive with good read performance.

There's also a new light workload for 2011. This is a far more reasonable, typical every day use case benchmark. Lots of web browsing, photo editing (but with a greater focus on photo consumption), video playback as well as some application installs and gaming. This test isn't nearly as write intensive as the MOASB but it's still multiple times more write intensive than what we were running in 2010.

As always I don't believe that these two benchmarks alone are enough to characterize the performance of a drive, but hopefully along with the rest of our tests they will help provide a better idea.

The testbed for Storage Bench 2011 has changed as well. We're now using a Sandy Bridge platform with full 6Gbps support for these tests.

AnandTech Storage Bench 2011 - Heavy Workload

We'll start out by looking at average data rate throughout our new heavy workload test:

Heavy Workload 2011 - Average Data Rate

In lighter workloads than our 2013 workload the EVO still does incredibly well.

Heavy Workload 2011 - Average Read Speed

 

Heavy Workload 2011 - Average Write Speed

AnandTech Storage Bench 2011 - Light Workload

Our new light workload actually has more write operations than read operations. The split is as follows: 372,630 reads and 459,709 writes. The relatively close read/write ratio does better mimic a typical light workload (although even lighter workloads would be far more read centric).

The I/O breakdown is similar to the heavy workload at small IOs, however you'll notice that there are far fewer large IO transfers:

AnandTech Storage Bench 2011 - Light Workload IO Breakdown
IO Size % of Total
4KB 27%
16KB 8%
32KB 6%
64KB 5%

Light Workload 2011 - Average Data Rate

Light Workload 2011 - Average Read Speed

Light Workload 2011 - Average Write Speed

 

Performance vs. Transfer Size Power Consumption
Comments Locked

137 Comments

View All Comments

  • Timur Born - Sunday, July 28, 2013 - link

    Just did a quick test: On my 8 gb RAM system Windows 8 uses quite exactly 1 gb for write caching and all available RAM for read caching. It doesn't matter whether the 1 gb consist of one or several files and whether they fit into the cache as a whole or not (first 1 gb is cached if not).
  • 1Angelreloaded - Friday, July 26, 2013 - link

    Hold on a second correct me if I'm wrong on this paradox. Did Samsung not scale back on NAND production in order to drive the price up for greater bloated profits, now as stated in Korea press conference they want "SSDs for everyone". WTF is going on here, and why are SSDs not at more reasonable pricing by now about .33cents per gig.?They had a complete shot at burying HDDs after the flood and the price hike.
  • FunBunny2 - Friday, July 26, 2013 - link

    Don't confuse capitalists with intelligence. They look at unit margin and ignore gross profit. IOW, they'd rather sell 100 at $2 margin than 1,000 at $1 margin. They're stupid.
  • MrSpadge - Saturday, July 27, 2013 - link

    There's also the factor of marget saturation to take into account. You can't sell an infinite number of drives.
  • Notmyusualid - Friday, July 26, 2013 - link

    Exciting technology indeed! Impressive numbers, nice identification of spare computer resources, and put to good use too. I'd imagine this would be the go-to drive for most users...

    But I'd like my clocks available for my applications thanks.

    In addition, I'm not willing to put my data on any non-enterprise disk now, cost be damned. Burned too many times now.

    Interesting product though....
  • z28dreams - Friday, July 26, 2013 - link

    I recently saw the Plextor M5P (pro) for $190 on sale.

    If the 840 evo comes out in the same price range, which would be a better buy?

    It looks like the write seems of the M5P are better, but I'm not about overall performance.
  • K_Space - Friday, July 26, 2013 - link

    Help a noob here: How is Rapid any different to a custom nonvolatile RAM disk with your selected cached files stored on it & these being written to the SSD at an interval? Is it mainly because Rapid can writes in blocks and it's more intelligent in its choice of cached files?
  • wpapolis - Saturday, July 27, 2013 - link

    Hey there all,

    I have a MacBook 13" from late 2008, the first gen of the unibody construction (Model MB467*/A).

    My bus speed is SATA 3Gbit/s.

    What's the best SSD for me?

    Trim doesn't work automatically for me, though I have found the commands to use in terminal to enable it.

    This Samsung drives looks really good, but it seems like I won't be able to use RAPID, or perhaps even TRIM. Plus I am limited by my bus speed. Should I still go for this Samsung just because the price might be the same as lower featured alternatives?

    What do you guys suggest? I want one in the 250GB range.

    Thanks,

    Bill
  • TheinsanegamerN - Saturday, July 27, 2013 - link

    if you have a mac, the samsung is your best bet. TRIM can be enabled quite easily on a mac if it is not done automatically, so you can use trim. as for RAPID, it replaces window's terrible i/o caching process. osx does not have this problem, so you dont have to worry about that. now, the sata2 interface will be a bottleneck, but it will still be much faster than a hard drive. id go for either this evo drive or the 840 250gb
  • wpapolis - Saturday, July 27, 2013 - link

    Yes, you reaffirmed what I was already thinking.

    Plus, when I upgrade this MacBook, I have the option to move the drive. Though, I have to say, performance is still pretty good, but each OS upgrade seems to make things a bit more sluggish.

    With 8GB RAM, and a current SSD, things should be good for a bit longer.

    Thanks for the feedback,

    Bill

Log in

Don't have an account? Sign up now