AnandTech Storage Bench 2011

Back in 2011 (which seems like so long ago now!), we introduced our AnandTech Storage Bench, a suite of benchmarks that took traces of real OS/application usage and played them back in a repeatable manner. The MOASB, officially called AnandTech Storage Bench 2011 - Heavy Workload, mainly focuses on peak IO performance and basic garbage collection routines. There is a lot of downloading and application installing that happens during the course of this test. Our thinking was that it's during application installs, file copies, downloading and multitasking with all of this that you can really notice performance differences between drives.

We tried to cover as many bases as possible with the software incorporated into this test. There's a lot of photo editing in Photoshop, HTML editing in Dreamweaver, web browsing, game playing/level loading (Starcraft II & WoW are both a part of the test) as well as general use stuff (application installing, virus scanning). We've included a large amount of email downloading, document creation and editing as well. To top it all off we even use Visual Studio 2008 to build Chromium during the test. The test has 2,168,893 read operations and 1,783,447 write operations. The IO breakdown is as follows:

AnandTech Storage Bench 2011 - Heavy Workload IO Breakdown
IO Size % of Total
4KB 28%
16KB 10%
32KB 10%
64KB 4%

Only 42% of all operations are sequential, the rest range from pseudo to fully random (with most falling in the pseudo-random category). Average queue depth is 4.625 IOs, with 59% of operations taking place in an IO queue of 1. The full description of the test can be found here.

AnandTech Storage Bench 2011 - Heavy Workload

Heavy Workload 2011 - Average Data Rate

AnandTech Storage Bench 2011 - Light Workload

Our light workload actually has more write operations than read operations. The split is as follows: 372,630 reads and 459,709 writes. The relatively close read/write ratio does better mimic a typical light workload (although even lighter workloads would be far more read centric). There's lots of web browsing, photo editing (but with a greater focus on photo consumption), video playback as well as some application installs and gaming. The I/O breakdown is similar to the heavy workload at small IOs, however you'll notice that there are far fewer large IO transfers.

AnandTech Storage Bench 2011 - Light Workload IO Breakdown
IO Size % of Total
4KB 27%
16KB 8%
32KB 6%
64KB 5%

Light Workload 2011 - Average Data Rate

Even with our older (generally less demanding) workloads, the M550—like the M500—don't really stack up all that well compared to the top performers. Provided the pricing is right, we can overlook a lot of this, but if you're after top performance there are definitely better SSDs.

Performance vs Transfer Size Power Consumption
Comments Locked

100 Comments

View All Comments

  • hojnikb - Wednesday, March 19, 2014 - link

    Oh snap, i forgot to reply to @beginner99 :)
  • emn13 - Wednesday, March 19, 2014 - link

    The conclusion of this article is at odds with the benchmarks it includes. There's just a 20% performance difference on the heavy-load test between the 840 EVO and M550 1TB drives, less in lighter workloads. I don't believe a 20% performance difference is perceptible in practice, unless you're really doing long-duration purely disk-limited batch processing, and even then it's not exactly a very interesting difference.

    The appropriate conclusion here is: *any* reasonably modern SSD is more that fast enough that even a heavy workload won't cause user-noticable performance differences. It just doesn't matter. Other factors (e.g. power consumption, power loss protection, price, reliability, support) are what matter.

    The article's conclusion simply doesn't make sense given the numbers shown here.
  • hojnikb - Wednesday, March 19, 2014 - link

    Well, there are some reasonably modern ssds, that user WILL notice the difference. Crucial V4 for expamle..
  • Kristian Vättö - Wednesday, March 19, 2014 - link

    Okay, I'll let Anand know that we no longer need to do reviews because all modern devices are already capable of Facebook, email and text processing.

    In a more serious note, it's true that for light users any modern SSD is fine and that is what I said in the final page:

    "If you're a light user and price is the key purchase factor, then the M500 suffices and saves you money."

    And that is the biggest problem I have with the M550. The M500 already does it for the mainstream user group and to be honest it is the drive I would buy given the current prices.

    However, the M550 doesn't cut it for the enthusiast/professional group who want the best IO performance. It does the job for sure but the enthusiast/professional kind of people usually like the idea of having the best money can buy, even if the differences in real world aren't that big. On the other hand, that's also the user group that can actually take advantage of the extra performance.

    I would argue that there is no middle ground in the SSD market. It's either the mainstream market where price is all that matters and that's where the M500 fits in perfectly. The high-end market is where the performance and features are the main element but the M550 isn't competitive there. Everything in the middle are kinda purposeless - some people will always buy them but they don't have any clear inducement to make them alluring.

    P.S. Don't take the first line too personally or seriously. Sometimes the comments just make me feel like everything is already enough for everyone and we don't need improved hardware.
  • hojnikb - Wednesday, March 19, 2014 - link

    Yeah exactly. m550 really seems kinda redundant (not implying, that better performance isn't good), considering its suppost to be a high performance drive, yet it really compets with mainstream at best.
    I think crucial need to work on firmware department, because as we've seen, there's lots to be squeezed out of this marvell controler. They already have great nand, they just need to make firmware better and they could easily compete in the highend segment.
    Well atleast thats what i think anyway..
  • Cerb - Sunday, March 23, 2014 - link

    Given that read and write latency is consistently higher than other SSDs, I'd bet much of the speed limitations are due to RAIN, which has to be handled in software by the SSD's controller. If so, newer faster controllers are what it would take to improve the speed by any great amount, without sacrificing that feature.
  • emn13 - Wednesday, March 19, 2014 - link

    I'm not saying you shouldn't review these things - I'm extremely interested in the results of these reviews. I'm saying that your own results don't back up your conclusions. It's not just light workloads where the difference is hard to notice - the anandtech 2013 "destroyer" - IIRC which writes a considerable amount, quite a bit more that a light, normal desktop workload (or frankly even a fairly heavy desktop workload) only shows a 20% performance difference. The performance consistency numbers at the steady state are just below 5000 iops, and that's actually slightly better than the EVO 840.

    Notably, there *are* SSD's which are quite a bit slower, and I'm sure there will be SSD's (or are, if you pay enough) that outclass the M550 - but I'm just not seeing that in these results.

    Sorry if I came across as ungracious - it's a little unfair in that I'm commenting now in that it seems I think the coverage is poor. But I'm commenting now, because this is one of the rare articles where I think anandtech's conclusions aren't reasonable. I love your coverage, particularly of SSD's, and have gladly learned a lot from all the in-depth analysis you've done.

    So please don't take this personally (I may have exagerrated) - I really don't understand how given essentially equivalent performance to the 840 EVO in practical terms (and slightly better @ steady state) you can call the performance all that disappointing. It's not a top-performer; but then, it's clearly aimed at the larger capacity/lower-price, and then I really don't see how this conclusion stacks up.
  • emn13 - Wednesday, March 19, 2014 - link

    Hmm, I've gotta admit however that the smaller variants are a lot more disappointing. I'm kind of surprised how *much* slower they are - the 256GB version is less than half as fast on the destroyer, which is really will be noticable :-).
  • Kristian Vättö - Wednesday, March 19, 2014 - link

    Oh, absolutely not. Justified feedback like yours is always welcome :)

    I guess the key here is that I was expecting this to be a high performance drive because that's what Crucial was touting when they briefed us. Obviously I expected the performance to be close to drives like SanDisk Extreme II and OCZ Vector 150 because those are what I categorize as high performance drives. However, what we got is a drive with mediocre performance that didn't meet the expectations I had in my mind, so I can't say I'm satisfied.

    That doesn't mean the M550 is bad because the price is very competitive but I still think it's rather redundant because the M500 is even more competitive in price. If the M550 was to replace the M500, then the scenario (and hence conclusion) would be different but as it stands the M500 will continue to be the king of value.

    The EVO is different in this regard because it was always supposed to be a value drive and Samsung has the 840 Pro to cater the high performance market.
  • nick2crete - Thursday, March 20, 2014 - link

    Kristian ,
    do you think that these performance issues can be minimized/fixed with new firmware(s) from Crucial ?

Log in

Don't have an account? Sign up now