Performance Consistency

We've been looking at performance consistency since the Intel SSD DC S3700 review in late 2012 and it has become one of the cornerstones of our SSD reviews. Back in the days many SSD vendors were only focusing on high peak performance, which unfortunately came at the cost of sustained performance. In other words, the drives would push high IOPS in certain synthetic scenarios to provide nice marketing numbers, but as soon as you pushed the drive for more than a few minutes you could easily run into hiccups caused by poor performance consistency. 

Once we started exploring IO consistency, nearly all SSD manufacturers made a move to improve consistency and for the 2015 suite, I haven't made any significant changes to the methodology we use to test IO consistency. The biggest change is the move from VDBench to Iometer 1.1.0 as the benchmarking software and I've also extended the test from 2000 seconds to a full hour to ensure that all drives hit steady-state during the test.

For better readability, I now provide bar graphs with the first one being an average IOPS of the last 400 seconds and the second graph displaying the standard deviation during the same period. Average IOPS provides a quick look into overall performance, but it can easily hide bad consistency, so looking at standard deviation is necessary for a complete look into consistency.

I'm still providing the same scatter graphs too, of course. However, I decided to dump the logarithmic graphs and go linear-only since logarithmic graphs aren't as accurate and can be hard to interpret for those who aren't familiar with them. I provide two graphs: one that includes the whole duration of the test and another that focuses on the last 400 seconds of the test to get a better scope into steady-state performance.

Steady-State 4KB Random Write Performance

In steady-state performance the SM951 provides a substantial ~70% upgrade over the XP941 and brings performance nearly to the same level with the 850 Pro. Given that the 850 Pro uses faster V-NAND, the steady-state performance is a pleasant surprise and shows that the SM951 is more than a marginal bump from the XP941. Obviously, drives with more default over-provisioning (i.e. Extreme Pro and Neutron XT) provide higher steady-state performance, but Samsung is doing very well with the default 7% over-provisioning. 

Steady-State 4KB Random Write Consistency

The consistency of the SM951 is also great. The Neutron XT is a living proof of a drive with high average IOPS, but horrible consistency because as we can see in the graph above its standard deviation is up to dozens of times higher compared to the other drives. That's just not acceptable for a modern drive, especially because there are many drives that can consistently provide high IOPS.

Samsung SM951 512GB
Default
25% Over-Provisioning

For a dozen seconds or so, the SM951 is actually able to burst out 100K IOPS, but the performance soon drops to below 10K IOPS and eventually evens out at ~7.5K IOPS. The SM951 is very consistent and doesn't experience any notable IOPS drops, whereas the XP941 regularly drops to a few hundred IOs per second. Increasing the over-provisioning to 25% brings the IOPS to about 35K, which is very decent and again much better than the XP941 that still has odd drops in performance. 

Samsung SM951 512GB
Default
25% Over-Provisioning
AnandTech 2015 Client SSD Suite AnandTech Storage Bench - The Destroyer
Comments Locked

128 Comments

View All Comments

  • peevee - Friday, March 20, 2015 - link

    IOmeter? Packing several weeks/months of IO into a several minutes/hours test? Seriously, your tests have become SO artificial as not to correspond to any real life experiences at all. For example, in real life SSD write speed almost does not matter, because almost always they are asynchronous - write happens into cache and user does not wait anything, or speed of writes is limited by the speed of data acquisition - case in point, you download test is always limited by much slower internet speed, or copying pictures off camera/SD card are limited by much slower camera/reader, USB or SD speeds etc. Background backup, happening without a user AT ALL? Come on!
    It would be actually much more interesting to see at least a few REAL numbers, like good old starting Windows or copying a catalog full of pictures and videos or starting a VM. So the users would see what amount of their time they would REALLY save by investing extra into a faster drive.
  • kishisaki - Tuesday, April 7, 2015 - link

    How did you get all those speed with Asus Z97 Deluxe?
    I thought it only has a 10Gb/s M.2 Slot?
  • Gradius2 - Wednesday, April 15, 2015 - link

    My solution is WAYYYY cheaper and bigger, I have 670GB (real size) on my little RAID, see the performance: http://i61.tinypic.com/2vt9mo6.jpg
  • xyvyx2 - Wednesday, July 22, 2015 - link

    I was able to keep the temps down on my SM951 by attaching a small heatsink... I need to do some data logging, but I don't think it's gone over 60C since:
    http://s76.photobucket.com/user/xyvyx/media/Comput...">[IMG]http://i76.photobucket.com/albums/j9/xyvyx/Compute...[/IMG]
  • stevae - Wednesday, August 12, 2015 - link

    why isn't there a trouble shoot included IF your result comes back that the drive DOES NOT have trim working? this is incomplete article.
  • Invisibleman - Sunday, August 16, 2015 - link

    Kristian,

    Because I didn't read this review earlier and I am now planning to upgrade my PC to an M2 SSD. I came to this review.

    But there is one thing I realy don't understand. As the setup is saying, you have tested with de Asus Z97 DeLuxe. I know there are 2 different versions of this one. 1 is with USB 3.1 support (new version) and 1 with USB 3.0 (Old one) this one I have.

    But if I look at the specs then the Z97 DeLuxe shares the bandwide with SataExpress 1 and have only 2 x PCI Express 3.0/2.0 x 16 Slots (Single at 16x or dual at x8/x8 Mode)

    But as I read the SM951 needs to have PCI 3.0 x 4bus. Am I missing something? For me it seems that the SM951 can't run full speed on this board. If it goes thru Sata Express then also get only PCI 3.0 X 2. But in the test (charts) you are mention PCI 3.0 x 4. How is this possible to get if the Max is PCI 3.0 x 2?

    So can you tell me what I am missing? What do I need to do/buy extra to get this one run one full power meaning PCI 3.0 x 4.

    Regards,
    Hans
  • Hoogmade - Monday, December 7, 2015 - link

    What card is used to use the SM951 in a Mac Pro 2012?
    I tried the Addonics ADM2PX4 but that doesn't seem to work.
  • dtscaps - Friday, March 11, 2016 - link

    Ok, this is supposed to be a review to guide me what SSD to buy. I read 10 pages of performance specs and 72 more comments dealing with microseconds marginality. The fact that this drive does or does not have an AES self encrypting mechanism adering to OPAL 2 with a possible IEEE1667 extension IS IMPORTANT. IT IS A COMPLETE SHOW STOPPER if the drive cannot encrypt data. Maybe except if you are a kid playing with new toys.

    So, is this SSD self encrypting ?
    Does it support Opal 2
    Does it support the IEEE1667 extension?

Log in

Don't have an account? Sign up now