Latency vs. Bandwidth: What to Look for in a SSD

It took me months to get my head wrapped around it, but I think I finally get it. We often talk about the concepts of bandwidth and latency but rarely are they as tangible as they are here today.

When I speak of latency I’m talking about how long it takes to complete a request, or fetch a block of data. When I mention bandwidth, I’m talking about how much you can read/write at once. Think of latency as the speed limit and bandwidth as the number of lanes on a high way.

If you’re the only car on the highway, you’re going to notice the impact of latency more than bandwidth. A speed limit of 70 mph instead of 35 is going to impact you much more than if you added more lanes to the road.

If you’re a city planner however and your only concern is getting as many people to work and back, you’re going to notice the impact of bandwidth more than latency. It doesn’t matter how fast a single car can move, what matters is how many cars you can move during rush hour traffic.

I’d argue that if you’re a desktop user and you’re using an SSD as a boot/application drive, what will matter most is latency. After you’ve got your machine setup the way you want it, the majority of accesses are going to be sequential reads and random reads/writes of very small file sizes. Things like updating file tables, scanning individual files for viruses, writing your web browser cache. What influences these tasks is latency, not bandwidth.

If you were constantly moving large multi-gigabyte files to and from your disk then total bandwidth would be more important. SSDs are still fairly limited in size and I don’t think you’ll be backing up many Blu-ray discs to them given their high cost per GB. It’s latency that matters here.

Obviously I’ll be testing both latency and bandwidth, but I wanted to spend a moment talking about the synthetic latency tests.

Iometer is a tool that can simulate any combination of disk accesses you can think of. If you know how an application or OS hits the disk, iometer can simulate it. While random disk accesses are the reason that desktop/notebook hard drives feel so slow, the accesses are generally confined to particular areas of the disk. For example, when you’re writing a file the OS needs to update a table mapping the file you’re writing to the LBAs it allocated for the file. The table that contains all of the LBA mapping is most likely located far away from the file you’re writing, thus the process of writing files to the same area can look like random writes to two different groups of LBAs. But the accesses aren’t spread out across the entire drive.

In my original X25-M article I ran a 4KB random write test over the entire span of the drive. That’s a bit more ridiculous than even the toughest user will be on his/her desktop. For this article I’m limiting the random write test to an 8GB space of the drive; it makes the benchmark a little more realistic for a desktop/notebook workload.

The other thing I’ve done is increased the number of outstanding IOs from 1 to 3. I’ve found that in a multitasking user environment Vista will generally have a maximum of 3 or 4 outstanding IOs (read/write requests).

The combination of the two results in a 100% random file write of 4KB files with 3 outstanding IOs to an 8GB portion of the drive for 3 minutes. That should be enough time to get a general idea of how well these drives will perform when it comes to random file write latency in a worst case, but realistic usage scenario.

The Verdict The Return of the JMicron based SSD
POST A COMMENT

256 Comments

View All Comments

  • KadensDad - Tuesday, October 27, 2009 - link

    How do these drives fail? I have heard that they will just suddenly die, no more writes or reads possible. What I would like to know is what happens when it dies? Do you lose all data? Just can't write anymore? How does the OS respond? Any early warnings? What about e.g. CRC? How does possibility of data corruption compare to traditional SSD? What about RAID? Since the drives are electrical, not mechanical, this reduces the number of failure vectors and environmental concerns (e.g., ambient temperature over lifetime of the drive). Won't SSDs therefore fail closer together in time in a RAID configuration? This reduces the window of opportunity for fixing an array and also decreases the applicability of RAID, however marginal.
    Reply
  • adsmith82 - Monday, September 14, 2009 - link

    I need to run HDDErase on an X25-M. No matter what bootable CD or flash drive I create, HDDErase does not see either of my SATA hard drives. I already disabled AHCI in BIOS. Also, I am using version 3.3. I know that 4.0 does not work with the X25-M.

    Can someone help me troubleshoot this please? Thanks.
    Reply
  • gallde - Thursday, June 11, 2009 - link

    You point out that TRIM will only work on deletions, not on overwrites. But, couldn't a smart controller look at blocks that have a majority of invalid pages and "trim" them as well, recovering clean pages as a background process? Reply
  • forsunny - Thursday, August 13, 2009 - link

    Why not just make the SSDs capable of individual page erases instead of blocks? Problem solved. Reply
  • Ron White - Sunday, August 31, 2014 - link

    Erasing the NAND transistor in an SSD requires such a large jolt of voltage that it would affect surrounding transistors. Reply
  • lyeoh - Friday, May 29, 2009 - link

    Good and informative article.

    Regarding the shill tshen83 who claims that Anandtech cost the drive manufacturers millions of dollars in sales.

    If that is true, Anandtech has saved customers millions of dollars.

    Anandtech should care more about their readers losses than drive manufacturer losses. If Anandtech was a site for drive manufacturers and their shills we wouldn't be reading it.

    To me, if the SSD drive manufacturers lose money, it's their own fault for building crap that has higher write latencies than old fashioned drives with metal discs spinning at 7200RPM or slower. Not anandtech's.

    I can get higher sequential reads and writes by using RAID on old fashioned drives. It is much harder to get lower latency. So Anandtech did the right thing for OCZ.

    Lastly, there might be a way of making your windows machine stutter less even with a crap SSD. Note: I haven't tested the actual effect on an SSD because I don't have an SSD.

    Basically by default when Windows accesses a file on NTFS, it will WRITE to the directory the time of the access. Yep, it writes when it opens files and directories (which are just special files). That might explain the stuttering people see. For a lot of things, Windows has to open files.

    Warning! There are reasons why some people or programs would want to know the last access time of files. Me and my programs don't (and I doubt most people would).

    If you are sure that's true for you (or are willing to take the risk) set NtfsDisableLastAccessUpdate=1 as per:

    http://technet.microsoft.com/en-us/library/cc75856...">http://technet.microsoft.com/en-us/library/cc75856...
    Reply
  • poohbear - Sunday, April 26, 2009 - link

    Brilliant article and very informative on these emerging technology. I wont be buying one anytime soon @ their prices, but good to know we'll FINALLY be replacing convential HDD which are the one component that have been pretty much the same since as far back as i can remember

    "SSDs have +5 armor immunity to random access latency"

    rofl that's the best analogy i've seen on a hardware review site. is every comp geek a RPG geek @ heart?
    Reply
  • Gootch - Sunday, April 19, 2009 - link

    Great article. Realy made me understand what I need to look at before making the plunge. Mistakes and all, my compliments. As for value between the now seemingly drastically improved Vertex vs the X25-M, I compared prices between the two and per Gb, the Intell product for say an 80 Gb drive is Can $5.86/Gb, while the OCZ 60 Gb SSD is Can $6.81/Gb. Now that we are no longer comparing apples and oranges, I think we need to point out that the Intel product is not only faster and maintains it's performance edge better, but it is cheaper per Gb. At least in Canada. I have many OCZ products and I love the company and it's customer support. I can only hope that they will make their SSDs more competitive in the near future, because most consumers will pay the extra 70 bucks and go with the X25 when they pay attention to the numbers, both performance and price. Reply
  • Baffo - Saturday, April 11, 2009 - link

    I could forsee a whole host of issues with encrypting SSD drives, not the least of which is essentially making the drive completely "used" outside of the drive slack space - which would be a temporary reprieve for the reasons discussed in this article. However, I could also see potential performance and lifetime issues since modern encryption uses streaming ciphers (e.g. an entire encrypted block - which may or may not conform to the physical block size will be changed for even one bit change within the block itself). Has anyone looked at the resultant effect on performance due to using encryption - it would be good to compare say Bitlocker, PGP, Checkpoint, and an open source encryption solution (Crypt or something like that?). This could actually become a real driver for moving to on-drive encryption where it would have the opportunity to optimize the encrpytion for the pro/cons of the SSD architecture. Reply
  • brandensilva - Friday, April 10, 2009 - link

    Great article! I respect that OCZ made the necessary changes to make this drive work. I'd rather take a slightly slower drive if it meant consistent performance.

    If my hard drive started to stutter I'd flip out! I'm glad that they took the feedback and instead of selling faulty drives, that would ultimately hurt their brand, they decided to go back to the drawing board and iron out the kinks. I'm not expecting them to compare to Intel's 25-M per price or performance. They don't have nearly the cash or manufacturing capacity to compete with Intel but they do have that small business feel with receiving feedback and making improvements, which is important to customers.

    Lets hope they continue to utilize that aspect of their business and further improve on their products and bring us some reliable SSD's in the future.
    Reply

Log in

Don't have an account? Sign up now