A Quick Flash Refresher

DRAM is very fast. Writes happen in nanoseconds as do CPU clock cycles, those two get along very well. The problem with DRAM is that it's volatile storage; if the charge stored in each DRAM cell isn't refreshed, it's lost. Pull the plug and whatever you stored in DRAM will eventually disappear (and unlike most other changes, eventually happens in fractions of a second).

Magnetic storage, on the other hand, is not very fast. It's faster than writing trillions of numbers down on paper, but compared to DRAM it plain sucks. For starters, magnetic disk storage is mechanical - things have to physically move to read and write. Now it's impressive how fast these things can move and how accurate and relatively reliable they are given their complexity, but to a CPU, they are slow.

The fastest consumer hard drives take 7 milliseconds to read data off of a platter. The fastest consumer CPUs can do something with that data in one hundred thousandth that time.

The only reason we put up with mechanical storage (HDDs) is because they are cheap, store tons of data and are non-volatile: the data is still there even when you turn em off.

NAND flash gives us the best of both worlds. They are effectively non-volatile (flash cells can lose their charge but after about a decade) and relatively fast (data accesses take microseconds, not milliseconds). Through electron tunneling a charge is inserted into an N-channel MOSFET. Once the charge is in there, it's there for good - no refreshing necessary.


N-Channel MOSFET. One per bit in a NAND flash chip.

One MOSFET is good for one bit. Group billions of these MOSFETs together, in silicon, and you've got a multi-gigabyte NAND flash chip.

The MOSFETs are organized into lines, and the lines into groups called pages. These days a page is usually 4KB in size. NAND flash can't be written to one bit at a time, it's written at the page level - so 4KB at a time. Once you write the data though, it's there for good. Erasing is a bit more complicated.

To coax the charge out of the MOSFETs requires a bit more effort and the way NAND flash works is that you can't discharge a single MOSFET, you have to erase in larger groups called blocks. NAND blocks are commonly 128 pages, that means if you want to re-write a page in flash you have to first erase it and all 127 adjacent pages first. And allow me to repeat myself: if you want to overwrite 4KB of data from a full block, you need to erase and re-write 512KB of data.

To make matters worse, every time you write to a flash page you reduce its lifespan. The JEDEC spec for MLC (multi-level cell) flash is 10,000 writes before the flash can start to fail.

Dealing with all of these issues requires that controllers get very crafty with how they manage writes. A good controller must split writes up among as many flash channels as possible, while avoiding writing to the same pages over and over again. It must also deal with the fact that some data is going to get frequently updated while others will remain stagnant for days, weeks, months or even years. It has to detect all of this and organize the drive in real time without knowing anything about how it is you're using your computer.

It's a tough job.

But not impossible.

Index Live Long and Prosper: The Logical Page
Comments Locked

295 Comments

View All Comments

  • minime - Tuesday, September 1, 2009 - link

    Thanks for that, but still, this is not quite a real business test, right?
  • Live - Monday, August 31, 2009 - link

    Great article! Again I might add.

    Just a quick question:

    In the article it says all Indilinx drives are basically the same. But there are 2 controllers:
    Indilinx IDX110M00-FC
    Indilinx IDX110M00-LC

    What's the difference?
  • yacoub - Monday, August 31, 2009 - link

    If Idle Garbage Collection cannot be turned off, how can it be called "[Another] option that Indilinx provides its users"? If it's not optional, it's not an option. :(
  • Anand Lal Shimpi - Monday, August 31, 2009 - link

    Well it's sort of optional since you had to upgrade to the idle GC firmware to enable it. That firmware has since been pulled and I've informed at least one of the companies involved of the dangers associated with it. We'll see what happens...

    Take care,
    Anand
  • helloAnand - Monday, August 31, 2009 - link

    Anand,

    The best way to test compiler performance is compiling the compiler itself ;). GCC has an enormous test suite (I/O bound) to boot. Building it on windows is complicated, so you can try compiling the latest version on the mac.
  • Anand Lal Shimpi - Monday, August 31, 2009 - link

    Hmm I've never played with the gcc test suite, got any pointers you can email me? :)

    Take care,
    Anand
  • UNHchabo - Tuesday, September 1, 2009 - link

    Compiling almost anything on Visual Studio also tends to be IO-bound, so you could try that as well.
  • CMGuy - Wednesday, September 2, 2009 - link

    We've got a few big java apps at work and the compile times are heavily I/O bound. Like it takes 30 minutes to build on a 15 disk SAN array (The cpu usage barely gets above 30%). Got a 160Gig G2 on order, very much looking forward to benchmarking the build on it!
  • CMGuy - Sunday, October 11, 2009 - link

    Finally got an X25-m G2 to benchmark our builds on. What was previously a 30 minute build on a 15 disk SAN array in a server has become a 6.5 minute build on my laptop.
    The real plus has come when running multiple builds simultaneously. Previously 2 builds running together would take around 50 minutes to complete (not great for Continuous Integration). With the intel SSD - 10 minutes and the bottleneck is now the CPU. I see more cores and hyperthreading in my future...
  • Ipatinga - Monday, August 31, 2009 - link

    Another great article about SSD, Anand. Big as always, but this is not just a SSD review or roundup. It´s a SSD class.

    Here are my points about some stuff:

    1 - Correct me if I´m wrong, but as far as capacity goes, this is what I know:

    - Manufacturers says their drive has 80GB, because it actually has 80GB. GB comes from GIGA, wich is a decimal unit (base 10).

    - Microsoft is dumb, so Windows follows it, and while the OS says your 80GB drive has 74,5GB, it should say 80GB (GIGA). When windows says 74,5, it should use Gi (Gibi), wich is a binary unit).

    - To sum up, with a 80GB drive, Windows should say it has 80GB or 74,5GiB.

    - A SSD from Intel has more space than it´s advertised 80GB (or 74,5GiB), and that´s to use as a spare area. That´s it. Intel is smart for using this (since the spare area is, well, big and does a good job for wear and performance over sometime).

    2 - I wonder why Intel is holding back on the 320GB X25-M... just she knows... it must be something dark behind it...

    Maybe, just maybe, like in a dream, Intel could be working on a 320GB X25-M that comes with a second controller (like a mirror of the one side pcb it has now). This would be awesome... like the best RAID 0 from two 160GB, in one X25-M.

    3 - Indilinx seems to be doing a good job... even without TRIM support at it´s best, the garbage cleaning system is another good tool to add to a SSD. Maybe with TRIM around, the garbage cleaning will become more like a "SSD defrag".

    4 - About the firmware procedure in Indilinx SSD goes, as far as I know, some manufacturers use the no-jumper scheme to make easier the user´s life, others offer the jumper scheme (like G.Skill on it´s Falcon SSD) to get better security: if the user is using the jumper and the firmware update goes bad, the user can keep flashing the firmware without any problem. Without the jumper scheme, you better get lucky if things don´t go well on the first try. Nevertheless, G.Skill could put the SSD pins closer to the edge... to put a jumper in those pins today is a pain in the @$$.

    5 - I must ask you Anand, did you get any huge variations on the SSD benchmarks? Even with a dirty drive, the G.Skill Falcon (I tested) sometimes perform better than when new (or after wiper). The Benchmarks are Vantage, CrystalMark, HD Tach, HD Tune.... very weird. Also, when in new state, my Vantage scores are all around in all 8 tests... sometimes it´s 0, sometimes it´s 50, sometimes it´s 100, sometimes it´s 150 (all thousand)... very weird indeed.

    6 - The SSD race today is very interesting. Good bye Seagate and WD... kings of HD... Welcome Intel, Super Talent, G.Skill, Corsair, Patriot, bla bla bla. OCZ is also going hard on SSD... and I like to see that. Very big line of SSD models for you to choose and they are doind a good job with Indilinx.

    7 - Samsung? Should be on the edge of SSD, but manage to loose the race on the end user side. No firmware update system? You gotta be kidding, right? Thank good for Indilinx (and Intel, but there is not TRIM for G1... another mistake).

    8 - And yes... SSD rocks (huge performance benefit on a notebook)... even though I had just one weekend with them. Forget about burst speed... SSD crushes hard drives where it matters, specially sequencial read/write and low latency.

    - Let me finish here... this comment is freaking big.

Log in

Don't have an account? Sign up now