Conclusion: Going for a Data Cache

At the hardware level, the Optane Memory M10 is a simple and straightforward update to the original Optane Memory, bringing a new capacity that some users will appreciate, and power management that was sorely lacking from the original. On the software side, the experience is quite similar to the first iteration of Optane Caching that Intel released a year ago with their Kaby Lake platform. The only big user-visible change is the ability to cache non-boot drives. This corrects the other glaring omission, giving the Optane Memory system an overall impression of being a more mature product that Intel is taking seriously.

Optane Memory caching now seems to be limited primarily by the fundamental nature of SSD caching: not everything can fit in the cache. Occasional drops down to hard drive performance are more frequent and more noticeable than when a flash-based SSD's SLC write cache fills up, or when a M.2 SSD starts thermally throttling. Neither of those happens very often for real-world use, but cache misses are still inevitable.

The latency from a flash-based SSD tends to grow steadily as the workload gets more intense, up to the point that there isn't enough idle time for garbage collection. The performance of most modern flash-based SSDs degrades gracefully until the SLC cache fills up. The latency distribution from an Optane+hard drive cache setup looks very different: latency is excellent until you try to read the wrong block, then you have to wait just as long as in a hard drive-only setup.

The key to making SSD caching work well for desktop use is thus to ensure that the cache is big enough for the workload. For relatively light workloads, the 32GB Optane Memory is often sufficient, and even the $25 16GB module that we haven't tested should offer a noticeable improvement in system responsiveness. For users with heavier workloads, the larger 64GB Optane Memory M10 and even the 118GB Optane SSD 800P may not be big enough, and the price starts getting close to that of a good and reasonably large SATA SSD.

For power users, the data drive acceleration mode is more appealing. A gamer might want to use a 256GB or 512GB SATA SSD for the OS and most programs and documents, but would need a 1TB or larger drive for his entire Steam library. A 1TB 7200RPM hard drive plus the 64GB Optane Memory M10 or the 58GB Optane SSD 800P is cheaper than a good 1TB SATA SSD, and the cache is large enough to hold one or two games. A 2TB hard drive plus the 118GB Optane SSD 800P can cache the even the largest of AAA games and is no more expensive than the cheapest 2TB SATA drive. For capacities beyond that, caching only gets more appealing.

Our SYSmark testing showed that for many common tasks, adding even a 32GB cache to a hard drive can bring performance up to the level of a SSD-only configuration. There are a lot of lightweight everyday workloads that can fit well in such a cache, and for those users the larger 64GB Optane Memory M10 doesn't bring worthwhile performance improvements over the 32GB Optane Memory.

On the other hand, it is clear that no amount of fast storage can make up for a system crippled by too little RAM, which is a disappointment in a time when SSDs are getting cheaper but RAM prices are still climbing. Optane SSDs may be the fastest swap devices money can buy, but they're no substitute for having adequate RAM. The 4GB low-end configuration we tested is simply not enough anymore, and for future storage caching tests we will consider 8GB as the absolute minimum requirement before any storage performance upgrades should be considered.

Our synthetic benchmarks of Intel's Optane Memory caching confirmed the most predictable effects of cache size compared to working set size, but didn't reveal many nuances of Intel's cache management strategies. There is clearly some overhead relative to accessing just the SSD, but not enough eliminate the fundamental performance advantages of 3D XPoint memory. There also appears to be some write caching and combining done with system RAM, trading a bit of safety for improved write performance beyond even what the Optane SSDs alone can handle. Whether it's advertised or not, this tends to be a feature of almost every third-party add-on software for storage acceleration. It's the simplest way to improve storage benchmark numbers and the tradeoffs are quite acceptable to many users.

The Optane Memory caching seems to be quite responsive to changes in usage patterns. One launch of an application is sufficient to bring its data into the cache, and Intel isn't shy about sending writes to the cache. It doesn't appear that the Optane Memory caching system does anything significant to reduce wear on the cache device, so Intel seems confident that these cache devices have plenty of write endurance.

Intel Optane Product Lineup
Capacity Drives
16 GB Optane Memory (M.2)
$24.99 ($1.56/GB)
32 GB Optane Memory (M.2)
$58.91 ($1.84GB)
58 GB

64 GB
Optane SSD 800P (M.2)
$111.48 ($1.92/GB)
Optane Memory M10
$144 ($2.48/GB)
118 GB Optane SSD 800P (M.2)
$196.43 ($1.66/GB)
280 GB Optane SSD 900P (AIC, U.2)
$354.99 ($1.27GB)
480 GB Optane SSD 900P (AIC)
544.99 ($1.14/GB)
Optane SSD 905P (U.2)
$599.00 ($1.25/GB)
960 GB Optane SSD 905P (AIC)
$1299.00 ($1.35/GB)

Intel's 3D XPoint memory is clearly a far better media for small cache drives than NAND flash, but it is still afflicted by a very high price per GB. Only the 16GB Optane Memory at $25 seems like an easy purchase to make, but it is small enough that its performance potential is much more limited than the larger Optane products. The 64GB Optane Memory M10 is expensive enough that skipping caching altogether and going with just a SATA SSD has to be seriously considered, even when shopping for 1 or 2 TB of storage. In spite of the power management the Optane Memory M10 adds over the original cache module, it still doesn't seem like a hard drive plus a cache module makes any sense for mobile use. Optane prices need to come down faster than NAND prices in order for this caching strategy to gain wide acceptance. This doesn't seem likely to happen, so Optane Memory will remain a niche solution—but that niche is definitely not as small as it was when Optane Memory was first introduced.

Mixed Read/Write Performance
POST A COMMENT

97 Comments

View All Comments

  • Flunk - Tuesday, May 15, 2018 - link

    For $144 you can get a 256GB M.2 SSD, big enough to use as a boot drive. Even as a cache for a slow hard-drive (which means you also need to buy a hard drive, possibly bumping the cost up to 512GB SSD prices) means this product doesn't make any sense at all. Maybe it made sense when they started development, but it doesn't now. Reply
  • binary visions - Tuesday, May 15, 2018 - link

    I'm not sure I understand your comment.

    This product isn't designed for people whose data fits on a boot drive. It's designed to accelerate disk speeds for people who require large data drives.

    E.g. my photos do not even remotely fit on an affordable SSD. I have a 6tb drive I work off of, but I'm frequently working in sets of photos that are <100gb. I suspect an Optane drive would significantly improve my workflow (I don't have a compatible system, but it's something I'm looking into in the future).

    Copying photos back and forth between an SSD for working on them, and back to the spinning platters for storage, is an ugly process at best.
    Reply
  • qlum - Tuesday, May 15, 2018 - link

    However at this point a conventional ssd of a larger size could also be used gor caching and may require less swaoping to the slower hdd. Reply
  • lmcd - Thursday, May 17, 2018 - link

    No. The idea of caching means that the device used as the cache will almost always be close to capacity. Nearly-full MLC and TLC SSD devices perform very poorly compared to their empty numbers. MLC and TLC devices would have 1/2 and 1/3 the size they're listed at when used as caches, which makes the comparison much less favorable. Reply
  • frenchy_2001 - Friday, May 18, 2018 - link

    I have used SSD caching for HDD for longer than intel has offered it.
    I bought a OCZ Synapse and I've used it for years. It was a 64GB SSD, with 32GB usable
    https://www.newegg.com/Product/Product.aspx?Item=N...
    (overprovisionning allowed better performances while full), supplied with a custom caching software.
    The software did not work great, but I transitioned to intel SMART response SSD caching when I upgraded from an AMD system to a Z68 (and beyond) and this has helped a lot.
    It is fully transparent and I hardly realize it's there, but the few time I had to remove it (I changed to a bigger SSD as cache, maxed to 80GB, or changed the HDD and had to redo the cache system), how slow the HDD alone was surprised me.
    Boot time is less than a minute, game load times are short enough... Basically, even with with caching alone, it gave me most of the benefits of SSD for everyday tasks.

    I fully expects this product to behave similarly, benefits increasing with size.

    This is not really for people building a new computer, this is for people that want to speed up a current one with a big HDD.
    Reply
  • Lolimaster - Tuesday, May 15, 2018 - link

    Maybe optimize your workflow, you would be better buying a 500GB SSD and MOVING your frequent data to that drive. It's the same thing, for the same price and 10x more storage. Reply
  • GTVic - Tuesday, May 15, 2018 - link

    He just said that transferring photos to an SSD is not feasible. Reply
  • joenathan - Tuesday, May 15, 2018 - link

    His plan still doesn't make sense, what he's just gonna have to hope the Intel software magically knows which of the 6TB of photos he is going to use today? If it's can't cache everything then it's just a gamble. It would be better for him to get a larger SSD and modify his work flow so that it would be feasible to transfer the photos. Reply
  • nevcairiel - Wednesday, May 16, 2018 - link

    Initial access will still be slower as the cache is being populated, that is true - but you would have the same initial cost if you manually move files to your "work drive", nevermind all the hassle that comes with that. Reply
  • Arnulf - Wednesday, May 16, 2018 - link

    Can't stop laughing at those read/write speeds ... downright pathetic compared to low end NVMe drives ... and to think Optane was touted to perform as a class of its own between flash and DRAM.

    As for your photo predicament - where is the bottleneck of your 100 GB photo editing process? I doubt it's random access. If it is sequential access (throughput) for batch processing all those photos then you will be limited by the HDD in either case (with or without Optane). Besides those horrible sequential transfer rates ... just can't stop laughing :-D

    Just get a large enough NVMe SSD.
    Reply

Log in

Don't have an account? Sign up now