Application Benchmarks

With a complex multi-layer storage system like the Intel Optane Memory H10, the most accurate benchmarks will be tests that use real-world applications. BAPCo's SYSmark 2018 and UL's PCMark 10 are two competing suites of automated application benchmarks. Both share the general goal of assigning a score to represent total system performance, plus several subscores covering different common use cases. PCMark 10 is the shorter test to run and it provides a more detailed breakdown of subscores. It is also much more GPU-heavy with 3D rendering included in the standard test suite and some 3DMark tests included in the Extended test. SYSmark 2018 has the advantage of using the full commercial versions of popular applications including Microsoft Office and Adobe Creative Suite, and it integrates with a power meter to record total system energy usage over the course of the test.

The downside of these tests is that they cover only the most common everyday use cases, and do not simulate any heavy multitasking. None of their subtests are particularly storage-intensive, so most scores only vary slightly when changing between fast and slow SSDs.

BAPCo SYSmark 2018

BAPCo's SYSmark 2018 is an application-based benchmark that uses real-world applications to replay usage patterns of business users, with subscores for productivity, creativity and responsiveness. Scores represnt overall system performance and are calibrated against a reference system that is defined to score 1000 in each of the scenarios. A score of, say, 2000, would imply that the system under test is twice as fast as the reference system.

BAPCo SYSmark 2018 Scores
Creativity Productivity Responsiveness Overall

The Kaby Lake desktop and Whiskey Lake notebook trade places depending on the subtest; sometimes the notebook is ahead thanks to its extra RAM, and sometimes the desktop is ahead thanks to its higher TDP. These differences usually have a bigger impact than choice of storage, though the Responsiveness test does show that a hard drive alone is inadequate. The Optane Memory H10's score with caching on is not noticeably better than when using the QLC portion alone, and even the hard drive with an Optane cache is fairly competitive with the all-solid state storage configurations.

Energy Usage

The SYSmark energy usage scores measure total system power consumption, excluding the display. Our Kaby Lake test system idles at around 26 W and peaks at over 60 W measured at the wall during the benchmark run. SATA SSDs seldom exceed 5 W and idle at a fraction of a watt, and the SSDs spend most of the test idle. This means the energy usage scores will inevitably be very close. The notebook uses substantially less power despite this measurement including the display. None of the really power-hungry storage options (hard drives, Optane 900P) can fit in this system, so the energy usage scores are also fairly close together.

BAPCo SYSmark 2018 - Energy Consumption

The Optane Memory H10 was the most power-hungry M.2 option, and leaving the Optane cache off saves a tiny bit of power but not enough to catch up with the good TLC-based drives. The Optane SSD 800P has better power efficiency than most of the flash-based drives, but its low capacity is a hindrance for real-world use.

 

UL PCMark 10

PCMark 10 scores
Subscore:

The Optane cache provides enough of a boost to PCMark 10 Extended scores to bring the H10 into the lead among the M.2 SSDs tested on the Whiskey Lake notebook. The Essentials subtests show the most impact from the Optane storage while the more compute-heavy tasks are relatively unaffected, with the H10 performing about the same with or without caching enabled.

Test Setup Cache Size Effects
Comments Locked

60 Comments

View All Comments

  • Alexvrb - Monday, April 22, 2019 - link

    "The caching is managed entirely in software, and the host system accesses the Optane and QLC sides of the H10 independently. "

    So, it's already got serious baggage. But wait, there's more!

    "In practice, the 660p almost never needed more bandwidth than an x2 link can provide, so this isn't a significant bottleneck."

    Yeah OK, what about the Optane side of things?
  • Samus - Tuesday, April 23, 2019 - link

    They totally nerf'd this thing with 2x PCIe.
  • PeachNCream - Tuesday, April 23, 2019 - link

    Linux handles Optane pretty easily without any Intel software through bcache. I'm not sure why Anandtech can't test that, but maybe just a lack of awareness.

    https://www.phoronix.com/scan.php?page=article&...
  • Billy Tallis - Tuesday, April 23, 2019 - link

    Testing bcache performance won't tell us anything about how Intel's caching software behaves, only how bcache behaves. I'm not particularly interested in doing a review that would have such a narrow audience. And bcache is pretty thoroughly documented so it's easier to predict how it will handle different workloads without actually testing.
  • easy_rider - Wednesday, April 24, 2019 - link

    Is there a reliable review of 118gb intel optane ssd in M2 form factor? Does it make sense to hunt it down and put as a system drive in the dual-m2 laptop?
  • name99 - Thursday, April 25, 2019 - link

    "QLC NAND needs a performance boost to be competitive against mainstream TLC-based SSDs"

    The real question is what dimension, if any, does this thing win on?
    OK, it may not be the fastest out there? But does it, say, provide approximately leading edge TLC speed at QLC prices, so it wins by being cheap?
    Because just having a cache is meaningless. Any QLC drive that isn't complete garbage will have a controller-managed cache created by using the QLC flash as SLC; and the better controllers will slowly degrade across the entire drive, maintaining always an SLC cache, but also using the entire drive (till its filled up) as SLC, then switching blocks to MLC, then to TLC, and only when the drive is approaching capacity, using blocks as QLC.

    So the question is not "does it give cached performance to a QLC drive", the question is does it give better performance or better price than other QLC solutions?
  • albert89 - Saturday, April 27, 2019 - link

    Didn't I tell ya ? Optane's capacity was too small for many yrs and compatible with a very tiny number devices/hardware/OS. She played the game of hard to get and now no guy wants her.
  • peevee - Monday, April 29, 2019 - link

    "The caching is managed entirely in software, and the host system accesses the Optane and QLC sides of the H10 independently. Each half of the drive has two PCIe lanes dedicated to it."

    Fail.
  • ironargonaut - Monday, April 29, 2019 - link

    "While the Optane Memory H10 got us into our Word document in about 5 seconds, the TLC-based 760P took 29 seconds to open the file. In fact, we waited so long that near the end of the run, we went ahead and also launched Google Chrome with it preset to open four websites. "

    https://www.pcworld.com/article/3389742/intel-opta...

    Win
  • realgundam - Saturday, November 16, 2019 - link

    What if you have a normal 660p and an Optane stick? would it do the same thing?

Log in

Don't have an account? Sign up now