BAPCo SYSmark 2014 SE

BAPCo's SYSmark 2014 SE is an application-based benchmark that uses real-world applications to replay usage patterns of business users in the areas of office productivity, media creation and data/financial analysis. In addition, it also addresses the responsiveness aspect which deals with user experience as related to application and file launches, multi-tasking etc. Scores are calibrated against a reference system that is defined to score 1000 in each of the scenarios. A score of, say, 2000, would imply that the system under test is twice as fast as the reference system.

SYSmark scores are based on total application response time as seen by the user, including not only storage latency but time spent by the processor. This means there's a limit to how much a storage improvement could possibly increase scores, because the SSD is only in use for a small fraction of the total test duration. This is a significant difference from our ATSB tests where only the storage portion of the workload is replicated and disk idle times are cut short to a maximum of 25ms.

AnandTech SYSmark SSD Testbed
CPU Intel Core i5-7400
Motherboard ASUS B250-PLUS
Chipset Intel B250
Memory 2x 8GB Kingston DDR4-2400 CL17
Case In Win C583
Power Supply Cooler Master G550M
OS Windows 10 64-bit, version 1703

Our SSD testing with SYSmark uses a different test system than the rest of our SSD tests. This machine is set up to measure total system power consumption rather than just the drive's power.

BAPCo SYSmark 2014 SE - ResponsivenessBAPCo SYSmark 2014 SE - Overall Rating

SYSmark 2014 SE doesn't come close to stressing the storage system enough to show meaningful distinctions between high-end NVMe SSDs. The Responsiveness sub-test is the most sensitive to storage performance, and only shows a few percent difference between most SSDs. The overall test barely registers a difference at all. But with my primary power meter broken, SYSmark does provide a rough assessment of how power hungry the Intel Optane SSD 900P is:

BAPCo SYSmark 2014 SE - Total System Power

The SYSmark energy usage scores measure total system power consumption, excluding the display. Our SYSmark test system idles at around 26 W and peaks at over 60 W measured at the wall during the benchmark run. SATA SSDs seldom exceed 5 W and idle at a fraction of a watt, and the SSDs spend most of the test idle.

Despite being the fastest drive in this bunch and thus the one with the shortest SYSmark run times, the Optane SSD 900P used far more energy over the course of the three SYSmark runs. With higher idle power than even the Intel SSD 750 and similar power draw under load, the Optane SSD 900P really needs its heatsink. Intel is a very long way off from being able to package this level of performance in a M.2 SSD.

Mixed Read/Write Performance Conclusion
Comments Locked

205 Comments

View All Comments

  • Kevin G - Monday, October 30, 2017 - link

    The software side does lag behind hardware by a substantial amount of time. However, the ground work is already being done. The first initial wave of support will be mundane as a 'RAM disk' but with firmware/hypervisor/OS support so that only Optane DIMMs are utilized for this functionality. Software overhead would still exist for the file system but legacy support would be maintained. I think patches already exist for this level of functionality in Linux, though I'm unsure if they're been rolled into the mainstream kernel.
  • Kevin G - Monday, October 30, 2017 - link

    Intel still has this potential on their road maps for 2018 with the Cascade Lake Xeons. Supporting Optane as memory requires some changes in the memory controllers and Intel is only targeting their Xeon lineup with such support. This was initially to arrive with Sky Lake-EP but was cut at the last minute due to apparently some bugs found in testing. This is what there are a few Sky Lake-EP motherboards out there with an extra memory slot that can't be used: it was only for the unreleased Optane DIMMs.

    The other thing is that Optane DIMMs were NEVER hyped to be faster than commodity DRAM. Intel never set that expectation and from all accounts, Optane is genuinely slower. However, byte addressability is there as is a strong increase in endurance for it to function in such a role, if slower. Any sort of performance gains will stems form various ideas that you mention, like the removal of a traditional storage stack etc.

    The other side of storage is capacity which Intel has really yet to demonstrate. Their talk of Optane DIMMs were to hit 1 TB per DIMM eventually but the sizes here point toward capacities in DIMM format roughly the same as traditional DIMMs (128 GB right now in servers with 256 GB on the horizon). I know of a few big data guys that dream of a system that could easily support 96 TB (1 TB DIMM per slot, 12 DIMM slots per socket, 8 sockets total) that would permit their entire cluster to be run on a single node and in-memory. At this point having the Optane DIMMs being slower than DRAM wouldn't matter as it would eliminate traditional bulk storage and networking overhead which are slower still. The potential is huge at the highend if Intel can get the technology out in the right form factor and at the capacities they need.

    Only reason Intel is launching like this now is that they need to get the technology out there and ramp up production. If it weren't for the Sky Lake bug, they would have launched the DIMM format by now.
  • 4shrovetide - Sunday, October 29, 2017 - link

    If someone picks up one of these and doesn't play games or just doesn't want the Star Citizen code, would you mind sending it to me? 4shrovetide@gmail.com Thank you in advance to anyone who helps out!
  • AnnonymousCoward - Sunday, October 29, 2017 - link

    What a copycat name, 900P! Like 950 Pro.
  • Kevin G - Sunday, October 29, 2017 - link

    I'm disappointed over all.

    The latency advantage is genuinely there as is random performance (which latency is factor in itself) but sequential performance falls short of the hype. What is disappointing as well is that only the 280 GB drive is going to be offered in U.2 format and capacities top out at 480 GB even of the add-in card model. The real ugly factor is power consumption which to Intel's credit wasn't hyping up prior to launch is high relative to other SSD solutions.

    The biggest promise of 3D Xpoint/Optane is in DIMM form factor with byte addressability. Intel delayed that last minute with Sky Lake-EP and told people to expect that with Cannon Lake-EP. It looks like Cannon Lake-EP is being delayed due 10 nm issues into 2019 so we're getting a 2018 refresh of Sky Lake-EP called Cascade Lake with the missing Optane DIMM support back-in. The hype of Optane was that while radically slower than DRAM, you do get nonvolatile support and a massive capacity increase, everything else being equal. The performance equation does change as operating system and applications are adapted to an all in-memory centric view (i.e. the concept of long term disk storage is removed, everything is seen as 'in-memory'). It isn't that Optane magically becomes faster but simply that a chunk of software necessary to work in today's view of fast volatile memory and slow persistent memory is no longer needed. It is simply an opportunity to gain in algorithmic efficiency by not having a traditional storage stack. This effect can be seen again if Optane DIMM sizes are well beyond that of DDR4 DIMMs and used in conjunction with large socket (think 8 or more) that could replace some clustered workloads and removing the networking stack from the performance equation.

    The really big disappointment is this launch doesn't point toward living up to the remaining hype at all. The lack luster capacity today certainly implies that the DIMM sizes necessary to threaten DRAM may not happen. 128 GB registered ECC DDR4 LR-DIMMs are out there today and 256 GB models are on the horizon. From the looks of it, Optane could make the 256 GB capacities in DIMM form and certainly come in cheaper but that wouldn't be as large of a game changer. Sure, the software changes for a pure in-memory system could still happen but it wouldn't enable any new workload that couldn't be done via current software and memory capacities. Tried and proven will win out even if it is more expensive because it is known quantity that works.
  • "Bullwinkle J Moose" - Monday, October 30, 2017 - link

    Any thoughts on Advanced Persistent Threats that will be lingering around when 3D Xpoint/Optane is in DIMM form factor ?

    Seems no-one has yet been willing to address the issue

    I would never consider persistent memory for just that reason alone

    And, swapping boot drives or restoring backups won't help it seems

    Any comments on the issue?
  • Kevin G - Monday, October 30, 2017 - link

    While a threat may persist in non-volatile memory, it still needs to be executed which is invoked from the host system. Cleansing an Optane DIMM maybe as simple as putting it into a system that is programmed to immediate wipe said Optane DIMM. There will always need to be a means to do some initial configuration/initialization which would be embedded at the firmwire level. In other words, the DIMMs don't have to be running an OS for them to be securely erased.

    Similarly, moving a DIMM from one system to another system is also possible, though the default should actually be to do nothing by default. As weird as it is, there exists the possibility of moving a running application from system to system by this method. This goes to your point about security. Thus the default for any system capable of hot swap or detecting a newly installed DIMM after power cycle, should not actually access the contents of that DIMM until given instructions to access it.
  • "Bullwinkle J Moose" - Monday, October 30, 2017 - link

    But wiping the DIMM defeats its very purpose for existing..............PERSISTENCE!

    Kaspersky found out how bad malware can be when it only runs in system memory and never touches a disk, networking the infected systems added persistence to the threat

    If you need to wipe the DIMM or disconnect from any networked machines, you eliminate any tiny perceived benefit this technology "could" give you over the tech we already have

    I say "Tiny" benefit only as it relates to the "massive" threat it can create from being persistent
  • regis440 - Monday, October 30, 2017 - link

    Faster then SDRAM PC133. Sign of the time :)
  • jrs77 - Monday, October 30, 2017 - link

    General purpose storage starts at a very minimum of 1TB these days. 2TB would be more appropiate with the ever growing filesizes of high resolution video and image-files.

    480GB is filled up with a handfull of game-installations allready these days. So these SSDs are only usable as OS/software disks and for that the price is way too high.

    Call me again when SSD-prices drop to ~ $100 / TB. Then we're talking usability as general storage drives.

Log in

Don't have an account? Sign up now