UL Benchmarks - PCMark, 3DMark, and VRMark

This section deals with a selection of the UL Futuremark benchmarks - PCMark 10, PCMark 8, and 3DMark. While the first two evaluate the system as a whole, 3DMark focuses on the graphics capabilities.

PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.

Futuremark PCMark 10 - Essentials

Futuremark PCMark 10 - Productivity

Futuremark PCMark 10 - Gaming

Futuremark PCMark 10 - Digital Content Creation

Futuremark PCMark 10 - Extended

PCMark 8

We continue to present PCMark 8 benchmark results (as those have more comparison points) while our PCMark 10 scores database for systems grows in size. PCMark 8 provides various usage scenarios (home, creative and work) and offers ways to benchmark both baseline (CPU-only) as well as OpenCL accelerated (CPU + GPU) performance. We benchmarked select PCs for the OpenCL accelerated performance in all three usage scenarios.

Futuremark PCMark 8 - Home OpenCL

Futuremark PCMark 8 - Creative OpenCL

Futuremark PCMark 8 - Work OpenCL

UL's 3DMark comes with a diverse set of graphics workloads that target different Direct3D feature levels. Correspondingly, the rendering resolutions are also different. The VRMark benchmark targets virtual reality specifically. Its workloads are termed as 'rooms', with each one being a piece of VR content designed to require a specific level of VR performance. We used 3DMark 2.4.4264 and VRMark 1.2.1701 to get an idea of the graphics capabilities of various systems. In this section, we take a look at the performance of the Intel NUC9i9QNX (Ghost Canyon) on a comparative basis across the different workloads.

3DMark Ice Storm

This workload has three levels of varying complexity - the vanilla Ice Storm, Ice Storm Unlimited, and Ice Storm Extreme. It is a cross-platform benchmark (which means that the scores can be compared across different tablets and smartphones as well). All three use DirectX 11 (feature level 9) / OpenGL ES 2.0. While the Extreme renders at 1920 x 1080, the other two render at 1280 x 720. The graphs below present the various Ice Storm worloads' numbers for different systems that we have evaluated.

UL 3DMark - Ice Storm Workloads

3DMark Cloud Gate

The Cloud Gate workload is meant for notebooks and typical home PCs, and uses DirectX 11 (feature level 10) to render frames at 1280 x 720. The graph below presents the overall score for the workload across all the systems that are being compared.

UL 3DMark Cloud Gate Score

3DMark Sky Diver

The Sky Diver workload is meant for gaming notebooks and mid-range PCs, and uses DirectX 11 (feature level 11) to render frames at 1920 x 1080. The graph below presents the overall score for the workload across all the systems that are being compared.

UL 3DMark Sky Diver Score

3DMark Fire Strike Extreme

The Fire Strike benchmark has three workloads. The base version is meant for high-performance gaming PCs. Similar to Sky Diver, it uses DirectX 11 (feature level 11) to render frames at 1920 x 1080. The Ultra version targets 4K gaming system, and renders at 3840 x 2160. However, we only deal with the Extreme version in our benchmarking - It renders at 2560 x 1440, and targets multi-GPU systems and overclocked PCs. The graph below presents the overall score for the Fire Strike Extreme benchmark across all the systems that are being compared.

UL 3DMark Fire Strike Extreme Score

3DMark Time Spy

The Time Spy workload has two levels with different complexities. Both use DirectX 12 (feature level 11). However, the plain version targets high-performance gaming PCs with a 2560 x 1440 render resolution, while the Extreme version renders at 3840 x 2160 resolution. The graphs below present both numbers for all the systems that are being compared in this review.

UL 3DMark - Time Spy Workloads

The VRMark Professional Edition comes with three rooms. Each room can be run either in desktop or HMD mode, with varying minimum requirements for the same workload. The benchmark results include the average FPS achieved, and a score based on the FPS. A pass or fail indicator is also provided based on whether the average FPS exceeds the required FPS. In this section, we take a look at the performance of the Intel NUC9i9QNX (Ghost Canyon) on a comparative basis across the three workloads in desktop mode.

VRMark Orange Room

The Orange Room is meant to test the effectiveness of a system for handling the requirements of the HTC Vive and the Oculus Rift. The recommended hardware for both VR HMDs should be able to easily achieve the desired target FPS (88.9 fps). However, in the desktop mode, the target performance is 109 fps without any frame drops. Systems benching with an average FPS lesser than that are deemed to have failed the VRMark Orange Room benchmark. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Orange Room

VRMark Cyan Room

The Cyan Room sits between the Orange and Blue rooms in complexity. It is a DirectX 12 benchmark. Similar to the Orange room, the target metrics are 88.9 fps on HMDs and 109 fps on the desktop monitor. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Cyan Room

VRMark Blue Room

The Blue Room is the most demanding of the three workloads. At the time of introduction of VRMark in October 2016, no publicly available system running as sold was able to pass the test. The Ghost Canyon NUC configuration with the RTX 2070 performs better than any previously benchmarked system, but it still doesn't meet the requirements to pass the VRMark Blue Room test.

The performance of a system in this benchmark is an indicator of its VR-readiness for future generation of HMDs. Similar to the other workloads, the passing performance metrics are 88.9 fps on HMDs and 109 fps on desktop monitors. The complexity of the workload is due to the higher resolution (5012 x 2880) and additional geometry making it necessary to increase the number of Direct3D API calls. The graphs below present the average FPS and score for the different systems being considered today.

UL VRMark - Blue Room

BAPCo SYSmark 2018 SPECworkstation 3 Benchmark
Comments Locked

109 Comments

View All Comments

  • ganeshts - Monday, April 20, 2020 - link

    The review of the ASRock 4x4 box based on that *single* reference design will be out soon. It targets the *embedded* market, and you will soon see why that is so. Currently, AMD's PC division (i.e, non-embedded) doesn't seem to think of mini-PCs as a high-margin area worth concentrating on. There is a reason why Udoo Bolt uses embedded Ryzen. And, that is why ASRock and other *embedded* market-targeting companies have those Zen 1 products.
  • Spunjji - Friday, April 24, 2020 - link

    "OEMs can take the plunge only if the silicon vendors offer them a proof of concept."

    This really doesn't strike me as the least bit true. Sure, a reference design would help - but it's surely not essential?
  • ganeshts - Friday, April 24, 2020 - link

    In every silicon vendor offering marketing I have seen (as an industry observer visiting trade shows, and as an engineer working in a fabless semiconductor company), there exists a board in a form-factor very *similar* to the end product that the vendor is targeting - either created by the vendor themselves, or, an ODM with close ties that is led hand-in-hand by the vendor [ eg. Thundersoft does the reference design implementation of Snapdragon IP cameras for Qualcomm - https://www.qualcomm.com/news/onq/2016/02/05/snapd... , and the ODM was funded in part by Qualcomm Ventures - https://www.qualcommventures.com/companies/mobile/... ].

    I would be very interested in knowing whether there are any examples for what you are suggesting - where a product was created for the end market without a reference design from main silicon's vendor.
  • bug77 - Thursday, April 16, 2020 - link

    I stopped reading when I got to the price.
  • zer0hour - Thursday, April 16, 2020 - link

    +1
  • quadrivial - Thursday, April 16, 2020 - link

    A mitx board is 6.75 x 6.75 inches. The final dimensions for this machine are around 9.5 x 8.5 inches.

    $1000-1700 without GPU, SSD, RAM is ridiculous for a mitx system. You could build an good (complete) system just a fraction bigger for that same price.
  • bug77 - Friday, April 17, 2020 - link

    Or, if you need something small, you can get a similarly specced laptop.
  • Namisecond - Friday, April 17, 2020 - link

    Exactly. Sliger even offers a case with a similar kind of PCIe splitter as this NUC offers. Even in the business space, how is this machine going to compete against those @9 Liter Dell, HP, Lenovo SFF workstations at half the price?
  • shabby - Thursday, April 16, 2020 - link

    +100 😂
  • sorten - Thursday, April 16, 2020 - link

    +1

    Stunned by the price. $2800 for a last generation CPU, 16GB of RAM, and an RTX 2070? Wow.

Log in

Don't have an account? Sign up now