Miscellaneous Performance Metrics

This section looks at some of the other commonly used benchmarks representative of the performance of specific real-world applications.

3D Rendering - CINEBENCH R15

We use CINEBENCH R15 for 3D rendering evaluation. The program provides three benchmark modes - OpenGL, single threaded and multi-threaded. Evaluation of different PC configurations in all three modes provided us the following results.

3D Rendering - CINEBENCH R15 - Single Thread

3D Rendering - CINEBENCH R15 - Multiple Threads

3D Rendering - CINEBENCH R15 - OpenGL

The results track what was observed in the media and entertainment category workloads in SPECworkstation 3.

x265 Benchmark

Next up, we have some video encoding benchmarks using x265 v2.8. The appropriate encoder executable is chosen based on the supported CPU features. In the first case, we encode 600 1080p YUV 4:2:0 frames into a 1080p30 HEVC Main-profile compatible video stream at 1 Mbps and record the average number of frames encoded per second.

Video Encoding - x265 - 1080p

Our second test case is 1200 4K YUV 4:2:0 frames getting encoded into a 4Kp60 HEVC Main10-profile video stream at 35 Mbps. The encoding FPS is recorded.

Video Encoding - x265 - 4K 10-bit

The Ghost Canyon NUC surprisingly performs better than systems equipped with CPUs sporting much higher TDPs.

7-Zip

7-Zip is a very effective and efficient compression program, often beating out OpenCL accelerated commercial programs in benchmarks even while using just the CPU power. 7-Zip has a benchmarking program that provides tons of details regarding the underlying CPU's efficiency. In this subsection, we are interested in the compression and decompression rates when utilizing all the available threads for the LZMA algorithm.

7-Zip LZMA Compression Benchmark

7-Zip LZMA Decompression Benchmark

Given the brief nature of the benchmark workload and the large number of available threads, it is no surprise that the Ghost Canyon NUC performs significantly better than the rest of the systems in this workload.

Cryptography Benchmarks

Cryptography has become an indispensable part of our interaction with computing systems. Almost all modern systems have some sort of hardware-acceleration for making cryptographic operations faster and more power efficient. In this sub-section, we look at two different real-world applications that may make use of this acceleration.

BitLocker is a Windows features that encrypts entire disk volumes. While drives that offer encryption capabilities are dealt with using that feature, most legacy systems and external drives have to use the host system implementation. Windows has no direct benchmark for BitLocker. However, we cooked up a BitLocker operation sequence to determine the adeptness of the system at handling BitLocker operations. We start off with a 2.5GB RAM drive in which a 2GB VHD (virtual hard disk) is created. This VHD is then mounted, and BitLocker is enabled on the volume. Once the BitLocker encryption process gets done, BitLocker is disabled. This triggers a decryption process. The times taken to complete the encryption and decryption are recorded. This process is repeated 25 times, and the average of the last 20 iterations is graphed below.

BitLocker Encryption Benchmark

BitLocker Decryption Benchmark

The BitLocker benchmark results are a bit surprising, particularly given the clear performance benefits of the Core i9-9980HK for cryptography applications in the other applications below.

Creation of secure archives is best done through the use of AES-256 as the encryption method while password protecting ZIP files. We re-use the benchmark mode of 7-Zip to determine the AES256-CBC encryption and decryption rates using pure software as well as AES-NI. Note that the 7-Zip benchmark uses a 48KB buffer for this purpose.

7-Zip AES256-CBC Encryption Benchmark

7-Zip AES256-CBC Decryption Benchmark

As expected, the 8C/16T configuration allows for fast encryption and decryption irrespective of the use of pure software or AES-NI instructions.

Yet another cryptography application is secure network communication. OpenSSL can take advantage of the acceleration provided by the host system to make operations faster. It also has a benchmark mode that can use varying buffer sizes. We recorded the processing rate for a 8KB buffer using the hardware-accelerated AES256-CBC-HAC-SHA1 feature.

OpenSSL Encryption Benchmark

OpenSSL Decryption Benchmark

These results are not surprising given the core count and operating frequency profile of the CPU in the Ghost Canyon NUC.

Agisoft Photoscan

Agisoft PhotoScan is a commercial program that converts 2D images into 3D point maps, meshes and textures. The program designers sent us a command line version in order to evaluate the efficiency of various systems that go under our review scanner. The command line version has two benchmark modes, one using the CPU and the other using both the CPU and GPU (via OpenCL). We present the results from our evaluation using the CPU mode only. The benchmark (v1.3) takes 84 photographs and does four stages of computation:

  • Stage 1: Align Photographs (capable of OpenCL acceleration)
  • Stage 2: Build Point Cloud (capable of OpenCL acceleration)
  • Stage 3: Build Mesh
  • Stage 4: Build Textures

We record the time taken for each stage. Since various elements of the software are single threaded, and others multithreaded, it is interesting to record the effects of CPU generations, speeds, number of cores, and DRAM parameters using this software.

Agisoft PhotoScan Benchmark - Stage 1

Agisoft PhotoScan Benchmark - Stage 2

Agisoft PhotoScan Benchmark - Stage 3

Agisoft PhotoScan Benchmark - Stage 4

The Ghost Canyon NUC is better than any of the other considered systems across all Photoscan stages.

Dolphin Emulator

Wrapping up our application benchmark numbers is the new Dolphin Emulator (v5) benchmark mode results. This is again a test of the CPU capabilities.

Dolphin Emulator Benchmark

In fact, the 249s taken by the Ghost Canyon NUC is the fastest amongst all SFF PCs we have evaluated with this benchmark.

SPECworkstation 3 Benchmark GPU Performance - Gaming Workloads
Comments Locked

109 Comments

View All Comments

  • ganeshts - Monday, April 20, 2020 - link

    The review of the ASRock 4x4 box based on that *single* reference design will be out soon. It targets the *embedded* market, and you will soon see why that is so. Currently, AMD's PC division (i.e, non-embedded) doesn't seem to think of mini-PCs as a high-margin area worth concentrating on. There is a reason why Udoo Bolt uses embedded Ryzen. And, that is why ASRock and other *embedded* market-targeting companies have those Zen 1 products.
  • Spunjji - Friday, April 24, 2020 - link

    "OEMs can take the plunge only if the silicon vendors offer them a proof of concept."

    This really doesn't strike me as the least bit true. Sure, a reference design would help - but it's surely not essential?
  • ganeshts - Friday, April 24, 2020 - link

    In every silicon vendor offering marketing I have seen (as an industry observer visiting trade shows, and as an engineer working in a fabless semiconductor company), there exists a board in a form-factor very *similar* to the end product that the vendor is targeting - either created by the vendor themselves, or, an ODM with close ties that is led hand-in-hand by the vendor [ eg. Thundersoft does the reference design implementation of Snapdragon IP cameras for Qualcomm - https://www.qualcomm.com/news/onq/2016/02/05/snapd... , and the ODM was funded in part by Qualcomm Ventures - https://www.qualcommventures.com/companies/mobile/... ].

    I would be very interested in knowing whether there are any examples for what you are suggesting - where a product was created for the end market without a reference design from main silicon's vendor.
  • bug77 - Thursday, April 16, 2020 - link

    I stopped reading when I got to the price.
  • zer0hour - Thursday, April 16, 2020 - link

    +1
  • quadrivial - Thursday, April 16, 2020 - link

    A mitx board is 6.75 x 6.75 inches. The final dimensions for this machine are around 9.5 x 8.5 inches.

    $1000-1700 without GPU, SSD, RAM is ridiculous for a mitx system. You could build an good (complete) system just a fraction bigger for that same price.
  • bug77 - Friday, April 17, 2020 - link

    Or, if you need something small, you can get a similarly specced laptop.
  • Namisecond - Friday, April 17, 2020 - link

    Exactly. Sliger even offers a case with a similar kind of PCIe splitter as this NUC offers. Even in the business space, how is this machine going to compete against those @9 Liter Dell, HP, Lenovo SFF workstations at half the price?
  • shabby - Thursday, April 16, 2020 - link

    +100 😂
  • sorten - Thursday, April 16, 2020 - link

    +1

    Stunned by the price. $2800 for a last generation CPU, 16GB of RAM, and an RTX 2070? Wow.

Log in

Don't have an account? Sign up now