Miscellaneous Performance Metrics

This section looks at some of the other commonly used benchmarks representative of the performance of specific real-world applications.

3D Rendering - CINEBENCH R15

We use CINEBENCH R15 for 3D rendering evaluation. The program provides three benchmark modes - OpenGL, single threaded and multi-threaded. Evaluation of different PC configurations in all three modes provided us the following results. It must be noted that R15 is good enough for the current crop of SFF PCs. Once we start getting 16 cores or more, the shift to more modern versions of CINEBENCH will be made.

3D Rendering - CINEBENCH R15 - Single Thread

3D Rendering - CINEBENCH R15 - Multiple Threads

3D Rendering - CINEBENCH R15 - OpenGL

Except for the OpenGL case, both the single (ST) and multi-threaded (MT) versions bring out Frost Canyon on top. As expected, there is negligible difference in the ST performance of the Bean Canyon and Frost Canyon NUCs, as the CPUs are both based on the same Skylake microarchitecture, with the optimizations allowing for higher clocks getting compensated by the increased core count in the processor.

x265 Benchmark

Next up, we have some video encoding benchmarks using x265 v2.8. The appropriate encoder executable is chosen based on the supported CPU features. In the first case, we encode 600 1080p YUV 4:2:0 frames into a 1080p30 HEVC Main-profile compatible video stream at 1 Mbps and record the average number of frames encoded per second.

Video Encoding - x265 - 1080p

Our second test case is 1200 4K YUV 4:2:0 frames getting encoded into a 4Kp60 HEVC Main10-profile video stream at 35 Mbps. The encoding FPS is recorded.

Video Encoding - x265 - 4K 10-bit

In both cases, the hexa-core nature of Frost Canyon stands in good stead, even enabling it to get a sizable lead over competing systems sporting processors with higher TDPs.

7-Zip

7-Zip is a very effective and efficient compression program, often beating out OpenCL accelerated commercial programs in benchmarks even while using just the CPU power. 7-Zip has a benchmarking program that provides tons of details regarding the underlying CPU's efficiency. In this subsection, we are interested in the compression and decompression rates when utilizing all the available threads for the LZMA algorithm.

7-Zip LZMA Compression Benchmark

7-Zip LZMA Decompression Benchmark

Here, we again see the hexa-core feature enabling Frost Canyon to surpass the performance of systems sporting processors with higher TDPs.

Cryptography Benchmarks

Cryptography has become an indispensable part of our interaction with computing systems. Almost all modern systems have some sort of hardware-acceleration for making cryptographic operations faster and more power efficient. In this sub-section, we look at two different real-world applications that may make use of this acceleration.

BitLocker is a Windows features that encrypts entire disk volumes. While drives that offer encryption capabilities are dealt with using that feature, most legacy systems and external drives have to use the host system implementation. Windows has no direct benchmark for BitLocker. However, we cooked up a BitLocker operation sequence to determine the adeptness of the system at handling BitLocker operations. We start off with a 2.5GB RAM drive in which a 2GB VHD (virtual hard disk) is created. This VHD is then mounted, and BitLocker is enabled on the volume. Once the BitLocker encryption process gets done, BitLocker is disabled. This triggers a decryption process. The times taken to complete the encryption and decryption are recorded. This process is repeated 25 times, and the average of the last 20 iterations is graphed below.

BitLocker Encryption Benchmark

BitLocker Decryption Benchmark

The availability of 6 cores to issue AES-NI operations on enables BitLocker to perform better on the Frost Canyon compared to Bean Canyon, despite the Bean Canyon configuration sporting a much higher performing memory sub-system with a DDR4-3000 SODIMM kit at a lower latency.

Creation of secure archives is best done through the use of AES-256 as the encryption method while password protecting ZIP files. We re-use the benchmark mode of 7-Zip to determine the AES256-CBC encryption and decryption rates using pure software as well as AES-NI. Note that the 7-Zip benchmark uses a 48KB buffer for this purpose.

7-Zip AES256-CBC Encryption Benchmark

7-Zip AES256-CBC Decryption Benchmark

The observations we made for the BitLocker workload work for 7-Zip too. The Ryzen 5 2400G, for some reason, seems to offer much faster / optimized hardware acceleration for certain cryptographic operations, enabling it to be neck-and-neck with the Frost Canyon for AES256-CBC decryption in the above case. Obviously, the TDP difference (65W vs 25W) needs to be taken into account, though it is likely that the Frost Canyon NUC was at turbo-speeds in PL2 for at least the first few iterations of the benchmark.

Yet another cryptography application is secure network communication. OpenSSL can take advantage of the acceleration provided by the host system to make operations faster. It also has a benchmark mode that can use varying buffer sizes. We recorded the processing rate for a 8KB buffer using the hardware-accelerated AES256-CBC-HAC-SHA1 feature.

OpenSSL Encryption Benchmark

OpenSSL Decryption Benchmark

Here, we see the Ryzen 5 2400G completely outperform the Frost Canyon NUC due to better optimization of the workload for the hardware acceleration capabilities offered by the Ryzen processor.

Agisoft Photoscan

Agisoft PhotoScan is a commercial program that converts 2D images into 3D point maps, meshes and textures. The program designers sent us a command line version in order to evaluate the efficiency of various systems that go under our review scanner. The command line version has two benchmark modes, one using the CPU and the other using both the CPU and GPU (via OpenCL). We present the results from our evaluation using the CPU mode only. The benchmark (v1.3) takes 84 photographs and does four stages of computation:

  • Stage 1: Align Photographs (capable of OpenCL acceleration)
  • Stage 2: Build Point Cloud (capable of OpenCL acceleration)
  • Stage 3: Build Mesh
  • Stage 4: Build Textures

We record the time taken for each stage. Since various elements of the software are single threaded, and others multithreaded, it is interesting to record the effects of CPU generations, speeds, number of cores, and DRAM parameters using this software.

Agisoft PhotoScan Benchmark - Stage 1

Agisoft PhotoScan Benchmark - Stage 2

Agisoft PhotoScan Benchmark - Stage 3

Agisoft PhotoScan Benchmark - Stage 4

The hexa-core nature makes the Frost Canyon NUC emerge as the best performer in the Agisoft Photoscan benchmark across all the SFF PCs considered in this review.

Dolphin Emulator

Wrapping up our application benchmark numbers is the new Dolphin Emulator (v5) benchmark mode results. This is again a test of the CPU capabilities.

Dolphin Emulator Benchmark

The benchmark is mostly bound by single-threaded performance, and we do not see much difference between the Bean Canyon and Frost Canyon NUCs in this workload.

UL Benchmarks: PCMark and 3DMark Networking and Storage Performance
Comments Locked

85 Comments

View All Comments

  • HStewart - Tuesday, March 3, 2020 - link

    I will say that evolution of Windows has hurt PC market, with more memory and such, Microsoft adds a lot of fat into OS. As as point of sale developer though all these OS, I wish Microsoft had a way to reduce the stuff one does not need.

    Just for information the original Doom was written totally different to games - back in old days Michael Abrash (a leader in original game graphics) work with John Carmack of Id software for Doom and Quake, Back then we did not have GPU driven graphics and code was done in assembly language.

    Over time, development got fat and higher level languages plus GPU and drivers. came in picture. This also occurred in OS area where in 1992 I had change companies because Assembly Language developers started becoming a dying breed.

    I think part of this is Microsoft started adding so many features in the OS, and there is a lot of bulk to drive the windows interface which is much simpler in older versions.

    If I was with Microsoft, I would have options in Windows for super trim version of the OS. Reducing overhead as much as possible. Maybe dual boot to it.

  • HStewart - Tuesday, March 3, 2020 - link

    I have some of original Abrash's books - quite a collectors item now a days

    https://www.amazon.com/Zen-Graphics-Programming-2n...
  • HStewart - Tuesday, March 3, 2020 - link

    And even more - with Graphics Programming Black book - almost $1000 now

    https://www.amazon.com/Michael-Abrashs-Graphics-Pr...
  • Qasar - Tuesday, March 3, 2020 - link

    you do know there are programs out there that can remove some of the useless bloat that windows auto installs, right ? maybe not to the extent that you are referring to, but ot is possible. on a fresh reinstall of win 10, i usually remove almost 500 megs of apps that i wont use.
  • erple2 - Saturday, March 14, 2020 - link

    This is an age old argument that ultimately falls flat in the face of history. "Bloated" software today is VASTLY more capable of the "efficient" code written decades ago. You could make the argument that we might not need all of the capabilities of software today, but I rather like having the incredibly stable OS's today than what I had to deal with in the past. And yes, OS's today are much more stable than they were in 1992 (not to mention vastly more capable)
  • Lord of the Bored - Thursday, March 5, 2020 - link

    My recollection is that was Windows Vista, not XP. XP was hitting 2D acceleration hardware that had stopped improving much around the time Intel shipped their first graphics adapter.
    Vista, however, had a newfangled "3D" compositor that took advantage of all the hardware progress that had happened since 1995... and a butt-ugly fallback plan for systems that couldn't use it(read as: Intel graphics).
    And then two releases later, Windows 8 dialed things way back because those damnable Intel graphics chips were STILL a significant install base and they didn't want to keep maintaining multiple desktop renderers.
    ...
    Unless the Vista compositor was originally intended for XP, in which case I eat my hat.
  • TheinsanegamerN - Monday, March 2, 2020 - link

    you dont need a 6 core CPU for back office systems or report machines either. So they wouldnt buy this at all.

    Dell, HP, ece make small systems with better CPU power for a lower price then this. The appeal of the NUCs was good CPUs with iris level GPUs isntead of the UHD that everyone else used.
  • PeachNCream - Monday, March 2, 2020 - link

    The intention of the NUC was to provide a fairly basic computing device in a small and power efficient package. Iris models were something of an aberration in more recent models. In fact, the first couple of NUC generations used some of Intel's slowest processors available at the time. tim
  • niva - Tuesday, March 3, 2020 - link

    The point is that if you're making a basic computing device why even go beyond 4 cores. I kind of want a NUC as a basic browsing computer that takes up little space. I can see these being used in the office too. Many use cases for a device like this with 6 or more cores in the office, especially for folks in engineering fields running Matlab or doing development/compiling. However, in almost all of these use cases having a stronger graphics package helps, never mind gaming. Taking a step back in the GPU side, especially given what AMD is doing right now and this being in response to the competition, doesn't make much sense. Perhaps this is just to hold them over until Intel fully transitions to using AMD GPUs in the future?
  • Lord of the Bored - Thursday, March 5, 2020 - link

    Can I just say how much I love that four cores is now considered a "basic" computing device? It leaves me suffused with a warm glow of joy.

Log in

Don't have an account? Sign up now