Miscellaneous Benchmarks

This section looks at some of the other commonly used benchmarks representative of the performance of specific real-world applications.

3D Rendering - CINEBENCH R15

We use CINEBENCH R15 for 3D rendering evaluation. The program provides three benchmark modes - OpenGL, single threaded and multi-threaded. Evaluation of different PC configurations in all three modes provided us the following results.

3D Rendering - CINEBENCH R15 - Single Thread

3D Rendering - CINEBENCH R15 - Multiple Threads

3D Rendering - CINEBENCH R15 - OpenGL

The gulf in the single-threaded score can be attributed to the actively-cooled version sustaining boost clocks for longer than the fanless version.

x265 Benchmark

Next up, we have some video encoding benchmarks using x265 v2.8. The appropriate encoder executable is chosen based on the supported CPU features. In the first case, we encode 600 1080p YUV 4:2:0 frames into a 1080p30 HEVC Main-profile compatible video stream at 1 Mbps and record the average number of frames encoded per second.

Video Encoding - x265 - 1080p

Our second test case is 1200 4K YUV 4:2:0 frames getting encoded into a 4Kp60 HEVC Main10-profile video stream at 35 Mbps. The encoding FPS is recorded.

Video Encoding - x265 - 4K 10-bit

Here, we see the versions stacked much closer to each other - these results pretty much conform to what we see further down in the thermal stress section.

7-Zip

7-Zip is a very effective and efficient compression program, often beating out OpenCL accelerated commercial programs in benchmarks even while using just the CPU power. 7-Zip has a benchmarking program that provides tons of details regarding the underlying CPU's efficiency. In this subsection, we are interested in the compression and decompression rates when utilizing all the available threads for the LZMA algorithm.

7-Zip LZMA Compression Benchmark

7-Zip LZMA Decompression Benchmark

The performance numbers for both benchmarks are close to each other, and within the range of run-to-run variance.

Cryptography Benchmarks

Cryptography has become an indispensable part of our interaction with computing systems. Almost all modern systems have some sort of hardware-acceleration for making cryptographic operations faster and more power efficient. In this sub-section, we look at two different real-world applications that may make use of this acceleration.

BitLocker is a Windows features that encrypts entire disk volumes. While drives that offer encryption capabilities are dealt with using that feature, most legacy systems and external drives have to use the host system implementation. Windows has no direct benchmark for BitLocker. However, we cooked up a BitLocker operation sequence to determine the adeptness of the system at handling BitLocker operations. We start off with a 2.5GB RAM drive in which a 2GB VHD (virtual hard disk) is created. This VHD is then mounted, and BitLocker is enabled on the volume. Once the BitLocker encryption process gets done, BitLocker is disabled. This triggers a decryption process. The times taken to complete the encryption and decryption are recorded. This process is repeated 25 times, and the average of the last 20 iterations is graphed below.

BitLocker Encryption Benchmark

BitLocker Decryption Benchmark

Creation of secure archives is best done through the use of AES-256 as the encryption method while password protecting ZIP files. We re-use the benchmark mode of 7-Zip to determine the AES256-CBC encryption and decryption rates using pure software as well as AES-NI. Note that the 7-Zip benchmark uses a 48KB buffer for this purpose.

7-Zip AES256-CBC Encryption Benchmark

7-Zip AES256-CBC Decryption Benchmark

Yet another cryptography application is secure network communication. OpenSSL can take advantage of the acceleration provided by the host system to make operations faster. It also has a benchmark mode that can use varying buffer sizes. We recorded the processing rate for a 8KB buffer using the hardware-accelerated AES256-CBC-HAC-SHA1 feature.

OpenSSL Encryption Benchmark

OpenSSL Decryption Benchmark

All of the above performance numbers for the standard kit and the Turing version are within the range of run-to-run variance, as expected.

Agisoft Photoscan

Agisoft PhotoScan is a commercial program that converts 2D images into 3D point maps, meshes and textures. The program designers sent us a command line version in order to evaluate the efficiency of various systems that go under our review scanner. The command line version has two benchmark modes, one using the CPU and the other using both the CPU and GPU (via OpenCL). We present the results from our evaluation using the CPU mode only. The benchmark (v1.3) takes 84 photographs and does four stages of computation:

  • Stage 1: Align Photographs (capable of OpenCL acceleration)
  • Stage 2: Build Point Cloud (capable of OpenCL acceleration)
  • Stage 3: Build Mesh
  • Stage 4: Build Textures

We record the time taken for each stage. Since various elements of the software are single threaded, and others multithreaded, it is interesting to record the effects of CPU generations, speeds, number of cores, and DRAM parameters using this software.

Agisoft PhotoScan Benchmark - Stage 1

Agisoft PhotoScan Benchmark - Stage 2

Agisoft PhotoScan Benchmark - Stage 3

Agisoft PhotoScan Benchmark - Stage 4

There are variances from stage to stage - however, the overall time taken is similar for both versions.

Dolphin Emulator

Wrapping up our application benchmark numbers is the new Dolphin Emulator (v5) benchmark mode results. This is again a test of the CPU capabilities.

Dolphin Emulator Benchmark

The standard kit completes the benchmark with slightly higher scores, but it is not a significant performance gulf.

BAPCo and UL Benchmarks HTPC Aspects
Comments Locked

28 Comments

View All Comments

  • Flunk - Tuesday, October 27, 2020 - link

    The publicity photos on Akasa's site show it in both orientations.
  • Operandi - Monday, October 26, 2020 - link

    The build quality on these is pretty exceptional and they work really well. I have a slightly smaller version with i3 based NUC hardware functioning as a HTPC; 0 noise and looks sick. At some point I'd like to try one of their ITX options with a AMD APU.
  • tfouto - Monday, December 28, 2020 - link

    Does the Wlan antena works on the new case? If not how does one solve this?
  • eastcoast_pete - Monday, October 26, 2020 - link

    Thanks, interesting review! This question isa bit out of left field, but are there (still) kits or build plans for a silent mineral oil-immersion cooled systems out there? (Very pure, pharmaceutical grade mineral oil, of course) I thought for a long time now that those might be a great solution for silent computing, as long as one doesn't want or have to modify the setup after it's in the oil. Any experience with one of those? They should be able to take a lot more TDP than a dry passive system like this one.
  • SirPerro - Monday, October 26, 2020 - link

    That exists since a long time ago. It works just fine! Very heavy build and nasty maintenance though...
  • eastcoast_pete - Monday, October 26, 2020 - link

    I saw some older reports and even reviews on those, but most were at least 10 years old and "archived". Do you (or anyone else) here know of kits that are available to buy. The DYI is a bit risky and gets messy, not the least because oil tends to travel up cables and connectors; there is a reason why WD40 etc exist and work - oil has high capillary action. Any information is appreciated!
  • Spunjji - Wednesday, October 28, 2020 - link

    I don't think there was ever enough money in it for kits to be sustainable - it's just too niche!
  • dontlistentome - Monday, October 26, 2020 - link

    Had two of their cases previously - Euler (thin-itx +35w i5) and Newton (7th Gen i5 NUC).
    Might be a northern european thing (UK) but in our typical rooms at home with no active air circulation, i've had overheating issues with both - throttling and outright thermal shutdown. Had to run a usb fan at times that defeats the whole point.
    Looking at the peak temperatures here, i'm guessing this is the same.
    I've now gone for a case with a slow fan that I can hide under my desk - not as pretty but it never crashes and is effectively silent too.
  • Operandi - Monday, October 26, 2020 - link

    Room air flow plays a role I'm sure. My gen 8 i3 based NUC is in the Plato which looks like it has quite a bit more surface area than the Newton. Its also out completely out in the open and has the benefit of central air though AC is almost never on. I've never had thermal issues with mine running World Community Grid at 75% load all summer. A 100% stress test on a hot day (28c) will cause it to throttle but thats not a realistic use case so I'd say it does quite well.
  • Oxford Guy - Monday, October 26, 2020 - link

    Remember the Kickstarter for the high-performance fabless gaming system touted by TweakTown, Linus, and others? Calyos.

    Apparently vaporware. The backers, last time I checked, received nothing. And, that may include people who preordered from their separate website. Also, apparently some of the people behind the Calyos debacle moved on to set up another company to sell, you guessed it, fabless gaming PCs and cases. I assume that didn’t go very far, too.

    People with tinnitus who want to game have a hard time. They either get to choose underpowered equipment or vaporware.

Log in

Don't have an account? Sign up now