System Performance: Miscellaneous Workloads

Standardized benchmarks such as UL's PCMark 10 and BAPCo's SYSmark take a holistic view of the system and process a wide range of workloads to arrive at a single score. Some systems are required to excel at specific tasks - so it is often helpful to see how a computer performs in specific scenarios such as rendering, transcoding, JavaScript execution (web browsing), etc. This section presents focused benchmark numbers for specific application scenarios.

3D Rendering - CINEBENCH R23

We use CINEBENCH R23 for 3D rendering evaluation. R23 provides two benchmark modes - single threaded and multi-threaded. Evaluation of different PC configurations in both supported modes provided us the following results.

3D Rendering - CINEBENCH R23 - Single Thread

3D Rendering - CINEBENCH R23 - Multiple Threads

It appears that enabling ECC has negligible effect on rendering performance. In the single-threaded case, the 28W PL1 Core i7-1360P in the new system performs roughly on par with the 40W PL1 Core i7-1260P in the Wall Street Canyon NUC. However, the lagging PL1 is a liability in the multi-threaded case, allowing both the Wall Street Canyon NUC and the 4x4 BOX-5800U to take a huge lead.

Transcoding: Handbrake 1.5.1

Handbrake is one of the most user-friendly open source transcoding front-ends in the market. It allows users to opt for either software-based higher quality processing or hardware-based fast processing in their transcoding jobs. Our new test suite uses the 'Tears of Steel' 4K AVC video as input and transcodes it with a quality setting of 19 to create a 720p AVC stream and a 1080p HEVC stream.

Transcoding - x264

Transcoding - x265_10bit

The relative ordering seen in the Cinebench multi-threading case is also seen in the case of x264 and x265 encoding for the same reason. The 28W PL1 is a downer for long-running tasks in the NUCS BOX-1360P/D4.

Transcoding - QuickSync H.264

Transcoding - QuickSync H.265 10bit

In the QuickSync case, which is purely a reflection of the iGPU clock speeds, the Wall Street Canyon NUC with higher PL1 is able to maintain faster clocks compared to the NUCS BOX, despite the latter having higher iGPU speeds on paper. Enabling ECC causes the frame rate to slip, only to be expected based on previous results for GPU-heavy benchmarks.

Archiving: 7-Zip 21.7

The 7-Zip benchmark is carried over from our previous test suite with an update to the latest version of the open source compression / decompression software.

7-Zip Compression Rate

7-Zip Decompression Rate

Higher power budgets and core counts matter in this test - so, the trend observed in the rendering and transcoding tests hold true here. ECC seems to negatively impact the compression rate, possibly due to the triggering of a large number of unaligned accesses to the external memory.

Web Browsing: JetStream, Speedometer, and Principled Technologies WebXPRT4

Web browser-based workloads have emerged as a major component of the typical home and business PC usage scenarios. For headless systems, many applications based on JavaScript are becoming relevant too. In order to evaluate systems for their JavaScript execution efficiency, we are carrying over the browser-focused benchmarks from the WebKit developers used in our notebook reviews. Hosted at BrowserBench, JetStream 2.0 benchmarks JavaScript and WebAssembly performance, while Speedometer measures web application responsiveness.

BrowserBench - Jetstream 2.0

BrowserBench - Speedometer 2.0

From a real-life workload perspective, we also process WebXPRT4 from Principled Technologies. WebXPRT4 benchmarks the performance of some popular JavaScript libraries that are widely used in websites.

Principled Technologies WebXPRT4

Single-threaded performance matters heavily in browser benchmarks. Here, the improvements in Raptor Lake-P come to fore. Even with ECC enabled, the NUCS BOX system is able to surpass the performance of the Wall Street Canyon with a higher PL1.

Application Startup: GIMP 2.10.30

A new addition to our systems test suite is AppTimer - a benchmark that loads up a program and determines how long it takes for it to accept user inputs. We use GIMP 2.10.30 with a 50MB multi-layered xcf file as input. What we test here is the first run as well as the cached run - normally on the first time a user loads the GIMP package from a fresh install, the system has to configure a few dozen files that remain optimized on subsequent opening. For our test we delete those configured optimized files in order to force a fresh load every second time the software is run.

AppTimer: GIMP 2.10.30 Startup

The 'cached start' situation is a win for the NUCS BOX, but the system suffers in the 'cold start' scenario. Based on the relative ordering of the system, the processor architecture generation and PL1 configuration appear to be the likely affecting factors.

System Performance: UL and BAPCo Benchmarks GPU Performance: Synthetic Benchmarks
Comments Locked

30 Comments

View All Comments

  • mode_13h - Tuesday, February 14, 2023 - link

    I also don't agree that W680 boards are scarce. At least Supermicro boards seemed to be easy enough to find since the end of last year. Now DDR5 ECC UDIMMs have been a much bigger challenge, but they're thankfully now readily available too.
  • mode_13h - Tuesday, February 7, 2023 - link

    Thanks for the review, but my ideal microserver would be fanless and support a 2.5" SATA SSD. Does anyone know if any of their fanless boxes support in-band ECC? I couldn't find any indication that they do.

    https://www.asrockind.com/en-gb/fanless-embedded-b...
  • ganeshts - Wednesday, February 8, 2023 - link

    ASRock Industrial took notice of your comment and requested that this be posted in response.


    ASRock Industrial technical support team appreciate your attention on our product.

    ASRock Industrial will use Intel 13Gen. IoTG SKUs CPU on the iBOX-series products.
    It will design as a fanless system with 2.5" SATA SSD support.
    For In-Band ECC feature, please note that Intel support it on select Industrial SKUs according to Intel’s official documents.
    We suggest to keep following ASRock Industrial’s website for more and latest news.

    https://www.asrockind.com/en-gb/fanless-embedded-b...
  • mode_13h - Thursday, February 9, 2023 - link

    Thanks for the follow-up!

    Now, if I could just find an ASRock Rack X570D4U-2L2T Mini-ATX board in stock somewhere in the US. I can never seem to find it or the newer /BCM version.
  • mode_13h - Monday, February 27, 2023 - link

    Just wanted to follow up on the ASRock Rack X570D4U-2L2T. It's finally back in stock @ newegg! Shipped & sold by newegg, too (i.e. not just some scalper).

    For those not familiar with this product, it's a micro-ATX AM4 server board with dual 10G Ethernet, ECC RAM support, and remote management via BMC. I'm excited, because there are no other products like it, to my knowledge. ASRock Rack has validated ECC memory on it, which you tend to see on other AM4 boards. You can find professional reviews of it, on other sites.

    I'm about to order mine, now.
  • mode_13h - Monday, February 27, 2023 - link

    Sorry, I meant to say that I _haven't_ seen ECC memory fully validated and supported, on other AM4 boards. This is one of the preferred boards of the homebrew NAS community.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    Nice NUC. But I am waiting on the 7735U.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    $690 barebones.
  • sjkpublic@gmail.com - Monday, February 13, 2023 - link

    Silly people posting on ECC for a end user desktop/kiosk device - trying to put a square peg in a round hole. I like the idealistic attitude. But the realistic says otherwise.
  • sjkpublic@gmail.com - Tuesday, February 14, 2023 - link

    Silly me! I retract. ECC support is a great idea.

Log in

Don't have an account? Sign up now