System Performance: Miscellaneous Workloads

Standardized benchmarks such as UL's PCMark 10 and BAPCo's SYSmark take a holistic view of the system and process a wide range of workloads to arrive at a single score. Some systems are required to excel at specific tasks - so it is often helpful to see how a computer performs in specific scenarios such as rendering, transcoding, JavaScript execution (web browsing), etc. This section presents focused benchmark numbers for specific application scenarios.

3D Rendering - CINEBENCH R23

We use CINEBENCH R23 for 3D rendering evaluation. R23 provides two benchmark modes - single threaded and multi-threaded. Evaluation of different PC configurations in both supported modes provided us the following results.

3D Rendering - CINEBENCH R23 - Single Thread

3D Rendering - CINEBENCH R23 - Multiple Threads

It appears that enabling ECC has negligible effect on rendering performance. In the single-threaded case, the 28W PL1 Core i7-1360P in the new system performs roughly on par with the 40W PL1 Core i7-1260P in the Wall Street Canyon NUC. However, the lagging PL1 is a liability in the multi-threaded case, allowing both the Wall Street Canyon NUC and the 4x4 BOX-5800U to take a huge lead.

Transcoding: Handbrake 1.5.1

Handbrake is one of the most user-friendly open source transcoding front-ends in the market. It allows users to opt for either software-based higher quality processing or hardware-based fast processing in their transcoding jobs. Our new test suite uses the 'Tears of Steel' 4K AVC video as input and transcodes it with a quality setting of 19 to create a 720p AVC stream and a 1080p HEVC stream.

Transcoding - x264

Transcoding - x265_10bit

The relative ordering seen in the Cinebench multi-threading case is also seen in the case of x264 and x265 encoding for the same reason. The 28W PL1 is a downer for long-running tasks in the NUCS BOX-1360P/D4.

Transcoding - QuickSync H.264

Transcoding - QuickSync H.265 10bit

In the QuickSync case, which is purely a reflection of the iGPU clock speeds, the Wall Street Canyon NUC with higher PL1 is able to maintain faster clocks compared to the NUCS BOX, despite the latter having higher iGPU speeds on paper. Enabling ECC causes the frame rate to slip, only to be expected based on previous results for GPU-heavy benchmarks.

Archiving: 7-Zip 21.7

The 7-Zip benchmark is carried over from our previous test suite with an update to the latest version of the open source compression / decompression software.

7-Zip Compression Rate

7-Zip Decompression Rate

Higher power budgets and core counts matter in this test - so, the trend observed in the rendering and transcoding tests hold true here. ECC seems to negatively impact the compression rate, possibly due to the triggering of a large number of unaligned accesses to the external memory.

Web Browsing: JetStream, Speedometer, and Principled Technologies WebXPRT4

Web browser-based workloads have emerged as a major component of the typical home and business PC usage scenarios. For headless systems, many applications based on JavaScript are becoming relevant too. In order to evaluate systems for their JavaScript execution efficiency, we are carrying over the browser-focused benchmarks from the WebKit developers used in our notebook reviews. Hosted at BrowserBench, JetStream 2.0 benchmarks JavaScript and WebAssembly performance, while Speedometer measures web application responsiveness.

BrowserBench - Jetstream 2.0

BrowserBench - Speedometer 2.0

From a real-life workload perspective, we also process WebXPRT4 from Principled Technologies. WebXPRT4 benchmarks the performance of some popular JavaScript libraries that are widely used in websites.

Principled Technologies WebXPRT4

Single-threaded performance matters heavily in browser benchmarks. Here, the improvements in Raptor Lake-P come to fore. Even with ECC enabled, the NUCS BOX system is able to surpass the performance of the Wall Street Canyon with a higher PL1.

Application Startup: GIMP 2.10.30

A new addition to our systems test suite is AppTimer - a benchmark that loads up a program and determines how long it takes for it to accept user inputs. We use GIMP 2.10.30 with a 50MB multi-layered xcf file as input. What we test here is the first run as well as the cached run - normally on the first time a user loads the GIMP package from a fresh install, the system has to configure a few dozen files that remain optimized on subsequent opening. For our test we delete those configured optimized files in order to force a fresh load every second time the software is run.

AppTimer: GIMP 2.10.30 Startup

The 'cached start' situation is a win for the NUCS BOX, but the system suffers in the 'cold start' scenario. Based on the relative ordering of the system, the processor architecture generation and PL1 configuration appear to be the likely affecting factors.

System Performance: UL and BAPCo Benchmarks GPU Performance: Synthetic Benchmarks
Comments Locked

30 Comments

View All Comments

  • AntonErtl - Saturday, February 4, 2023 - link

    Given that ECC error reports are extremely rare on our systems (with typically 128GB of RAM), I don't worry about having more than one error in 512 bits. Even when a DIMM failed, it resulted in 19 ECC errors (18 uncorrectable) in 14 hours, probably noticed by scrubbing (regular walks through memory to detect whether a bit has flipped).
  • HideOut - Sunday, January 29, 2023 - link

    You linked the wrong item for barebones. You linked the old model.
  • ganeshts - Monday, January 30, 2023 - link

    Yes, the target page will get updated with the additional new model once Newegg is ready to sell them (as per the info I have from ASRock Industrial). If the URL changes, I will update it. For now, the system has just started entering the channel and is not available for end-user purchase yet.
  • GhostOfAnand - Monday, January 30, 2023 - link

    Good work, G-man. I liked the expose on this in-band ECC business. Discussion here: https://www.realworldtech.com/forum/?threadid=2104...
  • notR1CH - Tuesday, January 31, 2023 - link

    I would love to see some video tests at non-standard resolutions like "5K" (5120x2160). I have a couple of kiosks that run weird display resolutions and would love to use a NUC to power them, but with the official specs only going up to 4K I've not wanted to risk it not working.
  • abufrejoval - Saturday, February 4, 2023 - link

    Well, it stands to reason that the in-band ECC option would be physically available on all recent SoCs, because nobody can resist maximizing cut & paste IP blocks.

    But with Intel NUCs, there is literally no chance whatsoever they'd support that on non-industrial SKUs, because it's a chance to charge double.

    So I wonder if they won't force OEMs to disable that 'rogue' feature, much like AES512 or some of the recent BLK overclocking gimmicks.

    I don't even mind paying an ECC premium on hardware I run 24x7, because in those cases compromised data would cost much more. But you can't buy "ECC-variants" of common NUCs and recently even buying ECC variant mainboards of classical desktop chipsets e.g. W680 has become next to impossible, when that was relatively easy say in Haswell times.

    Don't know if it's because it's too niche or if Intel is somehow actively discouraging that market. AMD came to rescue until it went with DDR5, where ECC variants were "unobtainium".

    All I can say is that I'd be happy to throw €100 at the ability to activate in-band ECC for any SoC that phyiscally supports it, even in a notebook that might get recycled as a server after it's no longer fit for the roadtrips.
  • AntonErtl - Saturday, February 4, 2023 - link

    W680 boards are available in Germany and Austria, but they are expensive (>EUR 440).

    DDR5 UDIMMs with ECC are available in Germany and Austria from Kingston at ~EUR 210 for a 32GB UDIMM. Note that unlike for AM4, Asrock apparently no longer supports ECC with AM5, currently leaving ASUS as only supplyer for those of us who want ECC. At least AMD officially supports ECC in all socketed Ryzen 7000 CPUs up to now.
  • mode_13h - Tuesday, February 14, 2023 - link

    > Asrock apparently no longer supports ECC with AM5

    Even ASRock Rack? They've announced AM5 boards, but I'm not sure if they're yet shipping.
  • AntonErtl - Wednesday, March 1, 2023 - link

    There are no Asrock Rack AM5 boards listed on geizhals.at yet, so those may or may not support ECC when they become available.

    If this is an attempt by Asrock to get us to buy the more expensive Asrock Rack boards, it will fail: We will just buy ASUS.
  • mode_13h - Sunday, March 5, 2023 - link

    BTW, the only ECC DDR5 UDIMMs I'm seeing are all DDR5-4800. I think it'll be a while before we see anything much faster.

    This could be a point in favor of in-band ECC, if only support for it would be more widespread.

Log in

Don't have an account? Sign up now