CPU Performance: Encoding Tests

With the rise of streaming, vlogs, and video content as a whole, encoding and transcoding tests are becoming ever more important. Not only are more home users and gamers needing to convert video files into something more manageable, for streaming or archival purposes, but the servers that manage the output also manage around data and log files with compression and decompression. Our encoding tasks are focused around these important scenarios, with input from the community for the best implementation of real-world testing.

All of our benchmark results can also be found in our benchmark engine, Bench.

For our graphs, some of them have two values: a regular value in orange, and one in red called 'Intel Spec'. ASUS offers the option to 'open up' the power and current limits of the chip, so the CPU is still running at the same frequency but is not throttled. Despite Intel saying that they recommend 'Intel Spec', the system they sent to us to test was actually set up with the power limits opened up, and the results they provided for us to compare to internally also correlated with that setting. As a result, we're providing both sets results for our CPU tests.

Handbrake 1.1.0: Streaming and Archival Video Transcoding

A popular open source tool, Handbrake is the anything-to-anything video conversion software that a number of people use as a reference point. The danger is always on version numbers and optimization, for example the latest versions of the software can take advantage of AVX-512 and OpenCL to accelerate certain types of transcoding and algorithms. The version we use here is a pure CPU play, with common transcoding variations.

We have split Handbrake up into several tests, using a Logitech C920 1080p60 native webcam recording (essentially a streamer recording), and convert them into two types of streaming formats and one for archival. The output settings used are:

  • 720p60 at 6000 kbps constant bit rate, fast setting, high profile
  • 1080p60 at 3500 kbps constant bit rate, faster setting, main profile
  • 1080p60 HEVC at 3500 kbps variable bit rate, fast setting, main profile

Handbrake 1.1.0 - 720p60 x264 6000 kbps FastHandbrake 1.1.0 - 1080p60 x264 3500 kbps FasterHandbrake 1.1.0 - 1080p60 HEVC 3500 kbps Fast

.

7-zip v1805: Popular Open-Source Encoding Engine

Out of our compression/decompression tool tests, 7-zip is the most requested and comes with a built-in benchmark. For our test suite, we’ve pulled the latest version of the software and we run the benchmark from the command line, reporting the compression, decompression, and a combined score.

It is noted in this benchmark that the latest multi-die processors have very bi-modal performance between compression and decompression, performing well in one and badly in the other. There are also discussions around how the Windows Scheduler is implementing every thread. As we get more results, it will be interesting to see how this plays out.

Please note, if you plan to share out the Compression graph, please include the Decompression one. Otherwise you’re only presenting half a picture.

7-Zip 1805 Compression7-Zip 1805 Decompression7-Zip 1805 Combined

.

WinRAR 5.60b3: Archiving Tool

My compression tool of choice is often WinRAR, having been one of the first tools a number of my generation used over two decades ago. The interface has not changed much, although the integration with Windows right click commands is always a plus. It has no in-built test, so we run a compression over a set directory containing over thirty 60-second video files and 2000 small web-based files at a normal compression rate.

WinRAR is variable threaded but also susceptible to caching, so in our test we run it 10 times and take the average of the last five, leaving the test purely for raw CPU compute performance.

WinRAR 5.60b3

.

AES Encryption: File Security

A number of platforms, particularly mobile devices, are now offering encryption by default with file systems in order to protect the contents. Windows based devices have these options as well, often applied by BitLocker or third-party software. In our AES encryption test, we used the discontinued TrueCrypt for its built-in benchmark, which tests several encryption algorithms directly in memory.

The data we take for this test is the combined AES encrypt/decrypt performance, measured in gigabytes per second. The software does use AES commands for processors that offer hardware selection, however not AVX-512.

AES Encoding

.

CPU Performance: Office Tests CPU Performance: Web and Legacy Tests
Comments Locked

136 Comments

View All Comments

  • Yorgos - Wednesday, January 30, 2019 - link

    it's not only program dependent, it's also scheduler dependent.
    It is found that the windows scheduler doesn't treat TR very well and throttles it down.(ref. L1T)
  • MattZN - Wednesday, January 30, 2019 - link

    Yup, in a nutshell. When Microsoft finally fixes that scheduler issue all of these sites will have to rerun their benchmarks. While it won't run away on performance, the results will start to look more like they should given the HW capabilities. Not a problem for me with Linux but its kinda amusing that Windows users are so beholden to bugs like these and even the professional reviewers get lost when there isn't a convenient UI button that explains what is going on.

    -Matt
  • mapesdhs - Saturday, February 2, 2019 - link

    Is that the same issue as the one referring to running on core zero? I watched a video about it recently but I can't recall if it was L1T or elsewhere.
  • jospoortvliet - Sunday, February 3, 2019 - link

    it is that issue yes. blocking use of core is a work-around that kind'a works.
  • jospoortvliet - Sunday, February 3, 2019 - link

    (in some workloads, not all)
  • Coolmike980 - Monday, February 4, 2019 - link

    So here's my thing: Why can't we have good benchmarks? Nothing here on Linux, and nothing in a VM. I'd be willing to be good money I could take a 2990, run Linux, run 5 VM's of 6 cores each, run these benchmarks (the non-gpu dependent ones), and collectively beat the pants off of this CPU under any condition you want to run it. Also, this Civ 6 thing - the only benchmark that would be of any value would be the CPU one, and they've been claiming to want to make this work for 2 years now. Either get it working, or drop it altogether. Rant over. Thanks.
  • FlanK3r - Wednesday, January 30, 2019 - link

    where is CinebenchR15 results? In testing methology is it, but in results I can not find it :)
  • MattsMechanicalSSI - Wednesday, January 30, 2019 - link

    der8auer did a delid video, and a number of CB runs. https://www.youtube.com/watch?v=aD9B-uu8At8 Also, Steve at GN has had a good look at it. https://www.youtube.com/watch?v=N29jTOjBZrw
  • MattZN - Wednesday, January 30, 2019 - link

    @MattsMechanicalSSI Yup... both are very telling.

    I give the 3175X a pass on DDR connectivity (from the DerBauer video) since he's constantly having to socket and unsocket the chip, but I agree with him that there should be a carrier for a chip that large. Depending on the user to guess the proper pressure is a bad idea.

    But, particularly the GN review around 16:00 or so where we see the 3175X pulling 672W at the wall (OC) for a tiny improvement in time over the 2990WX. Both AMD and Intel goose these CPUs, even at stock, but the Intel numbers are horrendous. They aren't even trying to keep wattages under control.

    The game tests are more likely an issue with the windows scheduler (ala Wendel's work). And the fact that nobody in their right mind runs games on these CPUs.

    The Xeon is certainly a faster CPU, but the price and the wattage cost kinda make it a non-starter. There's really no point to it, not even for professional work. Steve (GN) kinda thinks that there might be a use-case with Premier but... I don't really. At least not for the ~5 months or so before we get the next node on AMD (and ~11 months for Intel).

    -Matt
  • mapesdhs - Saturday, February 2, 2019 - link

    Cinebench is badly broken at this level of cores, it's not scaling properly anymore. See:

    https://www.servethehome.com/cinebench-r15-is-now-...

Log in

Don't have an account? Sign up now