SPEC CPU - Single-Threaded Performance

SPEC2017 and SPEC2006 is a series of standardized tests used to probe the overall performance between different systems, different architectures, different microarchitectures, and setups. The code has to be compiled, and then the results can be submitted to an online database for comparison. It covers a range of integer and floating point workloads, and can be very optimized for each CPU, so it is important to check how the benchmarks are being compiled and run.

We run the tests in a harness built through Windows Subsystem for Linux, developed by our own Andrei Frumusanu. WSL has some odd quirks, with one test not running due to a WSL fixed stack size, but for like-for-like testing is good enough. SPEC2006 is deprecated in favor of 2017, but remains an interesting comparison point in our data. Because our scores aren’t official submissions, as per SPEC guidelines we have to declare them as internal estimates from our part.

For compilers, we use LLVM both for C/C++ and Fortan tests, and for Fortran we’re using the Flang compiler. The rationale of using LLVM over GCC is better cross-platform comparisons to platforms that have only have LLVM support and future articles where we’ll investigate this aspect more. We’re not considering closed-sourced compilers such as MSVC or ICC.

clang version 10.0.0
clang version 7.0.1 (ssh://git@github.com/flang-compiler/flang-driver.git
 24bd54da5c41af04838bbe7b68f830840d47fc03)

-Ofast -fomit-frame-pointer
-march=x86-64
-mtune=core-avx2
-mfma -mavx -mavx2

Our compiler flags are straightforward, with basic –Ofast and relevant ISA switches to allow for AVX2 instructions. We decided to build our SPEC binaries on AVX2, which puts a limit on Haswell as how old we can go before the testing will fall over. This also means we don’t have AVX512 binaries, primarily because in order to get the best performance, the AVX-512 intrinsic should be packed by a proper expert, as with our AVX-512 benchmark.

To note, the requirements for the SPEC licence state that any benchmark results from SPEC have to be labelled ‘estimated’ until they are verified on the SPEC website as a meaningful representation of the expected performance. This is most often done by the big companies and OEMs to showcase performance to customers, however is quite over the top for what we do as reviewers.

Single-threaded performance of TGL-H shouldn’t be drastically different from that of TGL-U, however there’s a few factors which can come into play and affect the results: The i9-11980HK TGL-H system has a 200MHz higher boost frequency compared to the i7-1185G7, and a single core now has access to up to 24MB of L3 instead of just 12MB.

SPECint2017 Rate-1 Estimated Scores

In SPECint2017, the one results which stands out the most if 502.gcc_r where the TGL-H processor lands in at +16% ahead of TGL-U, undoubtedly due to the increased L3 size of the new chip.

Generally speaking, the new TGL-H chip outperforms its brethren and AMD competitors in almost all tests.

SPECfp2017 Rate-1 Estimated Scores

In the SPECfp2017 suite, we also see general small improvements across the board. The 549.fotonik3d_r test sees a regression which is a bit odd, but I think is related to the LPDDR4 vs DDR4 discrepancy in the systems which I’ll get back to in the next page where we’ll see more multi-threaded results related to this.

SPEC2017 Rate-1 Estimated Total

From an overall single-threaded performance standpoint, the TGL-H i9-11980HK adds in around +3.5-7% on top of what we saw on the i7-1185G7, which lands it amongst the best performing systems – not only amongst laptop CPUs, but all CPUs. The performance lead against AMD’s strongest mobile CPU, the 5980HS is even a little higher than against the i7-1185G7, but loses out against AMD’s best desktop CPU, and of course Apple M1 CPU and SoC used in the latest Macbooks. This latter comparison is apples-to-apples in terms of compiler settings, and is impressive given it does it at around 1/3rd of the package power under single-threaded scenarios.

CPU Tests: Core-to-Core and Cache Latency SPEC CPU - Multi-Threaded Performance
Comments Locked

229 Comments

View All Comments

  • vyor - Monday, May 17, 2021 - link

    Worst case for Zen3 is matching Zen2. That's the *worst* case. Name a single actual workload it's slower in.
  • Otritus - Monday, May 17, 2021 - link

    Vermeer was consistently faster than Matisse, but Milan was not consistently faster than Rome. Cezanne is faster than Renoir in all but 1 subtest. All 3 comparisons are Zen 3 vs Zen 2. Also SPEC isn't an actual workload by the standards of it's something people run for work or entertainment. It's just a series of industry-standard benchmarks to evaluate the performance of processors. In all of the real workloads Cezanne wins.
  • mode_13h - Monday, May 17, 2021 - link

    > Milan was not consistently faster than Rome.

    Because the IO die is consuming too much power @ the higher frequency it uses in Milan. Not due to the cores, themselves.
  • Bagheera - Tuesday, May 18, 2021 - link

    Rocket Lake was well loved.... by who? it was universally panned by reviewers. the lower end sub-$300 i5 may be good value, but that's about it. the high end parts not only lose to Zen 3 but loses even to CML in some cases.
  • Makste - Monday, May 31, 2021 - link

    Take a sarcasm 😉
  • Hifihedgehog - Monday, May 17, 2021 - link

    Exactly. Generally, I find the results here very accurate here, but that needs serious attention.
  • vyor - Monday, May 17, 2021 - link

    I find that his Spec testing has gotten worse and worse over the years. Andrei honestly just don't know how to use the suite and it almost always makes some parts look better than others when they really shouldn't be. Just look at the M1 tests for that, where the single thread perf in SPEC vastly exceeds that scene in any other test.
  • Andrei Frumusanu - Monday, May 17, 2021 - link

    You're welcome to demonstrate what is flawed with actual technical arguments.

    The M1 exceeds because it's that good, we're missing it in many other benchmarks simply because they aren't ported to macOS or currently don't have data on them.
  • vyor - Monday, May 17, 2021 - link

    "it's just that good" except in every single case it isn't.

    Name a single workload where the spec results line up with application performance.
  • Ppietra - Monday, May 17, 2021 - link

    Single thread performance seems to align quite well with other tasks!
    Look at Cinebench single thread performance. Look at compiling performance. Look at javascript performance, etc, etc!

Log in

Don't have an account? Sign up now