CPU Tests: SPEC Performance

SPEC2017 is a series of standardized tests used to probe the overall performance between different systems, different architectures, different microarchitectures, and setups. The code has to be compiled, and then the results can be submitted to an online database for comparison. It covers a range of integer and floating point workloads, and can be very optimized for each CPU, so it is important to check how the benchmarks are being compiled and run.

For compilers, we use LLVM both for C/C++ and Fortran tests, and for Fortran we’re using the Flang compiler. The rationale of using LLVM over GCC is better cross-platform comparisons to platforms that have only have LLVM support and future articles where we’ll investigate this aspect more. We’re not considering closed-sourced compilers such as MSVC or ICC.

clang version 10.0.0
clang version 7.0.1 (ssh://git@github.com/flang-compiler/flang-driver.git
 24bd54da5c41af04838bbe7b68f830840d47fc03)

-Ofast -fomit-frame-pointer
-march=x86-64
-mtune=core-avx2
-mfma -mavx -mavx2

Our compiler flags are straightforward, with basic –Ofast and relevant ISA switches to allow for AVX2 instructions. We decided to build our SPEC binaries on AVX2, which puts a limit on Haswell as how old we can go before the testing will fall over. This also means we don’t have AVX512 binaries, primarily because in order to get the best performance, the AVX-512 intrinsic should be packed by a proper expert, as with our AVX-512 benchmark. All of the major vendors, AMD, Intel, and Arm, all support the way in which we are testing SPEC.

To note, the requirements for the SPEC licence state that any benchmark results from SPEC have to be labeled ‘estimated’ until they are verified on the SPEC website as a meaningful representation of the expected performance. This is most often done by the big companies and OEMs to showcase performance to customers, however is quite over the top for what we do as reviewers.

SPEC2017 Rate-1 Estimated Total

In the single threaded test, the jump over the regular Zen 3 Ryzen mobile variant (5980HS) at the same power is quite substantial: +9.6% on integer performance and +14.1% on floating point. The move from DDR4 to DDR5 is quite substantial in that regard, and it’s seen in a lot of our upcoming benchmarks.

We didn’t see any change from 35 W to 45 W to 65 W in our AMD testing as the power consumption of the chip in single threaded workloads did not exceed 24 W, however we did see performance difference in Intel’s Alder Lake going from 45 W to 65 W, showcasing how much power the core can consume.

But if we compared that to Intel’s latest Alder Lake offerings, there’s a deficit in both categories – even though our lowest data here is at 45 W, we can see that the 45 W testing of the previous generation Intel also beats the 6900HS at SPECint (but AMD wins in SPECfp). This is something that carries through to multi-threaded performance.

SPEC2017 Rate-N Estimated Total

For Multi-Threaded performance, we only saw the slightest improvement from AMD moving up to 65 W, perhaps showcasing that the hardware is limited in other ways than just power and the uplift from DDR4 to DDR5. In any event, at 35 W, AMD still surpasses what the previous generation Intel i9-11980HK can provide at 65 W.

But if we compare it to Intel’s latest Alder Lake processors, featuring 6 performance cores and 8 efficiency cores, we now have 20 threads up against AMD’s 16 threads. If we compare 45 W to 45 W, Intel has a +14.0% lead in integer and a +13.3% lead in floating point, despite the 20% increase in threads. With Intel introducing this dual tier performance with hybrid SoCs, multi-threaded performance is going to be a combination of fast+slow and it all comes down to how the system can divide up the work.

Performance Per Watt CPU Tests: Office and Science
POST A COMMENT

92 Comments

View All Comments

  • mode_13h - Friday, March 18, 2022 - link

    > I haven't seen most of the anime you mentioned

    The Patlabor OAVs and movies are good for an 80's/90's nostalgia hit, IMO. It's that sort of old timey mecha anime that attracted many of us to the anime multiverse, in the first place. When I watched the OAVs on blu ray, the restoration was fantastic. Very crisp HD.

    > the new Dune was a big disappointment to me.

    Yeah, I read the trilogy before watching it. I'm so glad I did, because I knew exactly what was going on. Otherwise, I might've been lost.

    Yeah, they tried too hard to follow the narrative of the book. I think the only way to do it, and still end up with a good movie, is to focus on a particular story arc. If they'd nailed it, that would've set the stage for more to follow.

    I'd imagine they shot so much footage that it could conceivably be re-edited. I know they didn't shoot beyond the movie's ending, because I saw an interview with Zendaya, where she said she was only on location for the desert scenes for a couple days.
    Reply
  • mode_13h - Friday, March 18, 2022 - link

    I mean the original Patlabor OAVs. There are about 7 of them, I think. Near movie-quality animation, for the time.

    BTW, some aspects of the Ghost in the Shell franchise definitely make more sense, as we move towards the future it predicted.

    Oh, and Planetes is a nice series about a crew working to collect orbital debris. It aired about 2 decades ago, but I think it was based on manga that was older, still. Some aspects of it were a bit anachronistic even for the time, but other aspects about space physics and orbital living clearly received a lot of thought and attention. The story arc is a lot more interesting than it sounds, with lots of commentary about life, love, the privatization of space, corporate politics, geopolitics, personal ambition, and the ultimate path and personal costs of space exploration. If you don't mind a bit of slapstick and are willing to look past some of the more anachronistic aspects, it's worth a watch.
    Reply
  • GeoffreyA - Saturday, March 19, 2022 - link

    I haven't read the books but hope to do so before going into the coffin. Well, my view is that the excessive realism somehow harms the movie. If you go back to Lynch's 1984 version, despite the outlandish visuals, it is pretty alien, as Dune should be; and from a storytelling point of view, does that pretty well, going forward rapidly. Also, the princess's summary in the beginning got the viewer up to speed with this strange universe.

    The new movie took "show, don't tell" a bit too far, and the story didn't feel cohesive or unified, especially towards the end. It was tedious. The visions seemed forced and overdone. And for an epic, the cinematography was poor in my opinion. A key problem, I feel, is that it didn't bring out the true spirit of the desert. Coupled to this issue is Zimmer's music, in my view, missing the mark. It was too loud and vulgar, and seemed to view the desert from a commercialised, Hollywood lens, rather than feeling its power and reflecting that desolation. Then the CGI, I say no more.

    On the plus side, two sequences were outstanding: when Paul first steps onto the desert and picks up the sand/spice; and Paul and his mother's flight through the dust storm. That was world class.
    Reply
  • GeoffreyA - Saturday, March 19, 2022 - link

    When I saw the Patlabor poster some time ago, I was intrigued. That was part two I believe. Yes, as time goes by, I prefer to look back at older anime. I think it's fair to say the industry has gone downhill these days.

    And thanks for that great description of Planetes. I won't mind giving one or two episodes a go and seeing what it's like. It reminds me that I've still got to watch Cowboy Bepop.
    Reply
  • mode_13h - Sunday, March 20, 2022 - link

    Planetes is one of those series that takes a while to get going. The further you go, the deeper it gets. If you really don't like the first couple episodes, maybe it's not for you. However, you do get rewarded the longer you stick with it. Reply
  • mode_13h - Monday, March 21, 2022 - link

    > I haven't read the books but hope to do so before going into the coffin.

    There's a lot you can read into it about the corrupting tendencies of empires and exploitation of peoples and their natural resources. It feels like it might've tapped into the decolonization zeitgeist, or at least what I presume it should've been, as the former colonial powers of Europe unwound their foreign holdings. I could do without so much of the psychedelic stuff, but I know Heinlein also went there. So, maybe that was just another trend in 1960's sci fi.

    > If you go back to Lynch's 1984 version

    It's funny this came up, because I just started watching it last weekend and finished it mere hours ago. It did seem a bit overwrought. I remember how he seemed rather too fascinated with the perversions and excesses of the Harkkonen. I thought the exposition was a bit too much for the naive movie-goer, but probably a helpful reminder for those who'd read the books years earlier.

    Since I came to it with low expectations, I really wasn't disappointed. Since the movie had many shots in low light, I wonder just how much I benefited from seeing a clean, HD presentation. Overall, I guess my main complaints would be that some of the acting seemed sub-par (Sting, for one, definitely should've stayed focused on the music business) and I just wouldn't have tried to cover so much plot. It felt busy and probably hard for people to follow, without having read it. I wasn't too bothered by the dated special effects, but they do kind of jump out at you. Some of the sets were quite impressive.

    > The new movie took "show, don't tell" a bit too far

    Probably a reaction to Lynch's version. I also wonder if his 1990 TV series, Twin Peaks, was also sort of a reaction to the criticism he got for too much exposition in Dune.

    Anyway, the last I'll say about it is that I'm finding the Wikipedia page on Dune to be a good resource on the author and his influences.
    Reply
  • GeoffreyA - Monday, March 21, 2022 - link

    The visuals prevented me from watching it for a long time. It was only after I became a fan of David Lynch that I was able to see past that and appreciate what he had done. I think for a two-hour adaptation of such a vast novel, it is a commendable attempt, and I prefer it. As for the excesses, etc., well, that's Lynch as always. He always tends to bring out the darker side of things.

    I actually love Twin Peaks, and the recent season 3 was spectacular, if strange. But strange is this man's domain. Did too much exposition have an effect on his later work? I would say that Dune was an exception. Generally, his films are pretty obscure, nothing much being spelled out, and one often has to piece together a puzzle. He started off with that note in Eraserhead and hasn't really changed in four decades.
    Reply
  • GeoffreyA - Monday, March 21, 2022 - link

    "Sting, for one, definitely should've stayed focused on the music business"

    The best line!
    Reply
  • mode_13h - Tuesday, March 22, 2022 - link

    > I actually love Twin Peaks

    I never really watched it. My older sister watched the original TV airing. All I remember of it was the general strangeness and a recollection that even its conclusion left much unanswered.

    I haven't seen much of Lynch's work, but I did enjoy Mulholland Dr. All I remember from it is that I decided it's a fool's errand to make complete sense of the plot, since there were paradoxes inserted seemingly with the intent to break any strict interpretation.

    > Did too much exposition have an effect on his later work?

    That's not really what I meant. I was suggesting he got too much negative feedback on all the exposition in Dune, and therefore went too far in the other direction of being too obscure.

    From what I've heard, Kubrick would sometimes indulge in excessive obscurity to create a false sense of depth. The prime example being 2001: A Space Odyssey. If you actually read the book, you can supposedly see what kind of shenanigans he got up to, which I've heard he even admitted in an interview.

    > He started off with that note in Eraserhead and hasn't really changed in four decades.

    Ah, right. I never got round to watching that one.
    Reply
  • GeoffreyA - Wednesday, March 23, 2022 - link

    Mulholland Drive is perhaps my favourite film of all films. Again, it's the tragic note that speaks to me, and Naomi Watts, brilliant. I've racked my head over this story a great deal, and my tentative answer is that even the latter part, Diane's tale, is a dream, various pieces of evidence pointing there, particularly the blue box and the smoke. The question is, whose dream is *that*! Perhaps it's the director's dream after all.

    I haven't read 2001, but you're right, the film keeps things pretty bare and mysterious, and that creates the feeling of a deep, even terrible, mystery. Our age could actually learn something from that and stop filling in all the details. The human mind does a far better job at piecing together the monster in the shadows.
    Reply

Log in

Don't have an account? Sign up now