Conclusion: The War of Attrition

(These numbers have been updated with the later 0x34 microcode)

Intel’s desktop product teams have had their hands in a bind for a while. The goal was always to migrate from 14nm to 10nm when the intersection of performance, cost, and power hit the sweet spot. This was originally expected to happen after 2017, with the launch after Kaby Lake, but we are here in 2021 and this still hasn’t happened. Intel’s 10nm manufacturing process is unable to scale to the right level of frequency, power, and cost that is needed for an effective desktop processor.

Now Intel is full of smart people – alongside the manufacturing team, the internal microarchitecture teams building the next generation cores would have already been 3-5 years ahead in their design cycle, waiting to deploy the best ideas when the manufacturing was ready. However, with a plug in the pipeline and no way to easily patch it, Intel had to decide what to do in a worst case scenario – what if 10nm is never ready?

The first part of that answer is in our hands today. Despite not being designed for 14nm, Intel took its 10nm Sunny Cove core design (and Xe integrated graphics), and rebuilt it from the ground up. This sounds arduous – all the solutions to get things working in 10nm need to be rethought, and new issues with timing and signal integrity have to be solved. It wasn’t designed for 14nm, and to signify its difference, it was called Cypress Cove. These engineers are no doubt frustrated that they had core designs on the table, ready to go on 10nm, but they had to re-draw them in a different style where they are bigger and more power hungry, just to get something out of the door. That different style is Rocket Lake, and specifically the Core i7-11700K we have tested today.

Improvements for Desktop, Sort Of

Rocket Lake brings to the table a big core design with new features such as AVX-512 and PCIe 4.0. The core is so big that in order to keep die size, yield, and costs similar to the previous generation, the final design only has eight cores rather than ten. This would appear to be a 20% regression in absolute performance, however Intel is promoting a +19% average performance gain, evening it all out, while also providing the new features listed above. That +19% also should apply to single thread situations, enabling faster single user response time.

To validate Intel’s claims here, we run our industry standard benchmarks, such as SPEC, and compare the i7-10700K to the i7-11700K. Though this testing, we can confirm that Intel is correct on that +19% claim, however that isn’t an overall performance uplift and there’s a big asterisk next to that number.

All workloads at their core, even when browsing the web or word processing, can be split into integer (whole numbers, most workloads) and floating point (numbers with decimal places, workloads with math). In our testing, we saw the following:

  • Single thread floating point: +22%
  • Multi-thread floating point: +16.2%

Sounds great, right?

  • Single thread integer: +18.5%
  • Multi-thread integer: +5.8%

Oh. While Intel’s claim of +19% is technically correct, it only seems to apply to math-heavy workloads or single thread integer workloads. The benefits of non math-based throughput are still better than average, but only at 5.8% for multithreaded. Very rarely do Intel’s big claims come with an easily identifiable asterisk.

When we look at our real-world data, in almost every benchmark the 11700K either matches or beats the 10700K, and showcases the IPC gain in tests like Dolphin, Blender, POV-Ray, Agisoft, Handbrake, web tests, and obviously SPECfp. It scores a big win in our 3DPM AVX test, because it has AVX-512 and none of the other CPUs do.

A Comment on Gaming

Users looking at our gaming results will undoubtedly be disappointed. The improvements Intel has made to its processor seem to do very little in our gaming tests, and in a lot of cases, we see performance regressions rather than improvements. If Intel is promoting +19% IPC, then why is gaming not seeing similar jumps? 

Normally with gaming we might look to the structural latency comparison to see where some uplifts might come. 

The biggest change in the cache hierarchy is in the L3 cache, which is now ~45-46 cycles rather than 42-43 cycles. When we originally tested this with the 0x2C microcode it was 51 cycles, but Intel has implemented updates to reduce this to around 45-46 cycles, which improves gaming performance a little. This is still a slight regression, and we’re seeing the core-to-core latency (regardless of microcode) still show 28-30 nanosecond latencies on most cores, rather than 18-24 as observed on Comet Lake. We expected some regressions from Ice Lake/Sunny Cove with the backported core – 51 cycles for the L3 was considered a lot, but reducing that to 45-46 cycles is still a slight regression, but more in line with what we expected. Overall, there is an effective latency decrease from having larger caches, but this hasn't translated into gaming performance along with the increase in IPC.

But Margins, Power, and Temperature

Moving into this review, users that have followed Intel’s desktop platform know that sustained power modes on the high-core count models are a lot higher than the number on the box suggests. This isn’t just limited to the overclockable processors, like in our i9-10850K review where we saw 260 W, but even the i7-10700 rated at 65 W would push 200 W, especially in motherboards that ignored recommended turbo limits (which is practically every consumer gaming motherboard).

The migration of Sunny Cove cores, already known for being power hungry, onto an older process node, and then bundling AVX-512 in the mix, has had a number of enthusiasts concerned for how Intel would approach power consumption. Based on our testing today, the simple answer is to offer a blessing to the deity of your choice for a good CPU. Our Core i7-11700K is rated at 125 W. But in practice for a mild AVX2 workload we saw 225 W of power consumption and a temperature of 81ºC, while a general workload was around 130-155 W at 60ºC.

(0-0) Peak Power

The danger is that during our testing, the power peaked at an eye-catching 292 W on one of our tests systems. This was during an all-core AVX-512 workload, automatically set at 4.6 GHz, and the CPU hit 104ºC momentarily. A second motherboard, running new firmware, only peaked at 276 W, running at 4.4-4.6 GHz, but still saw 103ºC before reducing in power to 225 W.

For the first motherboard on the 0x2C microcode, there’s no indication that the frequency reduced when hitting this temperature, and our cooler is easily sufficient for the thermal load, which means that on some level we might be hitting the thermal density limits of wide mathematics processing on Intel’s 14nm. In order to keep temperatures down, new cooling methods have to be used, regardless of motherboard or microcode.

I noted that Intel has reduced the air gap inside the CPU package, with the whole z-height reduced from 4.48 mm to 4.36 mm. It’s a small change, meaning less material for thermal energy to transfer through, improving cooling.

Users looking to overclock on these processors are going to have to implement a strong AVX-512 offset here.

A Rock(et) and A Hard Place, But The Only Option Available

Rocket Lake is the product of an idea to backport a design, and ensures that the popular market segment of consumer processors is closer to the leading edge of Intel’s design, despite the unavailability of Intel’s latest process node to desktop-class hardware.

Going forward, Intel has (in not so many words) committed to a less rigid philosophy than the past – use the right design on the right process node, rather than tying the two together. Rocket Lake is arguably the first product coming from that philosophy, despite being a later part that came after core was designed in the first place. But Intel will measure its success as an initial yard stick to similar endeavors in the future. And it will succeed, for reasons external to Intel.

Our results clearly show that Intel’s performance, while substantial, still trails its main competitor, AMD. In a core-for-core comparison, Intel is slightly slower and a lot more inefficient. The smart money would be to get the AMD processor. However, due to high demand and prioritizing commercial and enterprise contracts, the only parts readily available on retail shelves right now are from Intel. Any user looking to buy or build a PC today has to dodge, duck, dip, dive and dodge their way to find one for sale, and also hope that it is not at a vastly inflated price. The less stressful solution would be to buy Intel, and use Intel’s latest platform in Rocket Lake.

Normally this is the point where I’d conclude with a comment on what to recommend. But the clear answer during this chip crunch is to buy the processor you can find at a reasonable price. We don’t have official pricing on Rocket Lake just yet, but if a retailer was happy to sell units before the official launch, then perhaps there will be sufficient number out there to go around.

Official details of Rocket Lake will be posted when our NDA on that information expires. Official retail of Rocket Lake will commence on March 30th.

Gaming Tests: Strange Brigade
Comments Locked

541 Comments

View All Comments

  • brucethemoose - Monday, March 8, 2021 - link

    1: AT benches on Windows, and right now x86 vs ARM is kinda Apples-to-oranges on that platform, especially when one starts mixing in emulation and AVX.

    Give it time. More comparisons will come. But you'll probably see comparisons on Linux/Mac, and open source software in general, sooner.

    2: People uses CPUs for different things. Some of these benches are relevant to those people.

    At the same time, my use cases weren't really covered here, so... I get what you're saying.

    3. Yeah, it seems rather silly to me, especially when Anand test GPU limited AAA games.

    Where you really need a big CPU is in simulation/sandbox games, especially in servers for such things, and sluggish early access stuff. But no one ever benches those :/
  • Silver5urfer - Monday, March 8, 2021 - link

    So with the 19% IPC claim and losing to 9900KS and 10700K what is the point of releasing this chip, from Intel. I never got much from AT benches a lot and preferred the Hardware unboxed, Gamernexus guys and others. But if this is the final performance figures, then this is really a DOA product from Intel. How can they allow this ? I never saw Intel in such a position..maybe X299 got rekted when Zen 2 dropped but this is mainstream segment.

    Damn it. AMD processors have the idiotic stock related issues, add that WHEA and USB shitstorm. Intel has bullshit performance over past gen except a Gen4 addition and extra lanes from chipset. GPUs are out of damn stock as well.

    2020 and 2021 both are completely fucked up for PC HW purchases.
  • Gigaplex - Monday, March 8, 2021 - link

    "I never saw Intel in such a position.."

    The Pentium 4, in particular the Prescott architecture was a dud back in the early 2000's. That era spawned the antitrust lawsuit against Intel for illegally blocking AMD sales since the Intel products weren't competitive.
  • dwbogardus - Monday, March 8, 2021 - link

    The fact that Intel can even remain in a close second place, using a 14 nm process is impressive. Imagine what they could do with TSMC's 7 nm process! It would almost certainly outperform AMD by a significant margin.
  • Bagheera - Monday, March 8, 2021 - link

    Really tired of Intel fanboys saying this.

    architectures are designed for specific nodes - RKL's problems are exactly due to porting an arch onto a node it wasn't designed for.

    the fact is Intel is not a partner for TSMC and their archs are not designed for TSMC processes. if Intel were to outsource CPU production to TSMC, they will either have to make a new arch or make make tweaks to existing ones - a multi-million $ endeavor with risms of issues like your just read with RKL.
  • Hifihedgehog - Tuesday, March 9, 2021 - link

    > a close second place

    ^Here we see in his natural environment your common everyday dude who fails at reading comprehension. I guess you didn't read the part about the serious gaming performance losses and latency regressions gen-over-gen, the 10% performance gap in single-threaded or 10-20%+ performance gaps in multithread, or the inexcusably high peak power draw? Talk about deluded...
  • RanFodar - Monday, March 8, 2021 - link

    Though their efforts may be futile, I am glad Intel attempted to do something out of the ordinary; not a Skylake refresh, but a backport that is found to have worse performance. And yet, it is an attempt for Intel to learn their lessons for generations to come.
  • Hifihedgehog - Tuesday, March 9, 2021 - link

    Backporting is not a lesson; it is a last ditch effort or a fallback when all else fails on the manufacturing side. Half full, half empty cup viewing aside, they wasted even more valuable engineering manhours into a failed backport when it should have been invested into developing new architectures. A best use would have been developing the next release. The problem is Intel had to make Rocket Lake good enough in synthetic benchmarks to appease their investors. That, however, still does not address the elephants in the room of 10-20% single threaded performance gaps or—the one that takes the cake—the latency regressions that makes gaming worse, Intel’s historic crown jewel. Much like movies that fail at release and live on box office bombs that their producers later opine should have been cut early on in development, Intel should have cut this idea early on. If you are looking for a lesson that Intel should have learned here, there it is: avoid another Rocket Lake backporting disaster and just warm over your current microarchitecture with one more middling refresh one last time.
  • Hifihedgehog - Tuesday, March 9, 2021 - link

    Ian, I just want to say thank you for the incredible review. Just ignore the haters on social media and in the comments who get their panties in a bunch. If the product is garbage, say it like it is, like you did and quite well I might add. You were incredibly diplomatic about it and even openly and honestly showed when and where Intel did win on the rare occasion in the benchmarks. It is so silly how people make these CPU companies (who don't know them from Sam Hill) their religion, as if erecting a Gordon Moore or Lisa Su shrine would avail them anything. Silly geese.
  • misiu_mp - Wednesday, March 10, 2021 - link

    Is that the new bulldozer?

Log in

Don't have an account? Sign up now