GPU Boost: Turbo For GPUs

Now that we’ve had a chance to take a look at the Kepler architecture, let’s jump into features. We’ll start with the feature that’s going to have the biggest impact on performance: GPU Boost.

Much like we’ve seen with CPUs in previous years, GPUs are reaching a point where performance is being limited by overall power consumption. Until the last couple of years GPU power consumption has been allowed to slowly drift up with each generation, allowing for performance to scale to an incredible degree. However for many of the same reasons NVIDIA has been focusing on efficiency in general, GPUs are being pressured to do more without consuming more.

The problem of course is compounded by the fact that there are a wide range of possible workloads for a GPU, much like there is for a CPU. With the need to design video cards around specific TDPs for both power supply and heat dissipation reasons, the goal becomes one of maximizing your performance inside of your assigned TDP.

The answer to that problem in the CPU space is turbo boosting – that is increasing the clockspeed of one or more CPU cores so long as the chip as a whole remains at or under its TDP. By using turbo, Intel and AMD have been able to both maximize the performance of lightly threaded applications by boosting a handful of cores to high speeds, and at the same time maximize heavily threaded performance by boosting a large number of cores by little to none. For virtually any CPU-bound workload the CPU can put itself into a state where the appropriate execution units are making the most of their TDP allocation.

Of course in the GPU world things aren’t that simple – for starters we don’t have a good analogy for a lightly threaded workload – but the concept is similar. GPUs need to be able to run demanding tasks such as Metro 2033 or even pathological applications like FurMark while staying within their designated TDPs, and at the same time they need to be sure to deliver good performance for compute applications and games that aren’t quite so demanding. Or put another way, tasks that are GPU limited but aren’t maxing out every aspect of the GPU need to be able to get good performance without being held back by the need to keep heavy workloads in check.

In 2010 AMD took a stab that this scenario with PowerTune, which was first introduced on the Radeon HD 6900 series. With PowerTune AMD could set their clockspeeds relatively high, and should any application demand too much of the GPU, PowerTune would throttle down the GPU in order to avoid going over its TDP. In essence with PowerTune the GPU could be clocked too high, and simply throttled down if it tried to draw too much power. This allowed lighter workloads to operate at higher clockspeeds, while keeping power consumption in check for heavy workloads.

With the introduction of Kepler NVIDIA is going to be tackling this problem for their products, and their answer is GPU Boost.

In a nutshell, GPU Boost is turbo for the GPU. With GPU Boost NVIDIA is able to increase the core clock of GTX beyond its 1006MHz base clock, and like turbo on CPUs this is based on the power load, the GPU temperature, and the overall quality of the GPU. Given the right workload the GTX 680 can boost by 100MHz or more, while under a heavy workload the GTX 680 may not move past 1006MHz.

With GPU Boost in play this adds a new wrinkle to performance of course, but ultimately there are 2 numbers to pay attention to. The first number is what NVIDIA calls the base clock: this is another name for the regular core clock, and it represents the minimum full load clock for GTX 680; when operating at its full 3D clocks, the GTX 680 will never drop below this number.

The second number is what NVIDIA calls the boost clock, and this one is far more nebulous, as it relates to the operation of GPU Boost itself. With GPU Boost NVIDIA does not have an explicit top clock; they’re letting chip quality play a significant role in GPU Boost. Because GPU Boost is based around power consumption and temperatures, higher quality GPUs that operate with lower power consumption can boost higher than lower quality GPUs with higher power consumption. In essence the quality of the chip determines its boost limit under normal circumstances.

Accordingly, the boost clock is intended to convey what kind of clockspeeds buyers can expect to see with the average GTX 680. Specifically, the boost clock is based on the average clockspeed of the average GTX 680 that NVIDIA has seen in their labs. This is what NVIDIA had to say about the boost clock in their reviewer’s guide:

The “Boost Clock” is the average clock frequency the GPU will run under load in many typical non-TDP apps that require less GPU power consumption. On average, the typical Boost Clock provided by GPU Boost in GeForce GTX 680 is 1058MHz, an improvement of just over 5%. The Boost Clock is a typical clock level achieved running a typical game in a typical environment

In other words, when the average GTX 680 is boosting it reaches 1058MHz on average.

Ultimately NVIDIA and their customers are going to go through some teething issues on this, and there’s no way around it. Although the idea of variable performance isn’t a new one – we already see this to some degree with CPU turbo – this is the first time we’ve seen something like this in the GPU space, and it’s going to take some time to get used to.

In any case while we can’t relate to you what the average GTX 680 does with GPU Boost, we can tell you about GPU Boost based on what we’ve seen with our review sample.

First and foremost, GPU Boost operates on the concept of steps, analogous to multipliers on a CPU. Our card has 9 steps, each 13MHz apart, ranging from 1006MHz to 1110MHz. And while it’s not clear whether every GTX 680 steps up in 13MHz increments, based on NVIDIA’s boost clock of 1058MHz this would appear to be the case, as that would be 4 steps over the base clock.

At each step our card uses a different voltage, listed in the table below. We should note that we’ve seen different voltages reported for the same step in some cases, so it’s not entirely clear what’s going on. In any case we’re listing the most common voltage we’ve recorded for each step.

GeForce GTX 680 GPU Boost Step Table
Frequency Voltage
1110MHz 1.175v
1097MHz 1.15v
1084MHz 1.137v
1071MHz 1.125v
1058MHz 1.125v
1045MHz 1.112v
1032MHz 1.100v
1019MHz 1.075v
1006MHz 1.062v

As for deciding what clockspeed to step up to, GPU boost determines this based on power consumption and GPU temperature. NVIDIA has on-card sensors to measure power consumption at the rails leading into the GPU, and will only allow the video card to step up so long as it’s below the GPU Boost power target. This target isn’t published, but NVIDIA has told us that it’s 170W. Note that this is not the TDP of the card, which is 195W. Because NVIDIA doesn’t have a true throttling mechanism with Kepler, their TDP is higher than their boost target as heavy workloads can push power consumption well over 170W even at 1006MHz.

Meanwhile GPU temperatures also play an important role in GPU boost. Our sample could only hit the top step (1110MHz) if the GPU temperature was below 70C; as soon as the GPU reached 70C it would be brought down to the next highest step of 1097MHz. This means that the top step is effectively unsustainable on the stock GTX 680, as there are few if any applications that are both intensive enough to require high clockspeeds and light enough to not push GPU temperatures up.

Finally, with the introduction of GPU Boost overclocking has been affected as well. Rather than directly controlling the core clock, overclocking is accomplished through the combined manipulation of the GPU Boost power target and the use of a GPU clock offset. Power target manipulation works almost exactly as you’d expect: you can lower and raise the GPU Boost power target by -30% to +32%, similar to how adjusting the PowerTune limit works on AMD cards. Increasing the power target allows the video card to pull more power, thereby allowing it to boost to higher steps than is normally possible (but no higher than the max step), while decreasing the power target keeps it from boosting at all.

The GPU offset meanwhile manipulates the steps themselves. By adjusting the GPU offset all of the GPU Boost steps are adjusted by roughly an equal amount, depending on what clocks the PLL driving the GPU can generate. E.G. a +100MHz offset clock would increase the 1st step to 1120MHz, etc up to the top step which would be increased to 1210MHz.

While each factor can be adjusted separately, it’s adjusting both factors together that truly unlock overclocking. Adjusting the GPU offset alone won’t achieve much if most workloads are limited by GPU Boost’s power target, and adjusting the power target alone won’t improve the performance of workloads that are already allowed to reach the highest step. By combining the two you can increase the GPU clock and at the same time increase the power target so that workloads are actually allowed to hit those new clocks.

On that note, overclocking utilities will be adding support for GPU Boost over the coming weeks. The first overclocking utility with support for GPU Boost is EVGA’s Precision X, the latest rendition of their Precision overclocking utility. NVIDIA supplied Precision X Beta 20 with our review samples, and as we understand it that will be made available shortly for GTX 680 buyers.

Finally, while we’ll go into full detail on overclocked performance in a bit, we wanted to quickly showcase the impact GPU Boost, both on regular performance and on overclocking. First up, we ran all of our benchmarks at 2560 with the power target for GPU boost set to -16%, which reduces the power target to roughly 142W. While GPU Boost cannot be disabled outright, this was enough to ensure that it almost never activated.

As is to be expected, the impact of GPU Boost varies depending on the game, but overall we found that enabling GPU boost on our card only improves performance by an average of 3%, and by no more than 5%. While this is effectively free performance, it also is a stark reminder that GPU Boost isn’t nearly as potent as turboing on a CPU – at least not quite yet. As there’s no real equivalent to the lightly threaded workload for GPUs, the need for a wide range of potential GPU Boost clocks is not nearly as great as the need for high turbo clocks on a CPU. Even a light GPU workload is relatively heavy when graphics itself is an embarrassingly parallel task.

Our other quick look is at overclocking. The following is what our performance looked like at 2560 with stock GPU Boost settings, a power target of +16% (195W), and a GPU offset of +100MHz.

Overall raising the GPU offset is much more effective than raising the power target to improve performance, reflecting the fact that in our case most games were limited by the GPU Boost clock rather than the power target at least some of the time.

The Kepler Architecture: Efficiency & Scheduling Meet the GeForce GTX 680
POST A COMMENT

405 Comments

View All Comments

  • SlyNine - Friday, March 23, 2012 - link

    lol, you're way of the mark.

    My point wasn't that the 680GTX isn't faster, it's however that it does stand up well against the 680GTX in performance.

    As far as compute goes, I'm not sure I understand your premise. Frankly I think it's an invalid inference. I said kills it. If that somehow implies it means it losses in the other compute tests, I'm not sure how you got there. Again invalid inference of the data.
    Reply
  • Galidou - Friday, March 23, 2012 - link

    You didn't get the point of what he meant. Yes AMD is loosing but mostly in games that already run 60+fps. The games AMD wins is where it's still not maxed out yet(below 60 fps).

    Which maybe means if some big demanding games come out, the winning/loosing shceme might go back and forth. But right now, not much games out there will push those gpus unless you got very high resolutions and right now, I think 90% of gamers have 1080p and lower which still runs super smooth with 95% of graphical options enables on a 150$ GPU...

    Still gotta say that this GTX 680 is really good for a flagship and the first one that's not uber huge and noisy and hot...
    Reply
  • CeriseCogburn - Tuesday, March 27, 2012 - link

    Shogun 2 TOTAL WAR, in this bench set is THE HARDEST GAME, not metro2033 and not crysis warhead.
    Sorry feller but ignoring that gets you guys the big fib you want.
    Sorry.
    Reply
  • CeriseCogburn - Tuesday, March 27, 2012 - link

    SHOGUN 2 680 wins in top rez.
    from article " Total War: Shogun 2 is the latest installment of the long-running Total War series of turn based strategy games, and alongside Civilization V is notable for just how many units it can put on a screen at once. As it also turns out, it’s the single most punishing game in our benchmark suite"

    OH WELL guess it's the metro2033 and crysis game engines cause the hardest game Nvidia 680 wins.
    Reply
  • CeriseCogburn - Tuesday, March 27, 2012 - link

    No you're WRONG. 1. 608 wins 1 bench in Merto2033, and ties within bench error on the other two resolutions.
    The hardest game as stated by the reviewer (since you never read) is Shogun2 total war, and Nvidia makes a clean sweep at all resolutions there.
    In fact the Nvidia card wins everything but Crysis here, ties on Metro, and smokes everything else.
    If Metro isn't a tie, take a look at the tie Ryan has for Civ5 and get back to me... !
    (hint: Nvidia wins by far more in Civ5)
    So--- let's see, one game with wierd benching old benching and AMD favored benchmark (dumping the waterfall bench that Nvidia won on all the time) >(Crysis)
    One "tie" metro2033, then Nvidsia sweeps the rest of them. many by gigantic frame rate victories.
    Other places show Nvidia winning metro2003 by a lot. (pureoverclock for one)
    ....
    No I'm not the one fudging, spinning and worse. You guys are. You lost, lost bad, man up.
    Reply
  • b3nzint - Monday, March 26, 2012 - link

    gt680 got more clocks, way higher memory bandwidth than 7970 thats why it got lower power load and price. but i think we can only compare 2 things if they have the "same" engine like drag race cars. both of them made a big leap from previous tech. and thats a win for us.
    btw, who comes out first ..amd. i say amd win period. so next time maybe they must release next gen gpu on the same time.
    Reply
  • b3nzint - Monday, March 26, 2012 - link

    sorry what i meant was gtx 680 has lower memory, so it gain lower power. Reply
  • CeriseCogburn - Tuesday, March 27, 2012 - link

    Or so a memory overclock unleashes it and it screams even further away at the tops of the charts... Reply
  • dlitem - Thursday, March 22, 2012 - link

    Actual street prices can be different:

    At least here on the eastern shores of Atlantic ocean German retailers are selling 7970's starting 460-470 eur including taxes with cards on stock and GTX680's are starting 499eur with taxes...
    Reply
  • TheRealArdrid - Thursday, March 22, 2012 - link

    Sigh, are people really relying on that weak argument again? It's the same thing people said when Intel starting trouncing AMD: it's not fair because Intel has Turbo Boost. Reply

Log in

Don't have an account? Sign up now