Discrete GPU Testing

We’ll kick things off with our discrete GPUs, which should present us with a best case scenario for DirectX 12 from a hardware standpoint. With the most powerful CPUs powering the most powerful GPUs, the ability to generate a massive number of draw calls and to have them consumed in equally large number, this is where DirectX 12 will be at its best.

We’ll start with a look a CPU scaling on our discrete GPUs. How much benefit do we see going from 2 to 4 and finally 6 CPU cores?

3DMark API Overhead D3D12 CPU Scaling

The answer on the CPU side is quite a lot. Whereas Star Swarm generally topped out at 4 cores – after which it was often GPU limited – we see gains all the way up to 6 cores on our most powerful cards. This is a simple but important reminder of the fact that the AOFT is a synthetic test designed specifically to push draw calls and avoid all other bottlenecks as much as possible, leading to increased CPU scalability.

With that said, it’s clear that we’re reaching the limits of our GPUs with 6 cores. While the gains from 2 to 4 cores are rather significant, increasing from 4 to 6 (and with a slight bump in clockspeed) is much more muted, even with our most powerful cards. Meanwhile anything slower than a Radeon R9 285X is showing no real scaling from 4 to 6 cores, indicating a rough cutoff right now of how powerful a card needs to be to take advantage of more than 4 cores.

Moving on, let’s take a look at the actual API performance scaling characteristics at 6, 4, and 2 cores.

3DMark API Overhead GPU Scaling - 6 Cores

6 cores of course is a best case scenario for DirectX 12 – it’s the least likely to be CPU-bound – and we see first-hand the incredible increase in draw call throughput by switching from DirectX 11 to DirectX 12 or Mantle.

Somewhat unexpectedly, the greatest gains and the highest absolute performnace are achieved by AMD’s Radeon R9 290X. As we saw in Star Swarm and continue to see here, AMD’s DirectX 11 throughput is relatively poor, topping out at 1.1 draw calls for both DX11ST and DX11MT. AMD simply isn’t able to push much more than that many calls through their drivers, and without real support for DX11 multi-threading (e.g. DX11 Dirver Command Lists), they gain nothing from the DX11MT test.

But on the opposite side of the coin, this means they have the most to gain from DirectX 12. The R9 290X sees a 16.8x increase in draw call throughput switching from DX11 to DX12. At 18.5 million draw calls per second this is the highest draw call rate out of any of our cards, and we have good reason to suspect that we’re GPU command processor limited at this point. Which is to say that our CPU could push yet more draw calls if only a GPU existed that could consumer that many calls. On a side note, 18.5M calls would break down to just over 300K calls per frame at 60fps, which is a similarly insane number compared to today’s standards where draw calls per frame in most games is rarely over 10K.

Meanwhile we see a reduction in gains going from the 290X to the 285 and finally to the 7970. As we mentioned earlier we appear to be command processor limited, and each one of these progressively weaker GPUs appears to contain a similarly weaker command processor. Still, even the “lowly” 7970 can push 11.6M draw calls per second, which is a 10.5x (order of magnitude) increase in draw call performance over DirectX 11.

Mantle on the other hand presents an interesting aside. As AMD’s in-house API (and forerunner to Vulkan), the AMD cards do even better on Mantle than they do DirectX 12. At this point the difference is somewhat academic – what are you going to do with 20.3M draw calls over 18.5M – but it goes to show that Mantle can still squeeze out a bit more at times. It will be interesting to see whether this holds as Windows 10 and the drivers are finalized, and even longer term whether these benefits are retained by Vulkan.

As for the NVIDIA cards, NVIDIA sees neither quite the awesome relative performance gains from DirectX 12 nor enough absolute performance to top the charts, but here too we see the benefits of DirectX 12 in full force. At 1.9M draw calls per second in DX11ST and 2.2M draw calls per second in DX11MT, NVIDIA starts out in a much better position than AMD does; in the latter they essentially can double AMD’s DX11MT throughput (or alternatively have half the API overhead).

Once DX12 comes into play though, NVIDIA’s throughput rockets through the roof as well. The GTX 980 sees an 8.2x increase over DX11ST, and a 7x increase over DX11MT. On an absolute basis the GTX 980 is consuming 15.5M draw calls per second (or about 250K per frame at 60fps), showing that even the best DX11 implementation can’t hold a candle to this early DirectX 12 implementation. The benefits of DirectX 12 really are that great for draw call performance.

Like AMD, NVIDIA seems to be command processor limited here. GPU-Z reports 100% GPU usage in the DX12 test, indicating that by NVIDIA’s internal metrics the card is working as hard as it can. Meanwhile though not charted, I also tested a GTX Titan X here, which achieved virtually the exact same results as the GTX 980. In lieu of more evidence to support being CPU bound, I have to assume that the GM200 GPU uses a similar command processor as the GM204 based GTX 980, leading to a similar bottleneck. Which would make some sense, as the GM200 is by all practical measurements a supersized version of GM204.

Moving down the NVIDIA lineup, we see performance decrease as we work towards the GTX 680 and GTX 750 Ti. The latter is a newer product, based on the GM107 GPU, but ultimately it is a smaller and lower performing GPU than the GTX 680. Regardless, we are hitting the lower command processor throughput limits of these cards, and seeing the maximum DX12 throughput decrease accordingly. This means that the relative gains are smaller – DX11 performance is virtually the same as GTX 980 since the CPU is the limit there – but even GTX 750 Ti sees a 3.8x increase in throughput over DX11ST.

Finally, it’s here where we’re seeing a distinct case of the DX11 test producing variable results. For the NVIDIA cards we have seen our results fluctuate between 1.4M and 1.9M. Of all of our runs 1.9M is more common – not to mention it’s close to the score we get on NVIDIA’s public WDDM 1.3 drivers – so it’s what we’re publishing here. However for whatever reason, 1.4M will become more common with fewer cores even though the bottleneck was (and remains) single-core performance.

3DMark API Overhead GPU Scaling - 4 Cores

As for performance scaling with 4 cores, it’s very similar to what we saw with 6 cores. As we noted in our CPU-centric look at our data, only the fastest cards benefit from 6 cores, so the performance we see with 4 cores is quite similar to what we saw before. AMD of course still sees the greatest gains, while overall the gap between AMD and NVIDIA is compressed some.

Interestingly Mantle’s performance advantage melts away here. DirectX 12 is now the fastest API for all AMD cards, indicating that DX12 scales out better to 4 cores than Mantle, but perhaps not as well to 6 cores.

3DMark API Overhead GPU Scaling - 2 Cores

Finally with 2 cores many of our configurations are CPU limited. The baseline changes a bit – DX11MT ceases to be effective since 1 core must be reserved for the display driver – and the fastest cards have lost quite a bit of performance here. None the less, the AMD cards can still hit 10M+ draw calls per second with just 2 cores, and the GTX 980/680 are close behind at 9.4M draw calls per second. Which is again a minimum 6.7x increase in draw call throughput versus DirectX 11, showing that even on relatively low performance CPUs the draw call gains from DirectX 12 are substantial.

Overall then, with 6 CPU cores in play AMD appears to have an edge in command processor performance, allowing them to sustain a higher draw call throughput than NVIDIA. That said, as we know the real world performance of the GTX 980 easily surpasses the R9 290X, which is why it’s important to remember that this is a synthetic benchmark. Meanwhile at 2 cores where we become distinctly CPU limited, AMD appears to still have an edge in DirectX 12 throughput, an interesting role reversal from their poorer DirectX 11 performance.

Other Notes & The Test Integrated GPU Testing
POST A COMMENT

113 Comments

View All Comments

  • chizow - Friday, March 27, 2015 - link

    Yeah buddy! Bring on DX12, aka Low Level API Done Right.

    Also fun to note all the rumors and speculation of AMD's poor DX11 MT driver support look to be real (virtually no DX11 ST to MT scaling and both lower than Nvidia DX11), but it is also obvious their efforts with Mantle have given them a nice base for their DX12 driver, at least in synthetic max draw call tests.

    Main benefits for DX12 will be for CPU limited games on fast hardware, especially RTS and MMO type games where the CPU tends to be the bottleneck. It will also be interesting to see what impact it has on higher-end set-ups like high-end multi-GPU. Mantle was supposed to show us the benefits in scaling, but due to piecemeal support and the fact multi-GPU needed much more attention with Mantle, CF was often left in a broken state.
    Reply
  • Barilla - Friday, March 27, 2015 - link

    I really hope dx12 and it's increase in draw call throughput will bring us greater scene complexity, i mean more "real" objects that could be interacted with rather than tricks like textures that make us think there is depth to them while in reality it's just clever artwork. Also objects like leaves, stones, grass etc. I think this would bring much better immersion in the games than just trying to constantly up the polygon count on characters and find new ways to animate hair. Maybe I'm the odd one, but i often focus much more on the game world rather than the characters. Reply
  • MobiusPizza - Friday, March 27, 2015 - link

    I can see how FutureMark can help make the next gen MineCraft title :P Reply
  • tipoo - Friday, March 27, 2015 - link

    Can Intel do any more on the driver side to see more DX12 gains, or is it all GPU front end limited at this point? Reply
  • mczak - Friday, March 27, 2015 - link

    I suspect for the chips listed it's about as good as it will get. Note that these are all Haswell GT2 chips - GT3 doubles up on some fixed function blocks in the frontend, though I don't know if it would help (the command streamer is supposedly the same so if it's limited there it wouldn't help).
    The results could be better with Broadwell, though (be it GT2 or GT3).
    Reply
  • tipoo - Friday, March 27, 2015 - link

    The older article on DX12 showed GT3/3e don't see much more gain past GT2, because while many things are doubled, the front end isn't. Command input limited.

    I haven't heard that Broadwell is different there.
    Reply
  • eanazag - Friday, March 27, 2015 - link

    DX12 is exciting for PC laptop and tablet gaming.

    My desktop can heat the room when gaming and I believe that DX12 and FPS limits could allow me to play cooler next summer. I'd like to see some FPS limiting options if it can reduce heat. During the winter I don't care. I pretty much stop gaming during the summer; at least with the desktop.
    Reply
  • martixy - Friday, March 27, 2015 - link

    I like this. Very much. The industry needs a clean reset and this is a perfect opportunity...
    Now if only the business side was as easy to overhaul as the technical side. :)
    Reply
  • KaarlisK - Friday, March 27, 2015 - link

    I can see the 4770R (GT3e) in the system specifications, but I do not see it in any of the charts. What happened? Reply
  • tipoo - Friday, March 27, 2015 - link

    That one I'd definitely be interested in, would the higher bandwidth it has allow any more DX12 gains? Reply

Log in

Don't have an account? Sign up now