Cayman: The New Dawn of AMD GPU Computing

We’ve already covered how the shift from VLIW5 to VLIW4 is beneficial for AMD’s computing efforts: narrower SPUs are easier to fully utilize, FP64 performance improves to 1/4th FP32 performance, and the space savings give AMD room to lay down additional SIMDs to improve performance. But if Cayman is meant to be a serious effort by AMD to relaunch themselves in to the GPU computing market and to grab a piece of NVIDIA’s pie, it takes more than just new shaders to accomplish the task. Accordingly, AMD has been hard at work to round out the capabilities of their latest GPU to make it a threat for NVIDIA’s Fermi architecture.

AMD’s headline compute feature is called asynchronous dispatch, a long word that actually does a pretty good job of describing what it does. To touch back on Fermi for a moment, with Fermi NVIDIA introduced support for parallel kernels, giving Fermi the ability to execute multiple kernels at once. AMD in turn is following NVIDIA’s approach of executing multiple kernels at once, but is going to take it one step further.

The limit of NVIDIA’s design is that while Fermi can execute multiple kernels at once, each one must come from the same CPU thread. Independent threads/applications for example cannot issue their own kernels and have them execute in parallel, rather the GPU must context switch between them. With asynchronous dispatch AMD is going to allow independent threads/applications to issue kernels that execute in parallel. On paper at least, this would give AMD’s hardware a significant advantage in this scenario (context switching is expensive), one that would likely eclipse any overall performance advantages NVIDIA had.

Fundamentally asynchronous dispatch is achieved by having the GPU hide some information about its real state from applications and kernels, in essence leading to virtualization of GPU resources. As far as each kernel is concerned it’s running in its own GPU, with its own command queue and own virtual address space. This places more work on the GPU and drivers to manage this shared execution, but the payoff is that it’s better than context switching.

For the time being the catch for asynchronous dispatch is that it requires API support. As DirectCompute is a fixed standard this just isn’t happening – at least not with DirectCompute 11. Asynchronous dispatch will be exposed under OpenCL in the form of an extension.

Meanwhile the rest of AMD’s improvements are focusing on memory and cache performance. While the fundamental architecture is not changing, there are several minor changes here to improve compute performance. The Local Data Store attached to each SIMD is now able to bypass the cache hierarchy and Global Data Store by having memory fetches read directly in to the LDS. Meanwhile Cayman is getting a 2nd DMA engine, improving memory reads & writes by allowing Cayman to execute two at once in each direction.

Finally, read ops from shaders are being sped up a bit. Compared to Cypress, Cayman can coalesce them in to fewer operations.

As today’s launch is primarily about the Radeon HD 6900 series AMD isn’t going too much in depth on the compute side of things, so everything here is a fairly high level overview of the architecture. Once AMD has Firestream cards ready to go with Cayman in them, there will likely be more to talk about.

VLIW4: Finding the Balance Between TLP, ILP, and Everything Else Advancing Primitives: Dual Graphics Engines & New ROPs


View All Comments

  • DoktorSleepless - Wednesday, December 15, 2010 - link

    Is it just me or are all the graphs missing? Reply
  • Ryan Smith - Wednesday, December 15, 2010 - link

    They're not missing. They're fashionably late.

    In all seriousness though, they're going up now. We had less than a week to cover all of this, so it's very much down to the wire here.
  • DoktorSleepless - Wednesday, December 15, 2010 - link

    They're still missing in some of the non-benchmark pages including the "Enhanced Quality AA". Reply
  • AnnihilatorX - Thursday, December 16, 2010 - link

    They are all here.
    You should clean your browser cache.
  • AstroGuardian - Wednesday, December 15, 2010 - link

    It's you. The graphs are drawn in infrared. Your fault you can't see them :) Reply
  • mmatis - Wednesday, December 15, 2010 - link

    They all look fine to me. Surely you aren't trying to use an NVidia card to read a favorable article about AMD? Reply
  • Stuka87 - Wednesday, December 15, 2010 - link

    Err, did you even read the article?! Reply
  • opticalmace - Wednesday, December 15, 2010 - link

    also missing the conclusion right now. :) Reply
  • tipoo - Wednesday, December 15, 2010 - link

    In their defense, you can't have read the whole article that fast :-P Reply
  • HOOfan 1 - Wednesday, December 15, 2010 - link

    Doesn't look to me like the HD6970 is worth $70 more than the HD6950 at this time.

    Hopefully for AMD/ATI's sake, drivers updates will catapult it ahead.

Log in

Don't have an account? Sign up now