Efficiency Gets Another Boon: Parallel Kernel Support

In GPU programming, a kernel is the function or small program running across the GPU hardware. Kernels are parallel in nature and perform the same task(s) on a very large dataset.

Typically, companies like NVIDIA don't disclose their hardware limitations until a developer bumps into one of them. In GT200/G80, the entire chip could only be working on one kernel at a time.

When dealing with graphics this isn't usually a problem. There are millions of pixels to render. The problem is wider than the machine. But as you start to do more general purpose computing, not all kernels are going to be wide enough to fill the entire machine. If a single kernel couldn't fill every SM with threads/instructions, then those SMs just went idle. That's bad.


GT200 (left) vs. Fermi (right)

Fermi, once again, fixes this. Fermi's global dispatch logic can now issue multiple kernels in parallel to the entire system. At more than twice the size of GT200, the likelihood of idle SMs went up tremendously. NVIDIA needs to be able to dispatch multiple kernels in parallel to keep Fermi fed.

Application switch time (moving between GPU and CUDA mode) is also much faster on Fermi. NVIDIA says the transition is now 10x faster than GT200, and fast enough to be performed multiple times within a single frame. This is very important for implementing more elaborate GPU accelerated physics (or PhysX, great ;)…).

The connections to the outside world have also been improved. Fermi now supports parallel transfers to/from the CPU. Previously CPU->GPU and GPU->CPU transfers had to happen serially.

A More Efficient Architecture ECC, Unified 64-bit Addressing and New ISA
Comments Locked

415 Comments

View All Comments

  • sandwiches - Thursday, October 1, 2009 - link

    Just created an account to say that I've never seen this kind of sycophantic, schizophrenic blathering as Silicondoc. I have been an Nvidia user for the past 7 years or so (simply out of habit) and before that a Voodoo user and I cannot even begin to relate to this buffoon.

    Oh and to incense him even more, I'd like to add that I bought a HD5870 from newegg a couple nights ago since I needed to upgrade my old 8800 GTS card, NOW... not in a few months or next year. Now. Seeing as how the HD 5870 is the fastest for my buck, I went with that. Forget treating brands like religions. Get whatever's good and you can afford and forget brands. The end.
  • SiliconDoc - Friday, October 2, 2009 - link

    LOL - another lifelong nobody who hasdn't a clue and was a green goblin by habit self reported, made another account, and came in just to "incense" "the debater".
    Really, you couldn't have done a better job of calling yourself a piece of trash.
    Congratulations for that.
    You admitted your goal was trolling and fanning the flames.
    LOL
    That was your goal, and so bright you are, that "sandwiches" came to mind as your name, a complimentary imitation, indicating you hoped to be equal to "Silicon" and decided to take a "tech part" styled name, or, perhaps as likely, it was haphazard chance cause buckey was hungry when he got here, and that's all he could think of.
    I think you're another pile of stupid with the C and below crowd, basically.
    So, that sort of explains your purchase, doesn't it ?
    LOL
    Yes, you can't possibly relate, you need more MHZ a lot bigger powr supply "sandwiches".
    LOL
    sandwiches!
  • CptTripps - Friday, October 2, 2009 - link

    Reading your comments makes me think you are about 12 and in need of serious evaluation. I have never seen someone so out of control on Anand for 30+ pages. Seriously, get your brain checked out, there is some sort of imbalance going on when everyone in the whole world is a liar except you, the only beacon of truth.
  • sandwiches - Friday, October 2, 2009 - link

    LMAO

    This has to be an online persona for you, Brian. Are you seriously like this in real life?
  • Voo - Thursday, October 1, 2009 - link

    We really need a "ignore this idiot" button :/


    Anyways, is there any reason why this has to be a "one size fits them all" chip? I mean according to the article there's a lot of stuff in it, which only a minority of gamers would ever need (ECC memory? That's more expensive than normal memory and usually has a performance impact).

    I mean there's already a workstation chip, why not a third one for GPU computing?
  • neomocos - Thursday, October 1, 2009 - link

    You know when someone says you are drunk/stupid/drugged/crazy/etc... then you might question him but when 2 or 3 people say it then it`s most than probably true but when all the people at anand say it then SiliconDoc should just stfu, go right now and buy an ati 5870 and smash it on the ground and maby he will feel better and let us be.

    I vote for ban also :) and i donate 10$ for the 5870 we anand users will give him as a present for christmas.Happy new red year Silicon...
  • andrihb - Thursday, October 1, 2009 - link

    I'm excited about this but I wish it was ready sooner. It looks like we'll have to wait 2-3 months for benchmarks, right?

    I hope it'll blow 5870 away because that's what is best for us, the consumers. We'll have an even faster GPU available to us which is all that really matters.

    I've noticed that a person here has been criticizing this article for belittling the fact that nVidia's upcoming GPU is likely going to have a vastly suerior memory bandwidth to ATI's current flagship. Anand gave us the very limited data that exists at the moment and left most of the speculation to us. He doesn't emphasize that Fermi (which won't even be available for months) has far more bandwidth than ATI's current flagship. I contend that most people already suspected as much.
    The vastly superior memmory bandwidth suggests that nVidia might just have a 5870 killer up it's sleeve. See what I just did there? This is called engaging in speculation. Anand could have done more of that, I agree, but saying that this is proof of Anand's supposed bias towards ATI? That is totally unreasonable.

    Hey, Doc, do you want to see a real life, batshit crazy, foaming at the mouth fanboy? All you need is a mirror.
  • JonnyDough - Thursday, October 1, 2009 - link

    "Jonah did step in to clarify. He believes that AMD's strategy simply boils down to targeting a different price point. He believes that the correct answer isn't to target a lower price point first, but rather build big chips efficiently. And build them so that you can scale to different sizes/configurations without having to redo a bunch of stuff. Putting on his marketing hat for a bit, Jonah said that NVIDIA is actively making investments in that direction. Perhaps Fermi will be different and it'll scale down to $199 and $299 price points with little effort? It seems doubtful, but we'll find out next year."

    FOOL!

    So nVidia is going to make this for Tesla. That's great that they're innovating but you mentioned that those sales are only a small percentage. AMD went from competing strongly in the CPU market to dominating the GPU market. Good move. But if there's no existing market for the GPGPU...do you really want to be switching gears and trying to create one? Hmm. Crazy!
  • SiliconDoc - Thursday, October 1, 2009 - link

    Admin: You've overstayed your welcome, goodbye.
    I'm not sure where you got your red rooster lies information. AMD/ati has NO DOMINATION in the GPU market.
    ---
    One moment please to blow away your fantasy...
    ---
    http://jonpeddie.com/press-releases/details/amd-so...">http://jonpeddie.com/press-releases/det...ntel-and...
    ---
    Just in case you're ready to scream I cooked up a pure grteen biased link, check back a few pages and you'll see the liar who claimed ati is now profitable and holding up AMD because of it provided the REAL empty rhetoric fanboy link http://arstechnica.com/hardware/news/2009/07/intel...">http://arstechnica.com/hardware/news/20...-graphic...
    which states
    " The actual numbers that JPR gives are worth looking at,
    which show INTEL dominates the GPU market !
    Wow, what a surprise for you. I've just expanded your world, to something called "honest".
    So:
    INTEL 50.30%
    NVIDIA 28.74%
    AMD 18.13%
    others below 1% each.
    ------------
    Gee, now you know who dominates, and for our discussions here, who is IN LAST PLACE! AND THAT WOULD BE ATI THE LAST PLACE LOSER!
    --
    Now, I wouldn't mind something like ati is competitive, but that DOMINATES thing says it's #1, and ati is :

    ************* ATI IS IN LAST PLACE ! LAST PLACE! **************

    Now please whine about the 3 listed at the link less than 1% each, so you can "pump up ati" by claiming "it's not last, which of course I would welcome, since it's much better than lying and claiming it's number one.
    ---
    I suspect all you crying ban babies are ready to claim to have found absolutely zero information or contributioon in this post.
  • tamalero - Thursday, October 1, 2009 - link

    huge difference between INTEGRATED GRAPHIC SEGMENT, wich is almost every laptop there and a lot of business computers.
    versus the DISCRETE MARKET, wich is the GAMING section... where AMD-ATI and NVIDIA are 100%.
    get your facts and see a doctor, your delusional attitude is getting annoying.

Log in

Don't have an account? Sign up now