GTX 550 Ti’s Quirk: 1GB Of VRAM On A 192-bit Bus

One thing that has always set NVIDIA apart from AMD is their willingness to use non-power of 2 memory bus sizes. AMD always sticks to 256/128/64 bit busses, while NVIDA has used those along with interesting combinations such as 384, 320, and 192 bit busses. This can allow NVIDIA to tap more memory bandwidth by having a wider bus, however they also usually run their memory slower than AMD’s memory on comparable products, so NVIDIA’s memory bandwidth advantage isn’t quite as pronounced. The more immediate ramifications of this however are that NVIDIA ends up with equally odd memory sizes: 1536MB, 1280MB, and 768MB.

768MB in particular can be problematic. When the GTX 460 launched, NVIDIA went with two flavors: 1GB and 768MB, the difference being how many memory controller/ROP blocks were enabled, which in turn changed how much RAM was connected. 768MB just isn’t very big these days – it’s only as big as NVIDIA’s top of the line card back at the end of 2006. At high resolutions with anti-aliasing and high quality textures it’s easy to swamp a card, making 1GB the preferred size for practically everything from $250 down. So when NVIDIA has a 768MB card and AMD has a 1GB card, NVIDIA has a definite marketing problem and a potential performance problem.

Video Card Bus Width Comparison
NVIDIA Bus Width   AMD Bus Width
GTX 570 320-bit   Radeon HD 6970 256-bit
GTX 560 Ti 256-bit   Radeon HD 6950 256-bit
GTX 460 768MB 192-bit   Radeon HD 6850 256-bit
GTX 550 Ti 192-bit   Radeon HD 5770 128-bit
GTS 450 128-bit   Radeon HD 5750 128-bit

NVIDIA’s solution is to normally outfit cards with more RAM to make up for the wider bus, which is why we’ve seen 1536MB and 1280MB cards going against 1GB AMD cards. With cheaper cards though the extra memory (or higher density memory) is an extra cost that cuts in to margins. So what do you do when you have an oddly sized 192-bit memory bus on a midrange card? For GTS 450 NVIDIA disabled a memory controller to bring it down to 128-bit, however for GTX 550 Ti they needed to do something different if they wanted to have a 192-bit bus while avoiding having only 768MB of memory or driving up costs by using 1536MB of memory. NVIDIA’s solution was to put 1GB on a 192-bit card anyhow, and this is the GTX 550 Ti’s defining feature from a technical perspective.

Under ideal circumstances when inter leaving memory banks you want the banks to be of equal capacity, this allows you to distribute most memory operations equally among all banks throughout the entire memory space. Video cards with their non-removable memory have done this for ages, however full computers with their replaceable DIMMs have had to work with other layouts. Thus computers have supported additional interleaving options beyond symmetrical interleaving, most notably “flex” interleaving where one bank is larger than the other.

It’s this technique that NVIDIA has adopted for the GTX 550 Ti. GF116 has 3 64-bit memory controllers, each of which is attached to a pair of GDDR5 chips running in 32bit mode.  All told this is a 6 chip configuration, with NVIDIA using 4 1Gb chips and 2 2Gb chips. In the case of our Zotac card – and presumably all GTX 550 Ti cards – the memory is laid out as illustrated above, with the 1Gb devices split among 2 of the memory controllers, while both 2Gb devices are on the 3rd memory controller.

This marks the first time we’ve seen such a memory configuration on a video card, and as such raises a number of questions. Our primary concern at this point in time is performance, as it’s mathematically impossible to organize the memory in such a way that the card always has access to its full theoretical memory bandwidth. The best case scenario is always going to be that the entire 192-bit bus is in use, giving the card 98.5GB/sec of memory bandwidth (192bit * 4104MHz / 8), meanwhile the worst case scenario is that only 1 64-bit memory controller is in use, reducing memory bandwidth to a much more modest 32.8GB/sec.

How NVIDIA spreads out memory accesses will have a great deal of impact on when we hit these scenarios, and at this time they are labeling the internal details of their memory bus a competitive advantage, meaning they’re unwilling to share the details of its operation with us. Thus we’re largely dealing with a black box here, which we’re going to have to poke and prod at to try to determine how NVIDIA is distributing memory operations.

Our base assumption is that NVIDIA is using a memory interleaving mode similar to “flex” modes on desktop computers, which means lower memory addresses are mapped across all 3 memory controllers, while higher addresses are mapped to the remaining RAM capacity on the 3rd memory controller. As such NVIDIA would have the full 98.5GB/sec of memory bandwidth available across the first 768MB, while the last 256MB would be much more painful at 32.8GB/sec. This isn’t the only way to distribute memory operations however, and indeed NVIDIA doesn’t have to use 1 method at a time thanks to the 3 memory controllers, so the truth is likely much more complex.

Given the black box nature of GTX 550’s memory access methods, we decided to poke at things in the most practical manner available: CUDA. GPGPU operation makes it easy to write algorithms that test the memory across the entire address space, which in theory would make it easy to determine GTX 550’s actual memory bandwidth, and if it was consistent across the entire address space. Furthermore we have another very similar NVIDIA card with a 192-bit memory bus on hand – GTX 460 768MB – so it would be easy to compare the two and see how a pure 192-bit card would compare.

We ran in to one roadblock however: apparently no one told the CUDA group that GTX 550 was going to use mixed density memory. As it stands CUDA (and other APIs built upon it such as OpenCL and DirectCompute) can only see 768MB minus whatever memory is already in use. While this lends support to our theory that NVIDIA is using flex mode interleaving, this makes it nearly impossible to test the theory at this time as graphics operations aren’t nearly as flexible enough (and much more prone to caching) to test this.

CUDA-Z: CUDA Available Memory. Clockwise, Top-Left: GTS 450, GTX 460  768MB, GTX 550 Ti

At this point NVIDIA tells us it’s a bug and that it should be fixed by the end of the month, however until such a time we’re left with our share of doubts. Although this doesn’t lead to any kind of faulty operation, this is a pretty big bug to slip through NVIDIA’s QA process, which makes it all the more surprising.

In the meantime we did do some testing against the more limited memory capacity of the GTX 550. At this point the results are inconclusive at best. Using NVIDIA’s Bandwidth Test CUDA sample program, which is a simple test to measure memcopy bandwidth of the GPU, we tested the GTS 450, GTX 468 768MB, GTX 460 1GB, and GTX 550 Ti at both stock and normalized (GTX 460) clocks. The results were inconclusive – the test seems to scale with core clocks far more than memory bandwidth – which may be another bug, or an artifact of the program having originally been written pre-Fermi. In any case here is the data, but we have low confidence in it.

As it stands the test shows almost no gain over the GTS 450 at normalized clocks; this doesn’t make a great deal of sense under any memory interleaving scheme, hence the low confidence. If and when all the bugs that may be causing this are fixed, we’ll definitely be revisiting the issue to try to better pin down how NVIDIA is doing memory interleaving.

Index Meet The Zotac GeForce GTX 550 Ti AMP Edition


View All Comments

  • dmans - Tuesday, March 15, 2011 - link

    my 8800 gt is better than this thing. Reply
  • mapesdhs - Tuesday, March 15, 2011 - link

    Google for, "Ian PC tests", it's the 1st link that comes back. Scroll down the page
    for the full list of results pages (I've done a whlole bunch). Voila, a mountain of
    8800GT data for you to chew on. 8-) And much more to add!

  • HangFire - Wednesday, March 16, 2011 - link

    "lan PC tests". Hmm. I get a link for a WiFi antenna.

    And, can you please stop spamming the comments?
  • mapesdhs - Wednesday, March 16, 2011 - link

    I'm not spamming the comments, I'm providing real info to help people
    out. Re the Google, it could be because being in the UK I'm forced
    to use which may give different results to
    (probably does). Alas, nothing I can do about that (hmm, "try, "Ian SGI
    UK" instead, that should bring up the right link). If you want to know
    what I'm talking about though, send me a PM and I'll send you the refs
    so you can see what I mean. People keep asking upgrade questions
    which review articles do not or cannot answer, eg. those playing
    older games, at lesser resolutions, with systems that don't have uber
    CPUs, etc.. I've been working to provide the info that answers such
    questions (have you?). That isn't spamming.

  • HangFire - Wednesday, March 16, 2011 - link

    >my 8800 gt is better than this thing.

    That would make it faster than the GTX260 as well. That's some 8800GT!

    I love the value that my 8800GT provided, but it is sitting on the shelf now for a reason.
  • sheh - Tuesday, March 15, 2011 - link

    I'm not one to comment on this sort of things in general but I must in this case. Each instance of "in to" in the graphics hardware articles comes with a mental dissonance I have to resolve before reading can be resumed.

    Other than that, keep up the good work. :)
  • gammaray - Tuesday, March 15, 2011 - link

    I don't understand the logic behind the pricing of video cards nowadays.

    Low end video cards like this new 550ti should be below 100$
    mid range video cards 150ish and
    high end 200-250$ MAXIMUM
  • mapesdhs - Tuesday, March 15, 2011 - link

    An item is only ever worth what someone is willing to pay.

    There are those with big budgets who are happy to pay $600+, hence products
    to match such affordability exist and always will do.

    If you had something to sell, would you let someone buy it for $200 if you had
    a different customer who was happy to pay you $400? ;)

    Such is the law of supply & demand. I deal with this every day with respect to
    buying/selling used SGI items. Hobbyists assume old items should be cheap
    because they're old and they don't want to pay much, but in reality commercial
    demand for certain items extremely strong, so the real value is sometimes very
    high. Same basic concept applies to anything really. A brand of chocolate
    cookies my gf & I particularly like have gone up in price recently by quite a lot,
    and I'm sure it's because they are popular. Demand rise = price rise.

    In some parts of the world, the market for high-end consumers GPUs is quite strong.

  • Will Robinson - Wednesday, March 16, 2011 - link

    What a shame to soil the good reputation of past and present Ti cards on this dud. Reply
  • Belard - Wednesday, March 16, 2011 - link

    "TI" is meaningless. Might as well mean "Total Idiot".

    If they took out the "TI", it would still be the same product. Its all marketing to get people to remember about the old $200 kick-ass 4200~4600 cards... before the GF 5800 debacle.

    TI originally was about its manufacturing (so they say), but look back. There were no 4200 and 4200 TI, right? They divide the GF2-tech cards into 4x0MX and the state of the art into 4x00TI.

    We'll soon see the return of MX, PRO and Ultras I think... hell, maybe even the "Geforce GTX ti 785 Ultra TNT" in 2012.

Log in

Don't have an account? Sign up now