In Q4 2015, JEDEC (a major semiconductor engineering trade organization that sets standards for dynamic random access memory, or DRAM) finalized the GDDR5X specification, with accompianing white papers. This is the memory specification which is expected to be used for next-generation graphics cards and other devices. The new technology is designed to improve bandwidth available to high-performance graphics processing units without fundamentally changing the memory architecture of graphics cards or memory technology itself, similar to other generations of GDDR, although these new specifications are arguably pushing the phyiscal limits of the technology and hardware in its current form.

The GDDR5X SGRAM (synchronous graphics random access memory) standard is based on the GDDR5 technology introduced in 2007 and first used in 2008. The GDDR5X standard brings three key improvements to the well-established GDDR5: it increases data-rates by up to a factor of two, it improves energy efficiency of high-end memory, and it defines new capacities of memory chips to enable denser memory configurations of add-in graphics boards or other devices. What is very important for developers of chips and makers of graphics cards is that the GDDR5X should not require drastic changes to designs of graphics cards, and the general feature-set of GDDR5 remains unchanged (and hence why it is not being called GDDR6).

Performance Improvements

Nowadays highly binned GDDR5 memory chips can operate at 7 Gbps to 8 Gbps data rates. While it is possible to increase performance of the GDDR5 interface for command, address and data in general, according to Micron Technology, one of the key designers of GDDR5X, there are limitations when it comes to array speed and command/address protocols. In a bid to improve performance of the GDDR5 memory, engineers had to change internal architecture of memory chips significantly.

The key improvement of the GDDR5X standard compared to the predecessor is its all-new 16n prefetch architecture, which enables up to 512 bit (64 Bytes) per array read or write access. By contrast, the GDDR5 technology features 8n prefetch architecture and can read or write up to 256 bit (32 Bytes) of data per cycle. Doubled prefetch and increased data transfer rates are expected to double effective memory bandwidth of GDDR5X sub-systems. However, actual performance of graphics cards will depend not just on DRAM architecture and frequencies, but also on memory controllers and applications. Therefore, we will need to test actual hardware to find out actual real-world benefits of the new memory.

Just like the predecessor, GDDR5X functions with two different clock types - a differential command clock (CK) to where address and command inputs are referenced, as well as a forwarded differential write clock (WCK) where read and write data are referenced to. WCK runs at a frequency that is two times higher than the CK. The data can be transmitted at double data rate (DDR) or quad data rate (QDR) relative to the differential write clock (WCK), depending whether 8n prefetch or 16n prefetch architecture and protocols are used. Accordingly, if makers of chips manage to increase CK clock to 1.5 GHz, then data rate in QDR/16n mode will rise to 12 Gbps.

Since the GDDR5X protocol and interface training sequence are similar to those of the GDDR5, it should be relatively easy for developers of chips to adjust their memory controllers to the new type of memory. However, since the QDR mode (which is called Ultra High Speed mode in Micron’s materials) mandates usage of PLLs/DLLs (Phase Locked Loops, Delay Locked Loops), there will be certain design changes to design of high-end memory chips.

JEDEC’s GDDR5X SGRAM announcement discusses data rates from 10 to 14 Gbps, but Micron believes that eventually they could be increased to 16 Gbps. It is hard to say whether commercial chips will actually hit such data rates, keeping in mind that there are new types of memory incoming. However, even a 256-bit GDDR5X memory sub-systems running at 14 Gbps could provide up to 448 GBps of memory bandwidth, just 12.5% lower compared to that of AMD’s Radeon R9 Fury X (which uses first-gen HBM).

GPU Memory Math
  AMD Radeon
R9-290X
NVIDIA GeForce
GTX 980 Ti
NVIDIA GeForce
GTX 960
AMD Radeon
R9 Fury X
Samsung's 4-Stack HBM2 based on 8 Gb DRAM Theoretical GDDR5X 256-bit
sub-system
Theoretical GDDR5X 128-bit
sub-system
Total Capacity 4 GB 6 GB 2 GB 4 GB 16 GB 8 GB 4 GB
B/W Per Pin 5 Gb/s 7 Gb/s 7 Gb/s 1 Gb/s 2 Gb/s 14 Gb/s 14 Gb/s
Chip capacity 2 Gb 4 Gb 4 Gb 1 GB 4 GB 1 GB
(8 Gb)
1 GB
(8 Gb)
No. Chips/Stacks 16 12 4 4 4 8 4
B/W Per Chip/Stack 20
GB/s
28
GB/s
28
GB/s
128
GB/s
256
GB/s
56
GB/s
56
GB/s
Bus Width 512-bit 384-bit 128-bit 4096-bit 4096-bit 256-bit 128-bit
Total B/W 320
GB/s
336
GB/s
112
GB/s
512
GB/s
1
TB/s
448
GB/s
224
GB/s
Estimated DRAM
Power Consumption
30 W 31.5 W 10 W 14.6 W n/a 20 W 10 W

Capacity Improvements

Performance was not the only thing that developers of the GDDR5X had to address. Many applications require not only high-performance memory, but a lot of high-performance memory. Increased capacities of GDDR5X chips will enable their adoption by broader sets of devices in addition to graphics/compute cards, game consoles and network equipment as well as other areas. Initially one would expect the high density configurations to be slightly conservative on frequency to begin with.

The GDDR5 standard covered memory chips with 512 Mb, 1 Gb, 2 Gb, 4 Gb and 8 Gb capacities. The GDDR5X standard defines devices with 4 Gb, 6 Gb, 8 Gb, 12 Gb and 16 Gb capacities. Typically, mainstream DRAM industry tends to double capacities of memory chips because of economic and technological reasons. However, with GDDR5X the industry decided to ratify SGRAM configurations with rather unusual capacities — 6Gb and 12Gb.

The mobile industry already uses LPDDR devices with 3 Gb, 6 Gb and 12 Gb capacities in a bid to maximize flexibility of memory configurations for portable electronics. As it appears, companies developing standards for graphics DRAM also wanted to capitalize on flexibility. A GDDR5X chip with 16 Gb capacity made using 20 nm or 16/18 nm process technology would have a rather large die size and thus high cost. However, the size and cost of a 12 Gb DRAM IC should be considerably lower and such a chip could arguably address broader market segments purely on cost.

Just like in case of the GDDR5, the GDDR5X standard fully supports clamshell mode, which allows two 32-bit memory chips to be driven by one 32-bit memory controller by sharing address and command bus while reducing the number of DRAM IC’s I/Os to 16. Such operation has no impact on system bandwidth, but allows doubling the amount of memory components per channel. For example, it should be theoretically possible to build a graphics card with 64 GB of GDDR5X using one GPU with a 512-bit memory bus as well as 32 16 Gb GDDR5X memory chips.

Unusual capacities will help GDDR5X to better address all market segments, including graphics cards, HPC (high performance computing), game consoles, network equipment and so on. However, it should be noted that the GDDR5X has extremely potent rival, the second-gen HBM, which offers a number of advantages, especially in the high-end segment of the graphics and HPC markets.

Energy Efficiency

Power consumption and heat dissipation are two major limiting factors of compute performance nowadays. When developing the GDDR5X standard, the industry implemented a number of ways to keep power consumption of the new graphics DRAM in check.

Supply voltage and I/O voltages of the GDDR5X were decreased from 1.5V on today’s high-end GDDR5 memory devices to 1.35V. Reduction of Vdd and Vddq should help to cut power consumption of the new memory by up to 10%, which is important for high-performance and mobile devices where the memory can take a sizable chunk of the available power budget.

The reduction of supply and I/O voltages is not the only measure to cut power consumption of the new memory. The GDDR5X standard makes temperature sensor controlled refresh rate a compulsory feature of the technology, something that could help to optimize power consumption in certain scenarios. Moreover, there are a number of other features and commands, such as per-bank self refresh, hibernate self refresh, partial array self refresh and other, that were designed to shrink the energy consumption of the new SGRAM.

Due to lower voltages and a set of new features, power consumption of a GDDR5X chip should be lower compared to that of a GDDR5 chip at the same clock-rates. However, if we talk about target data rates of the GDDR5X, then power consumption of the new memory should be similar or slightly higher than that of GDDR5, according to Micron. The company says that GDDR5X’s power consumption is 2-2.5W per DRAM component and 10-30W per board. Even with similar/slightly higher power consumption compared to the GDDR5, the GDDR5X is being listed as considerably more energy efficient due to its improved theoretical performance.

We do not know specifications of next-generation graphics adapters (for desktops and laptops) from AMD and NVIDIA, but if developers of GPUs and DRAMs can actually hit 14 Gb/s data-rates with GDDR5X memory, they will double the bandwidth available to graphics processors vs GDDR5 without significantly increasing power consumption. Eventually, more efficient data-rates and unusual capacities of the GDDR5X could help to actually decrease power consumption of certain memory sub-systems.

Implementation

While internally a GDDR5X chip is different from a GDDR5 one, the transition of the industry to GDDR5X is a less radical step than the upcoming transition to the HBM (high-bandwidth memory) DRAM. Moreover, even the transition from the GDDR3/GDDR4 to the GDDR5 years ago was considerably harder than transition to the GDDR5X is going to be in the coming years.

The GDDR5X-compliant memory chips will come in 190-ball grid array packaging (as compared to 170-ball packaging used for current GDDR5), thus, they will not be pin-to-pin compatible with existing GDDR5 ICs or PCBs for modern graphics cards. But while the GDDR5X will require development of new PCBs and upgrades to memory controllers, everything else works exactly like in case of the GDDR5: the interface signal training features and sequences are the same, error detection is similar, protocols have a lot of resemblances, even existing GDDR5 low and high speed modes are supported to enable mainstream and low-power applications. BGA packages are inexpensive, and they do not need silicon interposers nor use die-stacking techniques which HBM requires.

Implementation of GDDR5X should not be too expensive both from R&D and production perspectives; at least, this is something that Micron implied several months ago when it revealed the first details about the technology.

Industry Support

The GDDR5X is a JEDEC standard supported by its members. The JEDEC’s document covering the technology contains vendor IDs for three major DRAM manufacturers: Micron, Samsung and SK Hynix. Identification of the memory producers are needed for controllers to to differentiate between various vendors and different devices, and listing the memory makers demonstrates that they participated in development, considered features and balloted on them at JEDEC’s meetings, which may indicate their interest in supporting the technology. Unfortunately, exact plans for each of the companies regarding GDDR5X production are unknown, though we would expect GDDR5X parts to fit between the current GDDR5 high end and anything implementing HBM, or for implementing higher memory capacity on lower end GPUs. Micron plans to start mass production of its GDDR5X memory chips in mid-2016, so we might see actual GDDR5X-based memory sub-systems in less than six months from now.

NVIDIA, currently the world’s largest supplier of discrete graphics processors, said that that as a member of JEDEC it participates in the development of industry standards like GDDR5X. AMD is also a member of JEDEC and it usually plays a key role in development of memory standards. Both of these companies also employ compression algorithms to allieviate the stress on texture transfers between the GPU and memory, and thus an increase in bandwidth (as shown by Fiji) plus an increase in density can see benefits in texture rich or memory bound compute scenarios.

While specific plans of various companies regarding the GDDR5X are unclear, the technology has a great potential if the numbers are accurate (it has to be, it's a standard) and has all chances to be adopted by the industry. The main rival of the GDDR5X, second-generation HBM, can offer higher bandwidth, lower power consumption and smaller form-factors, but at the cost of design and manufacturing complexities. In fact, what remains to be seen is whether the HBM and the GDDR5X will actually compete directly against each other or will just become two complementary types of memory. Different applications nowadays have different requirements, and an HBM memory sub-system with 1 TBps of bandwidth makes a perfect sense for a high-end graphics adapter. However mainstream video cards should work perfectly with GDDR5X, and chances are we will see both in play at different market focal points.

Source: JEDEC

POST A COMMENT

69 Comments

View All Comments

  • jragonsoul - Friday, January 22, 2016 - link

    Wow... impressive and damn near 1st gen HBM performance. I wonder how 2nd gen HBM will do compared... Reply
  • Stuka87 - Friday, January 22, 2016 - link

    It has HBM2 in one of the charts. Its listed as 1TB/sec. Reply
  • phoenix_rizzen - Friday, January 22, 2016 - link

    And there's even an article about HBM2 on this very site, posted just yesterday. ;) Reply
  • ToTTenTranz - Friday, January 22, 2016 - link

    HBM rev.2 doubles the bandwidth, quadruples the memory density and is in volume production right now.

    GDDR5X will only start production in half a year.
    Reply
  • Samus - Saturday, January 23, 2016 - link

    HBM requires entirely new memory controllers, generally graphics chips need to be built from the ground up to support it, and considering its cost and capacity restrictions per block (even HBM2) I suspect GDDR5X will be the industry standard for the next few years.

    Keeping in mind the reasons we've been using GDDR5 for the last decade: GPU's haven't been bandwidth starved. Because the industry has been stuck on 28nm for the last 6 years, GPU's haven't actually pushed memory technology. Now that 20nm is a reality for next-gen GPU's, that's going to change, but not dramatically. With GDDR5X, HBM just isn't needed....yet. But it will be. It's a superior memory architecture to DDR, but so was RAMBUS. It just wasn't necessary for the applications they were pushing it into.
    Reply
  • Yojimbo - Sunday, January 24, 2016 - link

    GDDR5 has been used for 7 1/2 years, not 10. 28nm graphics cards came out 4 years ago, not 6. Why do you exaggerate instead of using the real numbers?

    GPUs haven't been bandwidth starved because 1) GDDR5 bandwidths have increased somewhat since launch, though not much for a while, through wider buses and faster clocks and 2) compression technology has gotten better. They knew memory bandwidth would be a problem and I'm guessing settled on putting the work and money into compression specifically to solve that problem. The DRAM nodes have seen a slowdown in shrinkage along with the processor nodes, I believe. They are just entering 20nm GDDR5 now. It's reasonable to believe that in a world where the processor nodes had been shrunk faster, DRAM nodes also would have been able to, and would have been made to in order to keep up. AMD's Fury/Nano seems like they would have been bandwidth starved, or at least used a whole lot of power for its memory subsystem, without HBM1 even though it was still on a 28nm process because their color compression is not as good as Maxwell's.

    I don't think HBM2 faces a capacity restriction compared to GDDR5. GDDR5 can probably still keep up with the graphics bandwidth requirements of the upcoming 14nm/16nm GPUs if pushed, but while consuming much more power. I'm guessing the biggest use for HBM2 in the beginning will probably be for compute where the bandwidth is more important. Another use will be where power consumption is at a premium. It all has to do with what people are willing to pay for, as Huang said.
    Reply
  • Samus - Sunday, January 24, 2016 - link

    Calm the fuck down, maybe you shouldn't read between the lines. The point of my post, which is correct, is with the introduction of GDDR5X, HBM is currently not needed, costs too much, and essentially needs more than a memory controller built around it (such as next-gen GPU architectures.

    As I said, it will be a few years before HBM becomes mainstream. I'll meet you back here in a few years...
    Reply
  • Yojimbo - Sunday, January 24, 2016 - link

    "Calm the fuck down, maybe you shouldn't read between the lines."

    How was I not calm? You're not calm. Read between what lines? You said lots of things that were inaccurate. Not sure why you're meeting me back here in a few years. I never said HBM will or won't "become mainstream" whatever that means,
    Reply
  • 0razor1 - Monday, January 25, 2016 - link

    Both ya'all.
    The bandwidth is not needed if you consider pumping more lanes as a 'cheap' solution. a 512 bit card (290) can be rivalled by a 970 (256). However, I think we all know how memory starved the 970/
    980 is despite the delta color compression. 8GHz when you overclock the card, is what cripples it.
    I see a card like the 960 benefiting from such tech at even a 128 Bit bus. If you argue otherwise, please, buy stuff, experiment, BIOS edit and remove power limits, and you'll be better informed.

    Source? I've owned the 280x (7970), 290x, 960, 970.
    Reply
  • BurntMyBacon - Monday, January 25, 2016 - link

    @Samus: "Calm the fuck down, ..."

    Can't say as Yojimbo sounds particularly irate here. There are some good counter-points that aren't mutually exclusive to your own points. At the end of the day, I think you both agree that HBM won't initially be used on mainstream cards, though perhaps you dispute its usefulness in premium products.

    @Yojimbo: "I'm guessing the biggest use for HBM2 in the beginning will probably be for compute where the bandwidth is more important. Another use will be where power consumption is at a premium."
    Reply

Log in

Don't have an account? Sign up now