In 2014/2015, it took NVIDIA 6 months from the launch of the Maxwell 2 architecture to get GTX Titan X out the door. All things considered, that was a fast turnaround for a new architecture. However now that we’re the Pascal generation, it turns out NVIDIA is in the mood to set a speed record, and in more ways than one.

Announced this evening by Jen-Hsun Huang at an engagement at Stanford University is the NVIDIA Titan X, NVIDIA’s new flagship video card. Based on the company’s new GP102 GPU, it’s launching in less than two weeks, on August 2nd.

NVIDIA GPU Specification Comparison
  NVIDIA Titan X GTX 1080 GTX Titan X GTX Titan
CUDA Cores 3584 2560 3072 2688
Texture Units 224? 160 192 224
ROPs 96? 64 96 48
Core Clock 1417MHz 1607MHz 1000MHz 837MHz
Boost Clock 1531MHz 1733MHz 1075MHz 876MHz
TFLOPs (FMA) 11 TFLOPs 9 TFLOPs 6.6 TFLOPs 4.7 TFLOPs
Memory Clock 10Gbps GDDR5X 10Gbps GDDR5X 7Gbps GDDR5 6Gbps GDDR5
Memory Bus Width 384-bit 256-bit 384-bit 384-bit
VRAM 12GB 8GB 12GB 6GB
FP64 1/32 1/32 1/32 1/3
FP16 (Native) 1/64 1/64 N/A N/A
INT8 4:1 ? ? ?
TDP 250W 180W 250W 250W
GPU GP102 GP104 GM200 GK110
Transistor Count 12B 7.2B 8B 7.1B
Die Size 471mm2 314mm2 601mm2 551mm2
Manufacturing Process TSMC 16nm TSMC 16nm TSMC 28nm TSMC 28nm
Launch Date 08/02/2016 05/27/2016 03/17/2015 02/21/2013
Launch Price $1200 MSRP: $599
Founders $699
$999 $999

Let’s dive right into the numbers, shall we? The NVIDIA Titan X will be shipping with 3584 CUDA cores. Assuming that NVIDIA retains their GP104-style consumer architecture here – and there’s every reason to expect they will – then we’re looking at 28 SMs, or 40% more than GP104 and the GTX 1080.

It’s interesting to note here that 3584 CUDA cores happens to be the exact same number of CUDA cores also found in the Tesla P100 accelerator. These products are based on very different GPUs, but I bring this up because Tesla P100 did not use a fully enabled GP100 GPU; its GPU features 3840 CUDA cores in total. NVIDIA is not confirming the total number of CUDA cores in GP102 at this time, but if it’s meant to be a lightweight version of GP100, then this may not be a fully enabled card. This would also maintain the 3:2:1 ratio between GP102/104/106, as we saw with GM200/204/206.

On the clockspeed front, Titan X will be clocked at 1417MHz base and 1531MHz boost. This puts the total FP32 throughput at 11 TFLOPs (well, 10.97…), 24% higher than GTX 1080. In terms of expected performance, NVIDIA isn’t offering any comparisons to GTX 1080 at this time, but relative to the Maxwell 2 based GTX Titan X, they are talking about an up to 60% performance boost.

Feeding the beast that is GP102 is a 384-bit GDDR5X memory bus. NVIDIA will be running Titan X’s GDDR5X at the same 10Gbps as on GTX 1080, so we’re looking at a straight-up 50% increase in memory bus size and resulting memory bandwidth, bringing Titan X to 480GB/sec.

At this point in time there are a few unknowns about other specifications of the card. ROP count and texture unit count have not been disclosed (and this is something NVIDIA rarely posts on their site anyhow), but based on GP104 and GP106, I believe it’s safe to assume that we’re looking at 224 texture units and 96 ROPs respectively. To put this into numbers then, theoretical performance versus a GTX 1080 would be 24% more shading/texturing/geometry/compute performance, 50% more memory bandwidth, and 33% more ROP throughput. Or relative GTX Titan X (Maxwell 2), 56% more shading/texturing/geometry/compute performance, 43% more memory bandwidth, and 42% more ROP throughput. Of course, none of this takes into account any of Pascal’s architectural advantages such as a new delta color compression system.

Meanwhile like the past Titans, the new Titan X is a 250W card, putting it 70W (39%) above GTX 1080. In pictures released by NVIDIA and confirmed by their spec sheet, this will be powered by the typical 8-pin + 6-pin power connector setup. And speaking of pictures, the handful of pictures released so far confirm that the card will be following NVIDIA’s previous reference design, in the new GTX 1000 series triangular style. This means we’re looking at a blower based card – now clad in black for Titan X – using a vapor chamber setup like the GTX 1080 and past Titan cards.

The TDP difference between Titan X and GTX 1080 may also explain some of rationale behind the performance estimates above. In the Maxwel 2 generation, GTX Titan X (250W) consumed 85W more than GTX 980 (165W); but for the Pascal generation, NVIDIA only gets another 70W. As power is the ultimate factor limiting performance, it stands to reason that NVIDIA can't increase performance over GTX 1080 (in the form of CUDA cores and clockspeeds) by as much as they could over GTX 980. There is always the option to go above 250W - Tesla P100 in mezzanine form goes to 300 W - but for a PCIe form factor, 250W seems to be the sweet spot for NVIDIA.

Moving on, display I/O is listed as DisplayPort 1.4, HDMI 2.0b, and DL-DVI; NVIDIA doesn’t list the number of ports (and they aren’t visible in product photos), but I’d expect that it’s 3x DP, 1x HDMI, and 1x DL-DVI, just as with the past Titan X and GTX 1080.

From a marketing standpoint, it goes without saying that NVIDIA is pitching the Titan X as their new flagship card. What is interesting however is that it’s not being classified as a GeForce card, rather it’s the amorphous “NVIDIA Titan X”, being neither Quadro, Tesla, nor GeForce. Since the first card’s introduction in 2013, the GTX Titan series has always walked a fine line as a prosumer card, balanced between a relatively cheap compute card for workstations, and an uber gaming card for gaming PCs.

That NVIDIA has removed this card from the GeForce family would seem to further cement its place as a prosumer card. On the compute front the company is separately advertising the card's 44 TOPs INT8 compute performance - INT8 being frequently used for neural network inference - which is something they haven't done before for GeForce or Titan cards. Though make no mistake: the company’s GeForce division is marketing the card and it’s listed on GeForce.com, so it is still very much a gaming card as well.

As for pricing and availability, NVIDIA’s flagships have always been expensive, and NVIDIA Titan X even more so. The card will retail for $1200, $200 more than the previous GTX Titan X (Maxwell 2), and $500 more than the NVIDIA-built GTX 1080 Founders Edition. Given the overall higher prices for the GTX 1000 series, this isn’t something that surprises me, but none the less it means buying NVIDIA’s best card just got a bit more expensive. Meanwhile for distribution, making a departure from previous generations, the card is only being sold directly by NVIDIA through their website. The company’s board partners will not be distributing it, though system builders will still be able to include it.

Overall the announcement of this new Titan card, its specifications, and its timing raises a lot of questions. Does GP102 have fast FP64/FP16 hardware, or is it purely a larger GP104, finally formalizing the long-anticipated divide between HPC and consumer GPUs? Just how much smaller is GP102 versus GP100? How has NVIDIA been able to contract their launch window by so much for the Pascal generation, launching 3 GPUs in the span of 3 months? These are all good questions I hope we’ll get an answer to, and with an August 2nd launch it looks like we won’t be waiting too long.

Update 07/25: NVIDIA has given us a few answers to the question above. We have confirmation that the FP64 and FP16 rates are identical to GP104, which is to say very slow, and primarily there for compatibility/debug purposes. With the exception of INT8 support, this is a bigger GP104 throughout.

Meanwhile we have a die size for GP102: 471mm2, which is 139mm2 smaller than GP100. Given that both (presumably) have the same number of FP32 cores, the die space savings and implications are significant. This is as best of an example as we're ever going to get on the die space cost of the HPC features limited to GP100: NVLInk, fast FP64/FP16 support, larger register files, etc. By splitting HPC and graphics/inference into two GPUs, NVIDIA can produce GP102 at what should be a significantly lower price (and higher yield), something they couldn't do until the market for compute products based on GP100 was self-sustaining.

Finally, NVIDIA has clarified the branding a bit. Despite GeForce.com labeling it "the world’s ultimate graphics card," NVIDIA this morning has stated that the primary market is FP32 and INT8 compute, not gaming. Though gaming is certainly possible - and I fully expect they'll be happy to sell you $1200 gaming cards - the tables have essentially been flipped from the past Titan cards, where they were treated as gaming first and compute second. This of course opens the door to a proper GeForce branded GP102 card later on, possibly with neutered INT8 support to enforce the market segmentation.

POST A COMMENT

228 Comments

View All Comments

  • nevcairiel - Monday, July 25, 2016 - link

    Not to mention that there is a bunch of genres of games that just don't work well on consoles.

    They may release FPS games for consoles, but the entire genre just is no fun on a controller, especially competitive play.
    Not to mention complex strategy games, like Civilization.
    Reply
  • Eidigean - Friday, July 22, 2016 - link

    Your thought is that "gaming" hardware should be cheap. That's what Xbox and Playstation is for.

    This is a super computer. 11 teraflops is not easy to achieve, let alone in a 2-slot card. This kind of computing power cost millions of dollars just a few years ago. Spot complaining that $1,200 is expensive.

    The computer you want will always cost about $3,000. This has held true for 30 years.
    Reply
  • K_Space - Friday, July 22, 2016 - link

    .....except most of the comments completely ignore the fact that this isn't neccesserily a gaming card? As if dropping the GTX tag wasn't enough of a clue. Most of these will probably end up in render farms with a tiny niche going to top end gaming PCs. Reply
  • Gothmoth - Friday, July 22, 2016 - link

    tell us what you really think.
    you should have stayed in school and get a job that makes you not think twice about paying a 1200$ card.

    i have no problems to pay 1200$ for the fatest card i can get.
    the best is always more expensive.
    Reply
  • Black Obsidian - Friday, July 22, 2016 - link

    There's a difference between not being able to afford a $1200 card and being annoyed at the market failure that leads to the card being priced that way to begin with.

    I wouldn't think twice about buying a $1200 video card, but that's not what the Titan X is; it's an $800 video card that requires you to put another $400 in a pile and light it on fire. And yeah, that's going to piss people off.
    Reply
  • Gothmoth - Friday, July 22, 2016 - link

    800$ ..... how do you get to that number?

    i have to pay 1700$ dollar for a 10 core intel.... and 500$ for a 6 core that´s how it is.

    i paid much more for my car but i could have bought a VW golf to get from A to B.

    but these whining from people who can´t afford something is getting on my nerves.
    Reply
  • Eidigean - Friday, July 22, 2016 - link

    Exactly. Folks don't understand that larger chips have higher chances of defects. The yields are lower. There are reasons, like you said, for why 66% more cores costs 240% more dollars. Reply
  • SlyNine - Tuesday, July 26, 2016 - link

    Yes, lack of competition plays no role here. It's all just innocent ol Nvidia and Intel just can't make em better. Reply
  • Flunk - Friday, July 22, 2016 - link

    Nvidia only builds these huge top-end designs so they can sell a $1000+ Titan card. If they need to compete, then they release a cost-reduced version, but the intent was never to release this a a lower price point. Reply
  • Yojimbo - Friday, July 22, 2016 - link

    What you have to understand is that this card has uses beyond gaming. NVIDIA needs to be careful not to incentivize the deep learning community to spend their time and money trying to figure out ways to do their learning tasks with these far cheaper cards rather than spend money on the more expensive Tesla cards. The $1200 price tag is meant to give more reason for people to buy their $5000 Tesla cards with more memory instead of trying to cobble together something more exotic with the 12 GB Titan. Reply

Log in

Don't have an account? Sign up now