The Future: Competition, Secrecy, & the Unexpected

Finally, while Apple developing their own GPU is not unexpected given their interests and resources, the ramifications of it may very well be. There hasn’t been a new, major GPU vendor in almost a decade – technically Qualcomm’s team would count as the youngest, though it’s a spin-off of what’s now AMD’s Radeon Technologies Group – and in fact like the overall SoC market itself, the market for GPU vendors has been contracting as costs go up and SoC designers settle around fewer, more powerful GPU vendors. So for someone as flush with cash as Apple to join the GPU race is a very big deal; just by virtue of starting development of their own GPU, they are now the richest GPU designer.

Of course, once they start shipping their custom GPU, this will also open them up to patent challenges from those other players. While it has largely been on the backburner of public attention, this decade has seen a few GPU vendors take SoC vendors to court. This includes NVIDIA with Samsung and Qualcomm (a case that they lost), and still ongoing is AMD’s case against LG/MediaTek/Sigma/Vizio.

GPU development is a lot more competitive due to the fact that developers and compiled programs aren’t tied to a specific architecture – the abstraction of the APIs insulates against individual architectures – however it also means that there a lot of companies developing novel technologies, and all of those companies are moving in the same general direction with their designs. This potentially makes it very difficult to develop an efficient GPU, as the best means of achieving that efficiency have often already been patented.

What exists then is an uneasy balance between GPU vendors, and a whole lot of secrets. AMD and NVIDIA keep each other in check with their significant patent holdings, Intel licenses NVIDIA patents, etc. And on the flip side of the coin, some vendors like Qualcomm simply don’t talk about their GPUs, and while this has never been stated by the company, the running assumption has long been that they don’t want to expose themselves to patent suits. So as the new kid on the block, Apple is walking straight into a potential legal quagmire.

Unfortunately, I suspect this means that we’ll be lucky to get any kind of technical details out of Apple on how their GPUs work. They can’t fully hide how their CPUs work due to how program compilation works (which is why we know as much as we do), but the abstraction provided by graphics APIs makes it very easy to hide the inner-workings of a GPU and make it a black box. Even when we know how something works, features and implementation details can be hidden right under our noses.

Ultimately today’s press release is a bit bitter-sweet for all involved in the industry. On the one hand it absolutely puts Imagination, a long-time GPU developer, on the back foot. Which is not to spell doom and gloom, but the company will have to work very hard to make up for losing Apple. On the other hand, with a new competitor in the GPU space – albeit one we’ve been expecting – it’s a sign that things are about to get very interesting. If nothing else, Apple enjoys throwing curveballs, so expect the unexpected.

Imagination: Patents & Losing Apple
Comments Locked

144 Comments

View All Comments

  • Meteor2 - Wednesday, April 5, 2017 - link

    Yep. And ARM ISA chips suitable for HPC are coming this year, notably in the form of the Cavium ThunderX2. I'm expecting big things for that chip. I hope it contains SVE.
  • DezertEagle - Tuesday, April 4, 2017 - link

    I think you're right. Might be a good time to start stockpiling components?

    Already started a couple years ago and my wife thinks I'm a hoarder because I have multiple unopened boxes of CPU/GPU's, Motherboards, SBC's, etc... tucked away in a closet for safe keeping. However, I'm really more concerned about devices turning into the Wireless & WIFI only crap. Perhaps I'm just crazy, but one day tin foil hats will be fashionable!! :)
  • farloo - Tuesday, April 11, 2017 - link

    Looks like the future of Apple is ARM, even for their laptops and PCs. With computing relying less and less on CPUs and more on dedicated processing units, the in-house GPU thing makes sense.
  • farloo - Tuesday, April 11, 2017 - link

    http://www.emobly.com/
  • msroadkill612 - Monday, May 1, 2017 - link

    And shots swallowed at Imagination.
  • Lord-Bryan - Monday, April 3, 2017 - link

    Wow, i knew that Apple was stockpiling gpu engineers, but this was kind of "unexpected"
  • agoyal - Monday, April 3, 2017 - link

    I don't think this is about saving money. With about 300 million iPhones and IPads being sold a year, they are paying 25 cents per device which is nothing for Apple
  • iwod - Monday, April 3, 2017 - link

    Exactly, 65M+ a year is next to nothing for Apple. And when Intel cant get a GPU out without signing agreement with either AMD or Nvidia, I highly doubt Apple could do any different.

    But since Apple pays only ~10M for ARM uArc license + tiny tiny amount per chip sold, my guess is that Apple is trying to lower the Img price tag to something around 20M. Not really sure if all these are worth the hassle for 40M saving.
  • tipoo - Monday, April 3, 2017 - link

    Yeah, it would probably be cheaper to stay the way things are, but that's not Apple. It's the same reason they stopped licencing ready made ARM cores for chump change and made their own.
  • ET - Monday, April 3, 2017 - link

    > Imagination has a significant number of GPU patents (they’ve been at this for over 20 years)

    And given that the patent period is 20 years, that's probably why we're seeing Apple doing it now, as basic ImgTec patents are starting to expire.

Log in

Don't have an account? Sign up now