Automotive: DRIVE CX and DRIVE PX

While NVIDIA has been a GPU company throughout the entire history of the company, they will be the first to tell you that they know they can’t remain strictly a GPU company forever, and that they must diversify themselves if they are to survive over the long run. The result of this need has been a focus by NVIDIA over the last half-decade or so on offering a wider range of hardware and even software. Tegra SoCs in turn have been a big part of that plan so far, but NVIDIA of recent years has become increasingly discontent as a pure hardware provider, leading to the company branching out in unusual ways and not just focusing on selling hardware, but selling buyers on whole solutions or experiences. GRID, Gameworks, and NVIDIA’s Visual Computing Appliances have all be part of this branching out process.

Meanwhile with unabashed car enthusiast Jen-Hsun Huang at the helm of NVIDIA, it’s slightly less than coincidental that the company has also been branching out in to automotive technology as well. Though still an early field for NVIDIA, the company’s Tegra sales for automotive purposes have otherwise been a bright spot in the larger struggles Tegra has faced. And now amidst the backdrop of CES 2015 the company is taking their next step into automotive technology by expanding beyond just selling Tegras to automobile manufacturers, and into selling manufacturers complete automotive solutions. To this end, NVIDIA is announcing two new automotive platforms, NVIDIA DRIVE CX and DRIVE PX.

DRIVE CX is NVIDIA’s in-car computing platform, which is designed to power in-car entertainment, navigation, and instrument clusters. While it may seem a bit odd to use a mobile SoC for such an application, Tesla Motors has shown that this is more than viable.

With NVIDIA’s DRIVE CX, automotive OEMs have a Tegra X1 in a board that provides support for Bluetooth, modems, audio systems, cameras, and other interfaces needed to integrate such an SoC into a car. This makes it possible to drive up to 16.6MP of display resolution, which would be around two 4K displays or eight 1080p displays. However, each DRIVE CX module can only drive three displays. In press photos, it appears that this platform also has a fan which is likely necessary to enable Tegra X1 to run continuously at maximum performance without throttling.

NVIDIA showed off some examples of where DRIVE CX would improve over existing car computing systems in the form of advanced 3D rendering for navigation to better convey information, and 3D instrument clusters which are said to better match cars with premium design. Although the latter is a bit gimmicky, it does seem like DRIVE CX has a strong selling point in the form of providing an in-car computing platform with a large amount of compute while driving down the time and cost spent developing such a platform.

While DRIVE CX seems to be a logical application of a mobile SoC, DRIVE PX puts mobile SoCs in car autopilot applications. To do this, the DRIVE PX platform uses two Tegra X1 SoCs to support up to twelve cameras with aggregate bandwidth of 1300 megapixels per second. This means that it’s possible to have all twelve cameras capturing 1080p video at around 60 FPS or 720p video at 120 FPS. NVIDIA has also made most of the software stack needed for autopilot applications already, so there would be comparatively much less time and cost needed to implement features such as surround vision, auto-valet parking, and advanced driver assistance.

In the case of surround vision, DRIVE PX is said to deliver a better experience by improving stitching of video to reduce visual artifacts and compensate for varying lighting conditions.

The valet parking feature seems to build upon this surround vision system, as it uses cameras to build a 3D representation of the parking lot along with feature detection to drive through a garage looking for a valid parking spot (no handicap logo, parking lines present, etc) and then autonomously parks the car once a valid spot is found.

NVIDIA has also developed an auto-valet simulator system with five GTX 980 GPUs to make it possible for OEMs to rapidly develop self-parking algorithms.

The final feature of DRIVE PX, advanced driver assistance, is possibly the most computationally intensive out of all three of the previously discussed features. In order to deliver a truly useful driver assistance system, NVIDIA has leveraged neural network technologies which allow for object recognition with extremely high accuracy.

While we won’t dive into deep detail on how such neural networks work, in essence a neural network is composed of perceptrons, which are analogous to neurons. These perceptrons receive various inputs, then given certain stimulus levels for each input the perceptron returns a Boolean (true or false). By combining perceptrons to form a network, it becomes possible to teach a neural network to recognize objects in a useful manner. It’s also important to note that such neural networks are easily parallelized, which means that GPU performance can dramatically improve performance of such neural networks. For example, DRIVE PX would be able to detect if a traffic light is red, whether there is an ambulance with sirens on or off, whether a pedestrian is distracted or aware of traffic, and the content of various road signs. Such neural networks would also be able to detect such objects even if they are occluded by other objects, or if there are differing light conditions or viewpoints.

While honing such a system would take millions of test images to reach high accuracy levels, NVIDIA is leveraging Tesla in the cloud for training neural networks that are then loaded into DRIVE PX instead of local training. In addition, failed identifications are logged and uploaded to the cloud in order to further improve the neural network. Both of these updates can be done either over the air or at service time, which should mean that driver assistance will improve with time. It isn’t a far leap to see how such technology could also be leveraged in self-driving cars as well.

Overall, NVIDIA seems to be planning for the DRIVE platforms to be ready next quarter, and production systems to be ready for 2016. This should mean that it's possible for vehicles launching in 2016 to have some sort of DRIVE system present, although it's possible that it would take until 2017 to see this happen.

GPU Performance Benchmarks Final Words
POST A COMMENT

194 Comments

View All Comments

  • MrPoletski - Monday, January 26, 2015 - link

    I can't help but think the reason that this all happened at all is because of AMD and Mantle. Reply
  • maskofwraith - Monday, March 2, 2015 - link

    if OpenGL is FAR outdated and a mess then why are they still supporting it? why dont they try to contribute it to it, to make it better? Wait they cant do that all they need is money. half of the internet runs on opensource. Reply
  • GC2:CS - Monday, January 5, 2015 - link

    Why ?

    They do incredibly well on graphics font.
    Reply
  • Mondozai - Monday, January 5, 2015 - link

    Everyone who thinks that the X1 is going to crush all the competition is going to get burned once more, just like with K1. OEMs want an integrated solution. Yes, Nvidia has awesome GPU capabilities(duh) but that in of itself isn't enough. Still doesn't have an integrated modem, so the smartphone market is dead on arrival.

    Tablets have a better shot, but Nvidia is aiming for the car market for a reason. There may be a few one-off devices that they will aim for but overall, this isn't going to be a significant force in the high-end tablet space. S810 has the GPU capability to run 4K smoothly.

    Apple's next GPU is going to be a lot better, just like every year. Can Nvidia compete on a 'total system basis'? The answer remains as it has always been: no.
    Reply
  • speculatrix - Monday, January 5, 2015 - link

    Nvidia have Icera, their own 4G/LTE modem technology, so hopefully NVidia will have a version of the X1 with that integrated, or at least a version with a "glue-less" interconnect to their Icera module. Reply
  • Yojimbo - Tuesday, January 6, 2015 - link

    The soft-modem is MIA. NVIDIA has not been going after the smartphone market. Reply
  • Yojimbo - Tuesday, January 6, 2015 - link

    NVIDIA has not been pursuing smartphones for a couple years now. What advantage does the Snapdragon 810 have over the Tegra X1 in the high end tablet space? Qualcomm will have to compete based mostly on familiarity of the OEMs with their SOCs, price, and the fact that Samsung is unlikely to choose NVIDIA. If the 810 is available at an earlier date, that also might help them out during that time period. Reply
  • aenews - Saturday, January 24, 2015 - link

    The Snapdragon 810 doesn't even come close to matching the graphical prowess of the K1, even though it's just about a whole year newer.

    The Snapdragon 805 saw little adoption. In tablets, there was the Kindle Fire HDX. That's... one whole design win for tablets. The K1 was in the Shield Tablet and the Nexus 9 (and the Xiaomi MiPad).
    Reply
  • harrybadass - Monday, January 5, 2015 - link

    by the time the new Imagination7xxx&A9x is released this will already be obsolete.

    Nvidia is playing catchup.
    Reply
  • kron123456789 - Monday, January 5, 2015 - link

    Yeah. Exactly the same was said about Tegra K1 and GX6650. Reply

Log in

Don't have an account? Sign up now