GPU Performance

CPU performance is one side of an SoC, while GPU performance is the other side. With two years of GPU development between the Nexus 5 and the 5X we're hopefully looking at a substantial uplift in GPU performance. Qualcomm's official figures peg Adreno 418 as 20% faster than Adreno 330 in graphics workloads. To characterize the Nexus 5X's performance during graphics workloads that are similar to those a 3D game would provide I've run it through our standard GPU-focused benchmarks. The first is 3DMark, followed by BaseMark X and GFXBench 3.0.

3DMark 1.2 Unlimited - Graphics

3DMark 1.2 Unlimited - Physics

3DMark 1.2 Unlimited - Overall

The Nexus 5X ends up actually coming in below the Nexus 5 in 3DMark's overall score. This is the result of the much lower score in the physics sub test. However, it's worth noting that the 3DMark physics test has heavy data dependencies and all of our tested devices with bigger out of order cores end up doing poorly. While this is a possible scenario in a real-world program, I wouldn't make too many conclusions from the Nexus 5X's performance here. In the graphics test there's actually a surprising gap between the 5X and the LG G4 which uses the same SoC, and I've been unable to get a score anywhere near it no matter how many times I re-run the test. At least in 3DMark it looks like the LG G4 has a bit of a lead over the Nexus 5X.

BaseMark X 1.1 - Dunes (High Quality, Onscreen)

BaseMark X 1.1 - Hangar (High Quality, Onscreen)

BaseMark X 1.1 - Dunes (High Quality, Offscreen)

BaseMark X 1.1 - Hangar (High Quality, Offscreen)

BaseMark X 1.1 - Overall (High Quality)

BaseMark X's results are more in line with what I expected to see from the 5X's GPU. The on-screen results are far ahead of the LG G4, which isn't surprising at all when you consider that the G4 is driving a 2560x1440 panel while the 5X is pushing 1920x1080. Both off-screen results are close enough that they could be ascribed to margin of error, and ultimately BaseMark X shows that there's not really any gap between the absolute performance of the G4 and the 5X, but the 5X will definitely be faster for anything running at native resolution.

GFXBench 3.0 T-Rex HD (Onscreen)

GFXBench 3.0 Manhattan (Onscreen)

GFXBench 3.0 T-Rex HD (Offscreen)

GFXBench 3.0 Manhattan (Offscreen)

The results in GFXBench echo those of BaseMark X. The 5X beats the G4 in both off-screen cases, but only by a small margin. With the 5X being slightly faster than the G4 in both GFXBench and BaseMark X we may be looking at some small driver improvements here, but since all the gaps are so small it may just be coincidence that the 5X is the faster of the two devices in both tests.

Ultimately, both Adreno 418 and 430 are pretty good GPUs, and with the Nexus 5X being priced at $379 I think it offers more than adequate GPU performance for its price. What's interesting is that even though we didn't see Snapdragon 805 show up in many devices, it was in the Nexus 6, and its Adreno 420 GPU is definitely a bit faster than the Adreno 418 in the 5X. The Nexus 6 was also priced much higher than the 5X, and so with the 5X you're definitely getting a lot more GPU performance for your money than you got with the Nexus 6. The performance uplift is definitely greater than Qualcomm's stated 20%, and it's always nice to see something beat expectations.

NAND Performance

When I originally reviewed the Nexus 6 I decided to publish the review without any storage benchmarks, because in my testing I noticed that the results I was getting simply did not add up. Futher investigation revealed that it was the result of the Nexus 6's forced Full disk encryption (FDE), and the encryption and decryption of data being done without the use of high speed, power efficient fixed-function hardware. Later on in the Nexus 9 review Josh noted that there was a significant uplift in NAND performance compared to the Nexus 6, and it was clear that the AES/SHA instructions that are part of the ARMv8 instruction set were helping to reduce the performance impact of FDE.

Since Snapdragon 808 supports the ARMv8 ISA this presents a good opportunity to revisit this topic. The Nexus 5X shares several things with the LG G4, and one of them is its NAND, which is an eMMC 5.0 solution provided by Toshiba with the model number 032G74. While there's not much public information on this storage solution, one would expect that NAND storage speed results from the Nexus 5X closely match those of the LG G4, as if that isn't the case then it's clear that FDE causes a noticeable loss of performance despite ARMv8's cryptographic instructions.

Internal NAND - Random Read

Internal NAND - Random Write

Random read and write speeds both take a hit when compared to the LG G4. While the gaps don't look enormous, the performance with small transaction sizes on mobile devices is hardly great to begin with, and so even these small gaps can matter greatly. In this case both random read and write speeds are both about 30% lower than the G4, which is significant.

Internal NAND - Sequential Read

Internal NAND - Sequential Write

Sequential write speeds on the 5X end up being about equal to the G4, but the gap in sequential read speeds is enormous. Altogether, it's clear that there's still a significant reduction in NAND performance caused by the use of FDE when only using ARMv8's cryptographic instructions to encrypt and decrypt data to be written. This contrasts with comments made by Google engineer David Burke during a Reddit AMA discussing the FDE situation on the Nexus 5X in response to a comment that was referencing the Nexus 6's poor storage performance. What's interesting is that ARM has stated before that the ARMv8 cryptographic instructions are not a substitute for fixed-function hardware, and so it looks like there's a disagreement between ARM and Google on whether or not this is an adequate solution for encryption.

Reduced storage performance is not the only problem with this solution. Waking up the AP to do encryption or decryption every time the disk has to be read from or written to incurs a huge power penalty compared to simply using a hardware AES block and DMA which happens to be what Apple has been doing for about six years now. There are power savings here just waiting for Google to grab them, but they've decided not to do so for a second year now. Google certainly has an interest in getting Android phones to use FDE out of the box in order to combat negative perceptions about Android's security, but I don't think it's acceptable to have such a policy without the necessary hardware to make sure it doesn't affect the device's performance to any significant degree.

The Nexus 5X is certainly in a much better situation than the Nexus 6 was, but Google's FDE policy means you still get significantly reduced storage performance across the board compared to a device with the same NAND. This has various ramifications, ranging from data transfer speeds, to app install times, to performance when apps are updating in the background, to the ability to rapidly take photos and record high bitrate video. I really wish Google would either not ship with forced FDE and allow it to be disabled, or implement the necessary fixed-function AES hardware to avoid the significant performance hit.

System Performance Battery Life, Charging, WiFi
Comments Locked

197 Comments

View All Comments

  • Brandon Chester - Tuesday, November 10, 2015 - link

    We use iPerf 2 as well, with similar settings but a 60 second test period and only a single thread. 5X is on the latest firmware from Google, and the router is an Archer C7. The phones are always tested right beside the router.

    I actually tested the Nexus 6 and Galaxy S6 in the exact same configuration to make sure there wasn't some bug, and they achieved the same speeds that we've recorded previously.
  • Kumar Anand - Tuesday, November 10, 2015 - link

    Brandon - Thanks for your reply. This explains the difference. Here is my explanation.

    With single iperf stream, the CPU utilization is not enough for Nexus 5X and hence due to aggressive power save on Nexus 5X, the CPU clock frequency is likely scaling down impacting the overall Wi-Fi end to end throughput. Hence it is not really the Wi-Fi but the CPU power save that is preventing us from realizing the full capacity of Wi-Fi. Think of this as the classic performance vs power trade off. Nexus 5X has very good battery life due to aggressive power save policy. Other devices might not have as aggressive CPU scaling policy as Nexus 5x and hence do not impact the Wi-Fi TPUT even with the single iperf stream.

    If the intention is to see how much (maximum) TPUT Nexus 5X Wi-Fi can handle or achieve, we should pump enough traffic to take the CPU scaling behavior out of the equation. If you run with -P3 iperf option and pump 3 iperf traffic streams, you can realize the full capacity of Wi-Fi throughput. I am able to achieve more than ~600 Mbps consistently with -P3 option.

    In summary - the following statement "Nexus 5X's WiFi performance is not very high for a dual spatial stream 802.11ac implementation" is not accurate. A dual spatial stream 11ac chip (like the one in Nexus 5x) can definitely achieve more than ~600 Mbps but you just need to pump enough traffic. I would be very curious to see your revised comparative numbers with -P3 option.

    Thank you.
  • Kumar Anand - Tuesday, November 17, 2015 - link

    Hi Brandon - Did you run comparative tests with iperf -P3 option? Are you considering including the revised numbers with -P3 option? For achieving peak performance we should pump 3 streams of iperf traffic. This will really test what is the "max" throughput each of the phones can handle.
  • FL777 - Tuesday, November 10, 2015 - link

    Great review. Your phone reviews are the best on the internet with the one exception of your iPhone 6S review where you fall in love with the Apple SoC so much that you start gushing. Yeah the iPhone 6S is the fastest phone on the planet, but it lacks a lot of the sophisticated and very useful features that the Samsung 6S Edge and the Samsung Note 5 have.

    Google has really stepped up with teh 5x. The 6p is supposed to be a super phone also. I can't wait to see what the Galaxy S7 will look like. It's SoC is supposed to be a beast and the camera is supposed to be the first smartphone camera that rivals dedicated cameras.
  • Hanknah - Tuesday, November 10, 2015 - link

    Do you know of any reason why the Nexus 5x seems to be currently priced at USD $450-550? amazon.com has it from 450-510 and the google store has it from 500-550. I live in Canada so the google store might be showing me Canadian prices but amazon.com is showing the numbers in USD I'm pretty sure
  • Ryan Smith - Tuesday, November 10, 2015 - link

    The 5X is being sold directly by Google in the US. So Amazon prices would be reseller prices I expect.
  • Goodspike - Tuesday, November 10, 2015 - link

    What would be nice is to have test comparisons of new mid-range devices to high end devices from 3-4 years ago. I tried to go back and look at some earlier reviews, but many of the tests have changed (even ones with the same names). But my point is by doing so people would know if they could save money by foregoing something faster than what they have now.
  • evolucion8 - Tuesday, November 10, 2015 - link

    I had the Nexus 5 and I wasn't that fond of it, It felt cheaper and less premium compared to the Nexus 4, the camera was horrible when taking pictures and videos, the battery life was disappointing and the SOC would throttle a lot! I returned it and got its brother, the LG G2 and its so much better on every discipline, much better battery life, better screen, much better camera and better build quality. My only grief is that its list of custom ROMs is much smaller compared with what you can get for the Nexus 5, :-(
  • jay401 - Tuesday, November 10, 2015 - link

    Does this phone have WiFi Calling?
  • Brandon Chester - Tuesday, November 10, 2015 - link

    I actually don't know. Here in Canada we're basically in the dark ages so no carriers have it.

Log in

Don't have an account? Sign up now