Smartphone Audio Quality Testing
by Chris Heinonen on December 8, 2013 5:15 PM EST- Posted in
- Smartphones
- Audio
- Mobile
- Tablets
- Testing
In many of the examples you have seen so far, you notice that the Nexus 5 has a large issue with the left channel at peak volume levels. As Brian mentions in his Nexus 5 review, it is based on a similar platform to the LG G2 but it isn't identical. Because there are similarities I want to test it out and see if it has the same issue that I see on the Nexus 5.
The test that is causing the large issue on the Nexus 5 is a 1 kHz sine wave, at -0dBFS, at maximum volume. This is the loudest sound that any device will be asked to produce. If you're familiar with the trends in music mixing the past two decades you'll know that a peak of -0dBFS is not all that uncommon now. This chart at NPR shows the average and peak levels for the most popular songs over the past thirty years. Two decades ago testing for -0dBFS might not have been important but it is now. So lets look at this image from the Nexus 5 again.
Now for comparison, we will look at the LG G2.
This looks much better. However the LG G2 is still putting out 0.546528% THD+N into the left channel while only outputting 0.003338% into the right channel. So there is still some imbalance going on here. So why is the issue so much less on the G2 than on the Nexus 5?
The key to this is looking at the scale on the graphs here. While the Nexus 5 peaks are up close to 1.3-1.4V, the G2 has peaks that don't even reach 700mV. Looking at the actual numbers the G2 has a Vrms level of 475.3 mVrms while the Nexus 5 checks in at 843.6 mVrms for the left channel and 982 mVrms for the right channel. The G2 is placing far less stress on its headphone amplifier and keeping it from the output levels that cause this excessive clipping in the Nexus 5.
To look in more detail, we have THD+N Ratio charts for the stepped level sweep that we looked at earlier. First, lets look at the Nexus 5.
We see that the first three volume levels, 15-13, have THD+N distortion over 0.3% for the left ear, while they are below 0.01% for the right ear. From level 12 and below the THD+N levels are practically equal. Now to see how this data on the G2 looks.
We see the first volume step has 0.55% THD+N or so for the left ear, but the right ear is down at a similar level to level 14 on the Nexus 5. The next step drops it to 0.03% which is way, way below where it is on the Nexus 5 at that point. By step 13 they are equal.
The conclusion I pull from this is that both the G2 and the Nexus 5 have the exact same flaw right now. However, the G2 has attempted to hide it by reducing the maximum output level of their headphone amplifier. The Nexus 5 can play louder, but only with far more distortion. Given this I would expect there to be an update to the Nexus 5 at some point that lowers the maximum headphone level to something closer to the G2.
However this doesn't mean that the Nexus 5 is certainly worse to use with headphones. The top 3 settings are ones I would avoid due to the left channel issue, but I might avoid the top 1-2 settings on the G2 as well. If we consider 1% THD+N to be the maximum allowable level, that leaves 8 volume steps on the Nexus 5 that are usable. The G2 has 9 steps that are available to you, and 10 if you consider 0.03% THD+N in one ear to be OK (it probably is).
In the end, the G2 won't play as loud as the Nexus 5 will, but you don't want to play that loud anyway. It has more usable volume steps than the Nexus 5, and otherwise very similar numbers. I'll be interested to see if either of them make further changes to their maximum output levels to remove this issue.
Facebook
Twitter
RSS
188 Comments
View All Comments
Impulses - Monday, December 9, 2013 - link
Ehh, impedance curves for the headphones he suggested (Grado SR80, AKG K701) are easy to find (Inner Fidelity and others have decent databases)... Testing and providing output impedance for the phones would be very valuable indeed though, even if everything else in the chain performs alright that alone can affect the FR significantly with one pair of headphones and not at all with the next... And unfortunately there's never been a realistic standard for output impedance, (other than high quality solid state amps now aiming for >1 ohm), and it's often all over the place.ssddaydream - Monday, December 9, 2013 - link
I agree with this.I think of three main usage scenarios regarding the headphone output:
1.) Quality of HP output driving a high-impedance line-level input for a home or car stereo.
2.) Quality of HP output driving low-impedance, sensitive IEMs.
3.) Quality of HP output driving high-impedance, non-sensitive cans.
For #2 and #3, the output impedance should be known, as well as the amplifier power at a given THD level.
There reasons why the iPhones are able to perform well with IEMs, namely low noise floor and low output impedance. Also, iPhones perform well with larger cans because of the decent output power.
I think the usage cases I listed above are pretty common, so I think a good approach to testing is to think about the most important parameters for each usage case.
BTW, I am excited about AT doing these measurements- very good news, indeed!
Anand_user123 - Monday, December 9, 2013 - link
I use my phone most of the time as a music player. Audio quality and storage capacity for flac files are major factors in my buying decision. I hope we can have more widespread information on smartphones audio performancestepz - Monday, December 9, 2013 - link
If you actually cared about scientific measurements of audio performance you would use compressed audio instead of flac. ;) Given a decent amount of bitrate, compressed audio is indistinguishable from uncompressed in double blind tests. In my experience FLAC is mostly about the listener feeling good about getting the "correct" experience, like expensive speaker cables.Impulses - Monday, December 9, 2013 - link
There's a valid usage case for FLAC as far as ripping and archiving IMO, you might as well if you're ripping a large collection (or ripping often)... Since you can quickly re-transcode or edit files w/o a loss of quality... But yeah, I don't see why anyone would put FLAC files on a phone, transcoding is dead simple and super quick if you have a remotely modern PC. Managing FLAC & MP3 playlists or whatever shouldn't be a hurdle if you're putting the effort to maintain a FLAC library to begin with, just use the MP3 library for everything or use stuff like Media Monkey's smart filters/playlists.NaterGator - Monday, December 9, 2013 - link
The biasing of the amplifier in the Nexus 5 and LG G2 left channel appears incorrect. Note it is only clipping on the negative portion of the waveform.vshah - Monday, December 9, 2013 - link
Can't wait to see htc one results!jrs77 - Monday, December 9, 2013 - link
Could you compare the phones to an iPod maybe? This way we would've an comparisooon to a mediaplayer where there's no 3G/4G/LTE disturbance.Oh, and for the general audience discussing the DACs etc... The DAC isn't the cruicial part, never has been. The amp is what it's all about and how good or poor it's powered.
There's a reason why audiophiles still use tube-amps, or atleast digital amps with high quality toroidal transformers and good shielding to reduce noise distortion etc.
Oh, and btw... A good mediaplayer needs a microSDHC-slot or the possibility to use an USB-stick. A mediaplyer is no good if I can't carry my whole music-library with it (100+ GB).
Leezhunjin - Monday, December 9, 2013 - link
Hi Chris, very nice to see smartphones getting measured in terms of audio performance, as many of these phones are used as a music device as well. Personally, I think that an inclusion of output impedance measurements would really great be though, as it is one of the factors that would affect the earphone performance rather significantly.CSMR - Monday, December 9, 2013 - link
Very good start. Poor quality needs to be exposed and you've done this with the Nexus 5.I would like to see output impedance since low output impedance is a very important quality of a good headphone output.