Smartphone Audio Quality Testing
by Chris Heinonen on December 8, 2013 5:15 PM EST- Posted in
- Smartphones
- Audio
- Mobile
- Tablets
- Testing
Maximum Level
The maximum output level is derived from the 1kHz test tone used to determine THD+N. The higher the output from the headphone jack, the louder it can drive a pair of headphones. More importantly, having more power available means when you have dynamic music passages that call for power you are less likely to clip the waveform.
There is no chart to show here, just a number that the Audio Precision gives us. In our test data, the most powerful phone was the iPhone 5, at 32.46 mW of power. Next is the Nexus 5 at 22.24 mW, though we can’t drive it that high. Then the Note 3 at 11.81 mW and finally the Galaxy S4 at 3.895 mW. Doubling the power, from 4 mW to 8 mW, produces a 3 dB increase in volume level. 3 dB is the smallest change in volume levels we can easily hear. So even though the iPhone 5 produces 32 mW vs. 4 mW, that is only a 9 dB difference in volume. 10 dB is doubling the volume, so it isn’t even twice as loud. If you have demanding headphones, you will want as much power as you can get.
Frequency Response
To measure the frequency response we measure a set of 61 tones from 20 Hz to 20 kHz. All of these are then equalized to 1 kHz so we can see the maximum deviation from that level. An ideal phone will be perfectly flat here and allow you to adjust this with an EQ setting, or though your taste in headphones. On this test our best performing phone is the Galaxy S4, as seen here.
The total variation from 1 kHz is only 0.014 dB which is very good. The worst performing phone is the iPhone 5, but its variation is only 0.089 dB.
The iPhone 5 also picked up the 20 kHz tone while the Samsung and many others missed it. If we dropped this tone then it might be just as flat. The iPhone 5 test was run slightly differently, as it can't run the Android test program, which might account for this. For a phone with a different response, here is the HTC One with Beats enabled. Other HTC One testing is still in progress as I write this article.
Here we see that Beats is adding a +3.5 dB boost from 60 Hz to 90 Hz, but the deviation from 0 dB goes from 30Hz to 300 Hz. Past 6.5 kHz we also see a rise in the treble. People often mistake boosted treble for extra detail, which is likely the reasoning behind this. As we see it is far different than the other two examples we looked at.
Facebook
Twitter
RSS
188 Comments
View All Comments
porphyr - Monday, December 9, 2013 - link
This article is fantastic. I love that you are going to be testing audio quality. Obviously testing anything takes a lot of time, but I think it would be nice to see how these phones perform at "reasonable" listening levels. It would be great if you could pick dB level that is pleasant through the apple earpods and test a 2nd time at that, sort of how you use 200 nits for panel tests. That would give a more helpful representation of performance. Another thing that I would really appreciate is an explanation of how bad (or good) performance needs to be for most people to hear the difference (with bad and with good headphones). Thanks for the piece.99sport - Monday, December 9, 2013 - link
Thanks for the great article.Can you add built in speaker testing? I have an HTC one, and while I prefer to turn beats audio off when I use my phone in the car (listening to music on the car's speakers), I much prefer the sound of the built in speakers with beats audio on. As others have pointed out, all of the pieces in the chain are important to sound quality. My guess is that the frequency response of the built in speakers is much less at low frequency, and the beats audio increase in gain shown in your chart (below 100Hz) is designed to compensate for the frequency response characteristics of the built in speakers. In other words, if you tested the frequency response of the built in speakers (using a microphone with a known linear frequency response to gather the data), would the curve be much flatter when using the built in speakers with beats audio turned on versus turned off? Would the HTC one with beats audio on in fact have a much better (flatter) frequency response through the built in speakers than other phones do through their built in speakers?
It would be very useful to be able to compare the sound quality of the whole sound reproduction chain including the built in speakers – for me, the built in speaker sound quality and volume level is a major discriminator between phones – right up there with display color accuracy and camera quality.
dishayu - Monday, December 9, 2013 - link
Excellent initiative. The HTC One frequency response looks dreadful. I'm looking forward to graphs with beats enhancement off.As the next step, I would really like to see where different types of audio devices compare to each other... smartphones, ordinary media players (ipods), audiophile media players (HM-801), entry level/top level PC sound cards, realtek onboard chipsets.
NeoteriX - Monday, December 9, 2013 - link
I'm not sure if it's necessary to go through the effort of including PC soundcards, motherboard solutions, etc., but including media/MP3 players would definitely be a nice addition. The place that mobile phones have now as media consumption devices in addition to being phones came as an evolution from the original media device.However, the media device, given its singular purpose, prominently had sound quality as a major review component, and consumers did look at the DACs and opamps used. When they evolved to all-purpose smartphones, suddenly there were a lot of other features that took precedence, including processing power, display quality, etc.
Now that AnandTech is shepherding in a new look at audio quality, comparing the state of mobile phones to the heyday of media device would definitely be useful.
stunta - Monday, December 9, 2013 - link
Excellent article! It would be fantastic to see results from commonly used mp3 players. iPod, Sandisk Sansa (Clip, Fuze etc.) etc.How do you feed the test tone into the phone? Does the Audio Precision device come with test files you simply drop on the phone and play?
Also, do we know if these phones use the same amplifier for the built-in speakers and headphone outputs?
Thanks again!
Impulses - Monday, December 9, 2013 - link
I'll second this and dishayu above, it'd be a great reference.Hell, if we could get you to test output of a few BT receivers out there that might also be interesting and valuable to readers... I know BT's another can of worms as it introduces more compression etc, but it's actually gotten quite decent and those receivers end up replicating (and thus bypassing) many of the same components in phones.
There's not a lot of in depth reviews out there for those things but seeing as you can use them with any pair of headphones they'd fit right into your testing and they can be a suitable solution/alternative to a phone's line out. Something like the older Sony MW-300, or the newer models, or three equivalent Samsung/LG models.
Panzerknacker - Monday, December 9, 2013 - link
Please test the Oppo Find 5! I use that phone and it should have good audio capability. Wonder how it does vs iPhone 5.juhatus - Monday, December 9, 2013 - link
Now if only apple would enable their audio tech (noise-cancel atleast) on bluetooth.I downgraded from nokia 800 to iphone5 and atleast using the in-car-bluetooth the audio on calls went really bad.
On other comment, the graphs are huge in this article, maybe little scaling or something? some bare flatlines there and very big size graphs.
Nice article :)
Impulses - Monday, December 9, 2013 - link
Great article, though I have a quibble with the headphones to be used for future testing... Nothing against either as I've owned both, and the SR80 are a fine candidate (common entry level open headphone recommendation). The AKG have a reputation for being hard to drive and they aren't exactly very portable anyway, plus they represent another dynamic open headphone. I think a popular IEM (Ety, Shure, even Apple's dual driver IEM) might be a better second alternative, if it's at all possible with your rig... I know IEM are a pain to test due to seal issues and whatnot. Failing that maybe some other dynamic headphone that's more likely to be used with a mobile device (V-moda M-80? Senn HD25-1 II?), or something cheap yet extremely popular and good for the $ (Koss Portapro or KSC75).Impulses - Monday, December 9, 2013 - link
Also, if you could test and report output impedance for the phones that would be a HUGE help for people trying to figure out what kinda headphone would work best... Relatively high output Z isn't uncommon and it can wreck havoc with some lower impedance headphones, particularly sensitive IEM (and specially the multi balanced armature models that are so prevalent now).