Best of Android 2015: Audio

by: Team AADecember 9, 2015
1.6K

What is Best of Android?                

In Best of Android, we take the hottest devices of the moment and compare them in-depth. For this first edition, we picked up the following Android flagships:

  • Sony Xperia Z5 Premium
  • Nexus 6P
  • Motorola Moto X Force
  • Samsung Galaxy Note 5
  • LG V10
  • BlackBerry Priv

What about the Galaxy S6 or the HTC One M9 or the OnePlus 2, you ask. Those are all great phones. But, to keep this comparison manageable, we selected only the phones we feel are the most representative for the ecosystem right now.

Read more about Best of Android. Thanks for being a part of Android Authority!

With the smartphone having firmly replaced the iPod as the portable music player of choice, audio playback is an increasingly important factor in today’s high end mobile. Furthermore, with increasingly bold claims of HiFi and even studio quality playback being touted on some smartphones – I’m looking at the LG V10’s ludicrous sounding 32-bit playback option here – we should check to see just how well these claims hold up to some testing.

For this test we’ve also thrown in the ZTE Axon, to see how its “HiFi quality” DAC performs in a smartphone environment and how it stands up to the competition.

Audio Benchmarking

To give us an overview of how each smartphone performs, we put each headphone jack through a Focusrite 2i2 interface and ran the popular RightMark Audio Analyser, checking for frequency response, noise and distortion characteristics.

We’ll start with noise and crosstalk, which should push well through the -96dB noise floor offered by 16-bit audio if any of our high quality DACs want to come close to realising their touted 24-bit or 32-bit performance (a practical impossibility I might add).
Best of Android audio 1

Crosstalk isolation is excellent across all of the models and there certainly isn’t any sign of any stereo bleed issues. However, none of our smartphones make a notable move past the -96dB target. The Xperia Z5 Premium clocks in a decent -100dB, while the ZTE Axon falls some way short at just -92dB. It’s by no means noisy, but seems to defeat the objective of offering a 24-bit codec and LG’s 32-bit DAC boasting is just outright ridiculous.

To be fair to the smartphones though, at approaching -100dB we could be starting to push up against the noise limits of our testing environment as well. So to so avoid complicating the results, we’ll simply test with 16-bit audio from here on out.

Best of Android audio 2
Moving onto dynamic range, the difference between the loudest and quietest output, we should see all of our smartphones hit the full 96dB dynamic range afforded by our 16-bit test signal. While some smartphones do, three of our models fall short. The Nexus 6P, Xperia Z5 Premium and the ZTE Axon cannot reach the target, meaning that additional noise is likely making its way to the audio signal path somewhere between the DAC and the jack. This isn’t an unexpected result from a compact device with lots of potential for interference, but circuit layout in the leading phones seems to be a little better thought out.

The total harmonic distortion results are excellent across the board, with all of the handsets putting in performance well below 0.004%. The ZTE Axon is the winner by a small margin, followed by the Priv and the V10. The real test for music though is intermodulation distortion, as this shows the amount of distortion generated when playing back multiple tones.

Best of Android audio 3
There is a greater disparity in this test, with the LG V10, Nexus 6P and ZTE Axon all taking a lead coming in at or below 0.01%. Here the ZTE Axon is again the winner. The Galaxy Note 5 and Xperia Z5 Premium are very close by on 0.012%, while the Priv and Moto X Force are the worst performers, although by no means are they bad and such small percentage differences are going to be very tough to tell apart.

Smartphone frequency response

Frequency response is as flat as you like across all the tested smartphones, at least when connected up to our interface. Interestingly, the Moto X Force, Nexus 6P, BlackBerry Priv and LG V10 seem to have a low pass filter on their DAC output with a -3dB point at just over 18 kHz. This is likely designed to remove any high frequency interference from high speed signals, such as the codec clock, without interfering with the audible spectrum, or could be something in software.

High frequency filtering

Crunching through the data, it’s definitely a tight run thing in the portable audio space these days, will all the smartphones offering up specifications that are hard to complain about. It’s a bit disappointing to see that none of the higher resolution devices offer a notable bit-depth advantage, but this just highlights the difficulties in fitting low noise audio circuits into a mobile phone, if nothing else. With that said, the “32-bit” LG V10 performs consistently well across all of the tests, followed closely by the Galaxy Note 5 and the HiFi ZTE Axon.

Listening Test

Best of Android Audio listening test

Of course, no audio test would be complete without actually having a listen to the phones in the real world. So I stuck a couple of my favourite FLAC tracks on board and had a good listen through some AKG K550s, a reasonably priced pair of “reference” headphones. Honestly, all of the smartphones performed well, as the scientific testing suggested, but there were some subtle differences between a number of the phones.

The “worst” performers, to my ears, were the 6P and the X Force, as the balance didn’t quite seem to keep up with the other phones. Although tone and detail were good across both models, the X Force seems to throw in some heavy hitting bass that verged on boomy for my tastes. The 6P has the opposite problem, lacking any real punch to kick drums and both were missing that extra sizzle on cymbals that really flesh out a track.

The Priv sounded well balanced and delivered nice tone, but seemed to produce a narrower sound than all of the other handsets. This resulted in an experience that felt a bit more sterile. The ZTE Axon suffered from a similar lack of excitement despite sounding nice and wide, but I put this down some missing punch in the lows. That being said, the ZTE Axon offered excellent detail across the spectrum.

The Galaxy Note 5 stood out the most in terms of a unique tone, as the tracks seem a little warmer here than on other phones. After listening, I took a closer look at the intermodulation distortion results and found an interesting introduction of some second harmonic distortion that can’t be seen on other phones (at least not this noticeably). Although it only appears very slight, cumulatively this might be audible when listening to a full track. The panning and high-end detail are excellent with vocals cutting through nicely, but the extra smoothness might not sit well with everyone.

There appears to be some additional 2nd harmonic content introduced somewhere in the Galaxy Note 5's signal path, which is more typical of a classic warm valve sound.

There appears to be some additional 2nd harmonic content introduced somewhere in the Galaxy Note 5’s signal path, which is more typical of a classic warm valve sound.

The Xperia Z5 is one that the bass junkies will love. It really thumps on kicks but isn’t overbearing and provides excellent details in the mids that holds up well in the highs too. I really couldn’t find much to complain about here but it’s tough to call it notably ahead of the Note 5 or Axon.

This leaves the LG V10 as the stand out smartphone for me, and it was the only one to bring a smile to my face as it managed to conjure up some new sounds from tracks that I thought I knew in and out. The V10 is well balanced across the frequency spectrum and really shines when it comes to detail and spacing. It’s by far the widest sounding phone, which was actually a little disorienting at first, but this really allows for all the small details to come through. Although a 32-bit DAC may be little more than a marketing gimmick from a technical standpoint, the detail and sense of space that comes through with this codec are simply fantastic.

Rear speaker volume test

If you’re planning to take your smartphone out on the road, then the maximum volume of the smartphone’s speaker may also be of interest. We took a peak volume reading right next to the phone’s speaker to see which is the loudest. The chart below shows the result and the typical dB values for common environments.

Best of Android audio 4
Given that you’ll be holding the speaker away from you and the actual media volume will be more dynamic than the peak, you want to get notably past the markers to be sure that you can make out quieter details. So if you want to watch films in the car, the Note 5, X Force, Nexus 6P and LG V10 should definitely have you covered.

Remember, decibels are a logarithmic scale and every 10dB increase results in roughly a doubling of the perceived loudness of a sound. This makes the LG V10 the loudest of the bunch by some margin, offering up double the peak volume of BlackBerry Priv, Xperia Z5 Premium and the ZTE Axon. At a whopping 100dB I honestly don’t recommend sticking your ear right up next to the speaker.

Given the decent performance of the ZTE Axon in the headphone tests, the speakers were a major disappointment. We didn’t have any complaints about the other phones, but the Axon’s speaker was horrendously tinny.

Summing up

Taking the whole picture into account, the LG V10 is a pretty clear winner. It comes out as one of the best performers in both the jack and speaker tests, and sounds incredibly good. Second place is a very close run contest, with the Galaxy Note 5, Xperia Z5 Premium, and Nexus 6P all putting in good performances.

The Galaxy Note 5 just edges out ahead in the benchmark and speakers tests, but there’s excellent headphone sound available on the Z5 Premium too. Sadly, the Axon phone’s disappointing dynamic range and speaker results hurt what was otherwise a lovely sounding phone, proving that spec sheet point scoring doesn’t always translate in the real world. Unfortunately, the Moto X Force didn’t stand out in the listening test and had the worst distortion results, so you can certainly do better if you’re looking for a top notch audio experience.


Best of Android 2015

All the comparisons:

Best of Android: Display

Best of Android: Audio

Best of Android: Performance

Best of Android: Battery

Best of Android: Camera

Best of Android: User Experience

And the winner is…

Credits

Post by: Rob Triggs
Series Contributors: Rob TriggsGary Sims, Lanh Nguyen, Joe Hindy, Krystal Lora

Series Editors: Nirave Gondhia, Bogdan Petrovan, Andrew Grush

  • boris “gamusino petete” sajoni

    would the lg g4 be just as good as the v10? please answer

    • lalala

      dont think so spec wise.

    • Insert Name Here

      No because it doesn’t have all the improvements and 32bit DAC offered by the V10

    • Nachiketa Ramesh

      No. The V10 has a 32bit DAC.

  • Søren Jørgensen

    Why is the BB and the ZTE there but not HTC one m9/A9?

  • WitnessG

    Doesn’t the Moto X Pure have better speakers than the Force? Should have tested the Pure instead.

    • i_say_uuhhh

      Seems like it. I used to have the “X Pure” and let me tell you playing these through my vehicles AUX the sound was loud clear and the tones sounded great, compared to my Nexus 6P which sounds flat and noticeably less loud throughout. However if you are playing them without any headphones or aux cables, than the 6P is a bit louder.

  • Tsoa Tsyfatatra

    “For this test we’ve also thrown in the ZTE Axon, to see how its “HiFi quality” DAC performs in a smartphone environment and how it stands up to the competition.”
    I have the following questions :
    1.Where is the Marshall phone?
    2.Did you use any sounds enhancements for each phone you were testing?
    3. What flac format did you use?

  • Khizar Amin

    Not a single HTC phone in comparison?

    • SamG

      yes it’s truly sad that they missed out M9 on this one

  • Badelhas

    What about the HTC M8 or M9? Why didnt you include any of them?

    • dontpanicbobby

      The HTC One M8 was released in August 2014. It is strange that the HTC One M9 wasn’t included though, that came out in April 2015.

      • Badelhas

        Specially when the HTC One_M8 and M9 (I believe) are know for having great sound quality…

  • Juang Bo

    thanks for a nice and informative review ….

  • Juang Bo

    should include the M9, iphone 6s, and Meizu MX5 PRO

    • Smokingaces

      You know iPhone is not an android device, right?

  • _Tua madre è leggenda_

    Audio 32bit of LG v10 for lg g4?

  • ddas

    WHERE IS XIAOMI MI NOTE ?! with hifi audio

  • Dorsen Perianen

    Since we are talking audio, it would have make sense to include the Marshal London!

    • Arjuna Ravinthran

      I know right seemed like an obvious pick considering its musical pedigree

    • lumberjake

      Agreed, they should have gotten ALL the smartphones that have specific DACS for hi fi sound.

    • Marshal London is around $1,000 and is a great audiophile phone, but if you’re going to pay $1000 for a smartphone, you have to be sick in the head. It’s also not available in the US. Amps and/or DAC’s for less than $500 could give you better audio quality than purchasing a $1000 smartphone.

  • Iain William Davidson

    All of these figures are meaningless unless you have £1000+ headphones

    • Patrick Gerbersmann

      Na think 200-300

  • Steve Brain

    I must say I was a little disappointed they didn’t compare the G4. Seeing as the V10 is only available in very few markets.. But hey, owning this device for the past month or two it absolutely would not surprise me if they used the same audio hardware. Good job LG.

  • Hartfrid Lovejoy

    No mention of the Idol 3 or HTC M9?

  • Ugnius Igaris

    The ZTE Axon has Hi – Fi, whereas Z5 has Hi – Res, which is even better quality than the Hi – Fi. Then why do you emphasize Axon’s greatness so much and don’t even mention/try high res quality sound?

  • Sandy

    LG V10 FTW !!!

  • Žydrūnas

    This just proves that benchmarking shall never be the only point of focus. A winner phone without stereo speakers and no HTC One M9 with its incredible BoomSound speakers included makes all this software testing pretty pointless.

    • lumberjake

      They included a human too, its not just benchmarks. As someone who owned the HTC M7 and now the LG V10, the HTC is not even in the same league IMO.
      External speakers are ridiculously overhyped. I guess its cool if you game…maybe. The fact is that the sound that comes out of those speakers is a joke, they all sound like shit. Who in their right mind would listen to music on them?
      Headphone out is clearly a far more important feature because you can get good sound,really good and that is where the emphasis is and should be. My M7 is no where near as good as the LG V10. Its simply unlikely when the LG has high end DAC and amp circuits by a company that specializes in audio. The DAC and amp by ESS are soley designed for quality sound output whereas most use the built in SoC systems that just throw in the ability to play music and that is about it.

      The V10 is just an awesome phone period. I bought it just for the audio capabilities that eliminate my having to use an external DAC and amp stack system which was a huge PITA. In fact, I have read posts on audiophile sites that have said this phone compares with stand alone DAPs costing nearly as much. The V10 does for DAPs what smartphones in general have done for point and shoot cameras.Which was yet another bonus I got with the V10, its camera is incredible with DSLR like manual controls ,even for video!
      My friends thought I was crazy to spend $900 CAN to buy from Hong Kong but I think its a bargain considering all the features. Not only is it a brilliant phone but its also a mid level DAP ,agreat camera/video recorder, GPS device and a computer . Those high end DAPs could only dream of having the processor power featured on this phone.

  • NOTE 5 is the beast.

  • Susmith Sunil Kumar

    I was actually looking forward to this comparison… but the very fact that u didn’t give M9 a chance pisses me off sooo badly! it was a tough year for HTC I agree and the M9 didn’t live up to any body’s expectations… and imho the only thing htc did right with the m9 was the speakers. Boomsound has been a benchmark for quite sometime now and right when it mattered the most, the only phone that actually gave a shit about audio quality to the point that they advertised dolby audio, wasn’t given a chance. I couldn’t be more disappointed as an audiophile. Shame on you AA. Pls do a revised version of this with M9 included. There is absolutely no excuses for not including the M9 for a comparison like this.

  • Susmith Sunil Kumar

    I was actually looking forward to this comparison… but the very fact that u didn’t give M9 a chance pisses me off sooo badly! it was a tough year for HTC I agree and the M9 didn’t live up to any body’s expectations… and imho the only thing htc did right with the m9 was the speakers. Boomsound has been a benchmark for quite sometime now and right when it mattered the most, the only phone that actually gave a shit about audio quality to the point that they advertised dolby audio, wasn’t given a chance. I couldn’t be more disappointed as an audiophile. Shame on you AA. Pls do a revised version of this with M9 included. There’s absolutely no excuse for not including the One M9 for a comparison of Audio Quality.

  • Don_Alduck

    I have the Z5 and the audio quality is truly amazing. Good review, although HTC phones are missing.

  • tiger

    Google: Android audio latency.

    Android is pretty bad altogether.

    • The-Sailor-Man

      Samsung fixed the latency in their devices , ignorant.

      • Daniel Cho

        How so?

  • Dhaval Dn

    which one has front dual speakers ?

  • Mike

    Great, now why don’t you tell us which phone has the highest headphone output level?? I am not deaf or interested in blasting my ears out like an idiot. Anyone interested in music with dynamics and having a wide choice of headphones will need the most output they can get. Additionally the correct use of an equalizer can improve frequency response however requires pre-attenuation to avoid clipping. This means the master volume must be increased even more to obtain the same relative level but if you are already maxed out because of less than loud headphones and lack of overmastered loudness war material….you can forget rocking out.

  • Mike

    Also yes, the HTC’s really should be on here

  • Mike

    Great now can you tell us about the headphone output level of these devices? I am not deaf or interested in blasting my ears out like an idiot. Anyone interested in properly mastered music with dynamics and a wide variety of headphones to choose from will need as much output as they can get. Additionally the proper use of an equalizer can improve frequency response but requires pre-auttenation to avoid clipping. This means the master volume will have to be turned up even more to obtain the same relative level.

  • Go LG!

  • TheRelaxedFlier

    This article is so biased on the ZTE Axon (or the Pro version for that matter).