Performance

Anand declared the Epic 4G the fastest Android phone. I think it's safe to say that right now the Galaxy S is the undisputed performance champ for 3D, at least until we start seeing SoCs built around A9 MPCore with even more powerful GPUs. CPU wise, Hummingbird is running the same architecture ARM Cortex A8 at 1 GHz that we've seen in other SoCs. For now, the Fascinate's Hummingbird SoC with the PowerVR SGX 540 GPU is really what sets it apart. It's a significant improvement over the SGX 530/535, and if you haven't already, I'd encourage you to read what Anand had to say about it in the Epic review.

That improvement is readily apparent in Quake III, where the Fascinate posts unsurprisingly similar numbers to the Epic.

Likewise, we get similarly impressive Neocore numbers out of the Fascinate, which is Qualcomm's benchmark for showing off Adreno.

Though most of Android still can't take advantage of the SGX 540, applications that are rendered using OpenGL do show a massive performance boost. The qualitative difference between the stock Android gallery application on the Nexus One compared to the Fascinate is huge. On the Nexus One, it feels occasionally slow and choppy, yet on the Fascinate it's beyond smooth.

When the Android UI finally gets GPU acceleration, that huge performance gain will be readily apparent in everyday use instead of locked away for 3D apps and games.

Of course, our CPU-bound tests show almost exactly what you'd expect from a 1 GHz Cortex-A8. Bear in mind the Fascinate is running Android 2.1 as of these tests, but you can see how much Android 2.2 changes things - in some places.

As an aside, I talked in the Droid 2 article about how I didn't quite understand why Linpack performance on Android 2.2 on the OMAP 3620 SoC wasn't what I expected it to be. The comparison I was using was to all the smartphones I had previously seen with Android 2.2 - all of which were Qualcomm Snapdragon SoC based with Scorpion CPUs at the core. The Droid 2 was my first encounter with a relatively standard Cortex-A8 running Android 2.2 with the JIT/NEON optimizations.

As some of our readers noted, the reason that Linpack performance on the Droid 2 isn't as high is simple - Scorpion has faster FPU performance due to a 128 bit SIMD FPU datapath compared to Cortex-A8's 64 bit implementation. Both FPUs process the same SIMD-style instructions, the Scorpion just happens to be able to do twice as much, or optionally turn off half the datapath to save power.

The reason I bring this up is that we won't see as dramatic a change in benchmarks that are FPU/NEON heavy moving from Android 2.1 to 2.2 on the Fascinate. Modest gains are in order all around, but not the dramatic floating point performance boost that really doesn't translate into huge performance gains elsewhere.

I've also been doing the regular suite of page loading tests. Though the Fascinate lacks Flash and the faster browser that 2.2 brings, it renders pretty quickly: 

              

              

GPS Issues - Fix Times and SNR Speakerphone Volume and Battery Testing
Comments Locked

73 Comments

View All Comments

  • Brian Klug - Tuesday, October 5, 2010 - link

    Chemist1,

    I actually completely agree with you, 100%. When I joined on to tackle smartphones, my big objective has and still is to nail down testing for everything that's traditionally been subjective - battery life, screen quality, performance, signal strength, e.t.c, and make it just as objective as hardware reviews. Of course, audio (voice) quality is on that list as well.

    I've been grappling for some time on an ideal test methodology, one that would give a much better (objective) means of testing actual call quality than - it sounded good. I honestly couldn't agree more that this level of analysis is lacking. Unfortunately, until I've got that nailed down, it's really all I can say. What shape that takes is still up in the air.

    I've thought of recording the local ASOS weather station test call (which is so far what I use for measuring speakerphone volume) through both the line-out and speaker, then letting people compare those audio files directly. I've considered using some spectral analysis tools similar to determine the pass bandwidth of these phones (of course this would require some tweaking due to cellular latency and also a land line), and a few other things. If you or other commenters have suggestions, I'm more than all ears, seriously ;)

    I've actually done a fair amount of playing with CDMA voice codecs in the past - a number of WinMo devices would let you change from relatively-basic EVRC to better 13k voice codecs and a number of others. That kind of discussion and reporting about what codecs each device are using is where I'd like to go, getting that from Android sometimes is very difficult unfortunately. In fact, only device I've really seen that on so far is the EVO. I'd also like to eventually be able to characterize the difference between 1x voice, GSM and UMTS.

    There's a lot more we're trying to add for certain, I/we just have to figure out what the best way of testing those would be.

    -Brian
  • jasperjones - Tuesday, October 5, 2010 - link

    You may find this shocking but I highly doubt people will consider audio quality as important as you do when deciding for a smartphone.

    I faintly remember some study on what consumers are looking for in portable audio/MP3 players. Audio quality was NOT in people's top 5! Design, storage capacity, and three other things I cannot recall right now were more important to them. In an audio device!!

    So there you go.
  • chemist1 - Tuesday, October 5, 2010 - link

    jasperjones: Thanks for your comment. Well, one needs to be careful of these surveys, since small differences in wording can significantly change the outcome. But your point is well-taken: audio quality is not a top priority for consumers. Nevertheless, that's not to say that audio quality is of no interest to the majority of consumers, nor that it should not therefore be of significant interest to us. [Please see paragraphs 2 and 3 of my reply to kmmanety.]
  • MacTheSpoon - Wednesday, October 6, 2010 - link

    Audio quality matters to me, too, thanks for fighting the good fight, chemist1. ;)

    By the way, I own the phone and I have found the audio to be pretty good for calls so far. At least, I haven't found myself wishing the phone was louder or had any problems distinguishing speech.

    Listening to music with headphones...I don't have golden ears, and I don't know how it stacks up to a top mp3 player like a Cowon, but it's definitely not a low-end sound like my iPod Nano 4th Gen or my 2007 Macbook Pro, anyway.
  • strikeback03 - Thursday, October 7, 2010 - link

    Kinda like how in CNET reviews of point and shoot cameras image quality only accounts for something like 10% of their final score.

    Though a lot of consumers probably just assume audio quality is good enough. The majority are going to put compressed music on there anyway and then use cheap earbuds, so a lot of the audio quality discussion that goes on on tech sites is utterly irrelevant to the majority.
  • cwebersd - Wednesday, October 6, 2010 - link

    In addition to measurements of sound quality, how about a simple internal poll? Record sound samples of various phones, post them with obfuscated names for other staff members to listen to and have them judge intelligibility, clarity, harshness, etc. This should give you a decent sampling of real people's observations. Better than just your own.
  • dagamer34 - Tuesday, October 5, 2010 - link

    Brian, there are some JPEG artifacts in your gallery shots. I doubt the D80 has such visible artifacts on a downrezzed shot.
  • Brian Klug - Tuesday, October 5, 2010 - link

    Yeah unfortunately the gallery preview images are compressed even though I upload originals from all the cameras. If you click "View original size" you'll get the raw untampered JPEG though, complete with all the EXIF headers and everything you'd get from the camera. Unfortunately I can't control how the engine compresses those images for the gallery preview.

    -Brian
  • kmmatney - Tuesday, October 5, 2010 - link

    One problem is that the Audio quality changes so much with various factors (signal quality, the phone at the other end, etc..).

    I would disagree that that the main purpose of these phones is to actually be a "phone". No one cares that much about call quality when they are buying these phones - you just assume it will be acceptable.
  • softdrinkviking - Tuesday, October 5, 2010 - link

    Brian, even though there are many factors, I think you can do an, "all things being equal" type of test with a couple of variations.
    The data will still be meaningful when you are comparing it to other specific phones.

Log in

Don't have an account? Sign up now