HTC's Ultrapixels - Bucking The Trend

With the One, HTC has taken an incredibly daring direction for camera. Last year’s One X, One S, and rest of the One series included an ambitious F/2.0 system, discrete ISP, and set an impressive imaging baseline. A full year later, few of the major players are shipping an F/2.0 system (though Nokia will ship an F/1.9 system later this year and has the F/2.0 Lumia 920), but with the One, camera is even more of a serious emphasis. In fact, the camera in the One is surprisingly perhaps the most interesting and ambitious feature of all, outclassing even the unibody aluminum construction. The short list of features on the HTC One camera that make it unique are an F/2.0 system with larger than the norm 2.0 micron pixels, optical image stabilization (OIS), and a new revision of imagechip.

For years now, smartphone manufacturers have been moving to smaller and smaller pixels to increase the resolution of their cameras. It’s the megapixel race all over again, but in the smartphone platform. I gave a presentation at an industry event and laid out the general trends that I’ve seen smartphones taking for the past years. In general, there has been a progression from 1.75 micron pixels, to 1.4 micron pixels, now to 1.1 micron pixels on smartphone CMOS imagers. The result has been a steady increase in megapixels for the same 1/3” or 1/3.2” sensor size common for smartphones, from 5 MP to 8 MP to 13 MP, respectively, for those pixel sizes at the same optical format size. Conversely, OEMs can also deliver the same number of megapixels on a smaller and smaller sensor each generation, for example 8 MP at 1.4 microns on a 1/3.2“ sensor, or 8 MP at 1.1 microns on a 1/4” sensor. At the same time, smaller sensor means smaller z height required for the optics, which often is the thickest part of a design. There’s this constant battle between, you guessed it, industrial design and the camera system that goes in a smartphone.

Though improvements to quantum efficiency (think sensitivity, whether every photon is converted to an electron) at each successively smaller pixel size have mitigated some of the downsides from having smaller effective integration area for a pixel each time, there are still downsides to going smaller. Smaller pixels require an even better optical system to resolve that resolution, and already imaging onto pixels at 1.4 microns is really just oversampling. With the bayer color filter on top, you can make an argument that it isn’t really oversampling given the 2x2 nature of the array, but the reality is that we can’t image a spot onto a single 1.1µm pixel even with diffraction limited optics. Other downsides to smaller pixels are again a loss of sensitivity, partially from having a smaller integration area, partially from other things like the smaller active region for the sensor and a change in drive voltage. The other problem is loss of dynamic range before saturation occurs - already smartphones are operating with a dynamic range of around 5,000 photoelectrons. This means a very narrow range of brightnesses that can be represented inside the normal 10 bits of data shipped back from a given pixel at a given exposure.

The end result to this game is a ton of tradeoffs. In the case of the very high 13 MP cameras that are emerging today, we’re talking about an image that might not even be sharp outside in bright daylight if the optical system can’t resolve a high enough spatial frequency for the sensor, potentially very compressed dynamic range, and less and less sensitivity indoors in dim or low lighting. This year at the high end the trend is predominately 1.1 micron pixels, and basically any 13 MP camera you see in a smartphone is going to come with them. Likewise there’s a huge push for HDR this year in just about every mode (photos, videos, and panorama), and the reason is pretty much entirely to mitigate the fact that smartphone platform cameras just don’t have a lot of it before they saturate.

With the One camera, HTC has gone the other way entirely, instead moving up the scale to bigger 2.0 micron pixels while others move down to 1.1, while last year everyone primarily shipped at 1.4 microns. They’ve branded this the ‘UltraPixel sensor’, but really the important thing to think about is that the pixels are 4 square microns (2.0 x 2.0 micron) compared to the flavor-du-jour 1.21 square microns (1.1 x 1.1 micron) and thus have just over 3x the area. The result is, like anything else, a tradeoff but in the other direction - improved low light sensitivity and dynamic range at the expense of spatial resolution. At 1/3" sensor size, use of 2.0 micron pixels translates to 4.0 MP of resolution.

Smartphone Camera Comparison - 2013
  HTC One Samsung Galaxy S 2 Samsung Galaxy S 3 Samsung Galaxy S 4
Front Camera 2.1MP 2MP 1.9MP 2MP
Front Camera - CMOS OV2722
(1.4µm, 1/5.8")
- S5K6A3
(1.75µm, 1/6")
S5K6B2
(1.34µm, 1/6")
Front Camera - Focal Length ~1.59mm 2.73mm 2.7mm 1.85mm
Front Camera - Max Aperture F/2.0 F/2.8 F/2.8 F/2.4
Rear Camera 4MP 8MP 8MP 13MP
Rear Camera - CMOS ST VD6869
(2.0 µm, 1/3")
S5K3H2YX
(1.4µm 1/3.2")
Sony/Samsung
(1.4µm, ~1/3")
IMX135
(1.12µm, 1/3.")
Rear Camera - Focal Length 3.82mm
(28mm eff)
3.97mm 3.7mm 4.2mm
(31 mm eff)
Rear Camera - Max Aperture F/2.0 F/2.65 F/2.6 F/2.2

While some may decry the tradeoff of resolution for sensitivity and dynamic range, the reality is that we live in a world dominated by displays that are either 1080p, slightly above, or share via web-based services that dramatically downscale images for bandwidth reasons. The question is then how much resolution is really necessary given predominately electronic displays start to finish and lack of much printing or enlargement. At least for my workflow, 4 or 5 MP seems more than adequate for most sharing, especially if it’s sharp and ends up having good dynamic range, and that’s still enough resolution to downsample to 1080p and get an even sharper-looking image. There’s also a case to be made for storage requirements which are lighter and so on, but most of that is obvious. The benefits from having more sensor sensitivity are also immediate – no need to fire the distracting flash in a restaurant or at a party, shorter exposure times with less blurring, quicker follow up shots, more accurate preview, and so on.

When I heard that HTC was taking their camera this direction, I was incredibly excited. Not only is this completely bucking the camera trend that just about every other OEM seems satisfied with marching down just for marketability reasons, it’s actually sound science and possibly the best way to end the megapixel myth in the smartphone space. Unfortunately the flip side is that, obviously, HTC now has to fight the megapixel myth head on. This is incredibly difficult to market to most normal consumers since megapixels is just about the only parameter ever exposed to them, and marketing was probably the biggest problem with HTC’s lineup last year. Conveying the Ultrapixel message will require more than a branded name and carefully avoiding talking about the fact that the camera is 4.0 MP on the box or online specifications (as it is now), it will require real education and an active role in building credibility in the imaging space. It will also require real demonstrable benefits to consumers in use cases that matter to them.

Battery Life and Charging Still Camera Analysis
POST A COMMENT

626 Comments

View All Comments

  • TinCity - Tuesday, July 02, 2013 - link

    My mother just bought the HTC One and it is just awesome. Got her a case from Amazon and couldn't believe the discounts they have. I'm sharing this with everyone, here's a list of the cases with the biggest discounts and best reviews: http://amzn.to/1ayqnnq. Very Happy. Reply
  • Mdaf123 - Thursday, July 18, 2013 - link

    It sound weird question but does anyone know if this mobile has dual receiver such that it can measure 2g/3G at the same time without entering compressed mode? Reply
  • chanakyaz - Wednesday, July 24, 2013 - link

    This is what i just wrote in my facebook timeline when i shared this review..enough said, i guess! :-) "Darnnn, this is probably THE MOST detailed review I've seen on ANY kind of a gadget!! AMAZING ground work and research,Brian Klug!!!" Reply
  • chanakyaz - Wednesday, July 24, 2013 - link

    oh, btw..this is nothing to do with the gadget in question (HTC One) itself, cos I was already sold on it even before i started reading the review and now i can't wait to lay my hands on it! Reply
  • abye - Wednesday, July 31, 2013 - link

    the comparisons between the various phones with the differing angles / zoom etc. make it difficult to understand the true differences. In general the HTC one phones appear nearly as good as the Lumia 920 and in some specific cases much better than the 920. I'd go for the camera on the 920! Reply
  • Diorarat - Friday, August 02, 2013 - link

    I read a lot of comments about removable battery and SD card and frankly it's a problem that's not really a problem. People always say that removing the battery is a must but most of them never pulled out the battery even once. Let's be honest, it's too troublesome to swap batteries and charge the extra battery vs bringing a powerbank. Expandable memory is a joke to get people to buy 16gb models at the price of 32gb. 32gb is the sweet spot for me with games, movies and music. If I go out on a trip and want to bring a host of hd movies there's the other usb function which basically let's you watch media directly from a flash drive. I honestly don't see how you compare the one with the s4 or even the iphone. They're great phones but nothing that htc one brings to the table with the same buck. It has better screen and sounds. Software and camera is opinionated but you can't argue that hardware wise nothing comes close to it. Reply

Log in

Don't have an account? Sign up now