HQV 2.0 Benchmarking

HTPC enthusiasts are often concerned about the quality of pictures output by the system. While this is a very subjective metric, we have decided to take as much of an objective approach as possible. Over the last year or so, we have been using the HQV 2.0 benchmark for this purpose.

The HQV 2.0 test suite consists of 39 different streams divided into 4 different classes. The playback device is assigned scores for each, depending on how well it plays the stream. Each test was repeated multiple times to ensure that the correct score was assigned. The scoring details are available in the testing guide on the HQV website.

We first played back the benchmarking clips off the Blu-ray, but the scores recorded below are for standalone M2TS playback using CyberLink PowerDVD 12. Our take is that it is standalone files (such as those taken using consumer camcorders and smartphones) which require video post processing more than the already carefully transferred Blu-ray content. If certain driver post processing features are available only for Blu-ray playback, then, it is as good as not being available for consumers to take advantage.

In the table below, we indicate the maximum score possible for each test, and how much the 7750 was able to get with AMD's Catalyst 12.1-based launch drivers.

 
AMD 7750 : HQV 2.0 Benchmark
Test Class Chapter Tests Max. Score Radeon HD 7750
Video Conversion Video Resolution Dial 5 5
Dial with Static Pattern 5 5
Gray Bars 5 5
Violin 5 5
Film Resolution Stadium 2:2 5 5
Stadium 3:2 5 5
Overlay On Film Horizontal Text Scroll 5 5
Vertical Text Scroll 5 5
Cadence Response Time Transition to 3:2 Lock 5 5
Transition to 2:2 Lock 5 5
Multi-Cadence 2:2:2:4 24 FPS DVCam Video 5 5
2:3:3:2 24 FPS DVCam Video 5 5
3:2:3:2:2 24 FPS Vari-Speed 5 5
5:5 12 FPS Animation 5 5
6:4 12 FPS Animation 5 5
8:7 8 FPS Animation 5 5
Color Upsampling Errors Interlace Chroma Problem (ICP) 5 2
Chroma Upsampling Error (CUE) 5 2
Noise and Artifact Reduction Random Noise SailBoat 5 5
Flower 5 5
Sunrise 5 5
Harbour Night 5 5
Compression Artifacts Scrolling Text 5 5
Roller Coaster 5 5
Ferris Wheel 5 5
Bridge Traffic 5 5
Upscaled Compression Artifacts Text Pattern 5 3
Roller Coaster 5 3
Ferris Wheel 5 3
Bridge Traffic 5 3
Image Scaling and Enhancements Scaling and Filtering Luminance Frequency Bands 5 5
Chrominance Frequency Bands 5 5
Vanishing Text 5 5
Resolution Enhancement Brook, Mountain, Flower, Hair, Wood 15 15
Video Conversion Contrast Enhancement Theme Park 5 5
Driftwood 5 5
Beach at Dusk 5 5
White and Black Cats 5 5
Skin Tone Correction Skin Tones 10 7
         
    Total Score 210 193

We were not able to match what AMD claimed. In all probability, the difference is in the chroma upsampling scores. We already covered this in the Llano review. To recap, the image below is a screen capture while playing the HQV benchmark clip from a Blu-ray ISO on the AMD A8-3850. Note that the light red fringes along the edgs are uniform and extend to the right and the left before tapering off.

Now, let us look at the screen capture when the M2TS is played back using PowerDVD 12 on the Radeon HD 7750.

Zoom into the red stripes on the third row (in the original screenshot) and you can see for yourself that we have some ghost samples extending above and below the actual line of pixels. The screenshot is not at the exact timestamp as that of the Llano sample reproduced above, but the reader should be able to get a general idea of the problem we are hinting at. Readers interested in finding out more about the source of this problem should read up this excellent piece to get more information.

We notified AMD about this issue during the Llano review, but action doesn't seem to have been taken even after 6 months on what is clearly a driver issue. Note that we are not using MPC-HC (which might introduce its own errors in the renderer) in this case, but a standard off-the-shelf commercial player in CyberLink PowerDVD 12. Hopefully, AMD wakes up to this issue soon.

HTPC Testbed & Software Configuration Custom Refresh Rates
Comments Locked

155 Comments

View All Comments

  • anactoraaron - Wednesday, February 15, 2012 - link

    What happened there at 1920x1200 for the 6870? 23.2 fps seems a bit off to me. I get a solid 60 just about everywhere (occasional dips to ~50) at 1080.

    I am so glad I bought a 6870 ICEQ a month ago. Got the email today that I will be getting my rebate so your point about getting a 6870 for 159 AR is absolutely true. And the ICEQ edition I have is rocking a 1000/1150 oc all day long 32c idle 69c load via furmark 15 min run. Best part is it's much quieter than a reference card.

    All of the 7xxx releases seem a bit lackluster to me.
  • Ryan Smith - Wednesday, February 15, 2012 - link

    I go over this a bit in the commentary for that benchmark, but basically the 1GB cards are running out of memory in that benchmark. For reasons I've yet to determine, even though the 7700 series cards still only have 1GB they are handling the situation better than the 6800 and 5700.
  • bazinga77 - Wednesday, February 15, 2012 - link

    first thing that should be pointed out is that i believe that the 7700 series cards that launched today only have a 128 bit memory interface so no one should expect miracles especially at higher resolutions. the memory bandwidth on x700 cards and lower has always held them back a little, where as nvidia for instance on their 550ti uses a 192 bit memory interface. if this card used a higher bandwidth memory it would do better. also the 79xx series from amd upped the bandwidth from the 69xx series from 256 bit to 384 bit which is probably one of the reasons it was so impressive.

    well the gtx 460 is starting to disappear and amd discontinued the 6850 and 6870 two months ago so once they are gone they are gone. this is directly from amd. so i think this card fits in nicely and i expect once the 7850 launches that the price of this card will drop. i think that the 7770 almost being as fast as the 6850 isn't all that bad, especially because of how cool it runs and it seems like the factory oc cards close that gap even closer. considering how much power some of these cards took a couple of generations ago it seems like we are making progress. once the 7850 launches, which i believe happens next month, i think it will be the card to get, just as the 6850 was.

    so all in all it seems like the 7770 will fit in nicely with a small price drop and and the discontinuation of some of the older amd and nvidia cards that has been happening, let alone taking into account the promotions we might see with rebates on these cards or bundled games etc.

    lastly the 7750 seems like it will now be the best card on the market that doesn't require an external power connector and it will come in at only about $10 more than the current champ in that arena. so it looks like a nice card for the casual gamer or someone looking for an htpc card and it looks like the encoding features of the 77xx cards are pretty great.
  • chizow - Wednesday, February 15, 2012 - link

    Like I said in the 7970 and 7950 review comments, the reality of the situation is only going to get worst as AMD reveals the rest of their 7-series product stack.

    Ryan I can tell you're doing your best not to be too hard on AMD but there comes a time we need to call a spade a spade. What AMD is doing here in terms of price and performance with the 7-series is easily the worst we've ever seen in the last decade from a new GPU architecture, especially considering they're also on a new process node.

    If/when Nvidia pulls an RV770 on AMD, I really hope you and the rest of the media is up to the task the same way they were with the GTX 280. I don't think you were head GPU editor at that time but I'm sure you remember the backlash.
  • jjj - Wednesday, February 15, 2012 - link

    So AMD either went stupid all of the sudden or they just can't produce enough cards yet and priced them to not sell.Either way,this is a mistake and they are only hurting their image (something they can't afford since Nvidia is still the stronger brand).
    Lets hope Nvidia wants market share and gives us something exciting soon.
  • stolid - Wednesday, February 15, 2012 - link

    Arg. Might as well hang on to my 5770's. :/
  • adonn78 - Wednesday, February 15, 2012 - link

    And these cards are supossed to be an upgrade over the 6000 series how?
  • Targon - Wednesday, February 15, 2012 - link

    There is still a 7800 series set of cards that we have not seen yet. We saw the 7900 cards, and now the 7700 series. The comparisons here are 7700 vs. 6800 series, and that is ONE issue.

    Price vs. performance is the primary issue that I can see, and TIME will hopefully bring down the prices to a reasonable level. I also hope/expect that there are reasons for the prices that will be fixed quickly, so will reduce the prices. We shall see, but if NVIDIA is having problems, it may be that AMD is giving NVIDIA a chance to come back, and is saving their next big performance jump for that release.
  • chizow - Wednesday, February 15, 2012 - link

    "Price vs. performance is the primary issue that I can see, and TIME will hopefully bring down the prices to a reasonable level."

    But that's exactly the problem, time hasn't brought price down to a reasonable level because we've already had 14+ months of this performance level at the same or better prices. AMD's pricing does nothing to shift the price performance metric and if anything, they are actually falling behind the curve a bit as you can get "old" parts that perform the same or better than these "new" ones at much lower prices.

    The 7800 series will only emphasize this point further with similar performance relative to the 6900 series, but at much worst prices. But that's the trickle down effect of pricing a new "high-end" flagship part that's only 15-25% faster than the last-gen at a 10% price hike. There just isn't much value derived as you go further down the ladder.
  • ET - Wednesday, February 15, 2012 - link

    This is disappointing, although I agree that the 7750 does have a place due to its low power. Let's see what NVIDIA will offer.

    The only ray of sunshine is that as always with a new architecture it takes a while for the drivers to take full advantage of the hardware, so it's possible to see performance improvements of tens of percents over time. Let's hope that's the case here.

Log in

Don't have an account? Sign up now