Some Test Cases

Our new benchmark wouldn't be very useful if we didn't have any test cases, would it? As we mentioned on the previous page, the average frames per second of a game might not reflect accurately what occurs in the game, even if the average results are very higher. Please note that we are anticipating a full benchmark of almost a dozen ATI and NVIDIA cards in the next few weeks - this is just a sample of what our benchmark utility is capable of. Both graphs below are taken with the same "radar" Wolfenstien radar timedemo.

Wolfenstien: Enemy Territory - GeForceFX 5950 Ultra

Wolfenstien: Enemy Territory - GeForceFX 5600SE

The graph below is just an overlay of the above two graphs.

Wolfenstien: Enemy Territory - Overlay

We can really see those dips in the graphs where some IO is occurring and bogging down the graphic cards. We have observed much unusual phenomenon on some of these demo graphs. One thing that we can immediately digest from the 5950 Ultra graph is the 90FPS ceiling - the card is more capable, but Wolfenstien is configured to limit the video card at 85FPS. Notice also that around the 73rd second, the FX5600 hits a local minimum while the FX5950 hits the 85FPS ceiling. We will discuss these sorts of details more with the preliminary video card roundup.

Oh, yes, and of course, we have this graph to show you too.

Wolfenstien: Enemy Territory Comparison

Average FPS graphs are fine, but if we really want to convey some thorough and hard data sampling, we have to use average FPS in conjunction with line plots.

Why Average Frames Per Second Can Be Misleading IQ Testing and Final Words
POST A COMMENT

23 Comments

View All Comments

  • yelo333 - Friday, September 24, 2004 - link

    #12, as they mentioned in the article, that was with FRAPS...FRAPS does not run on linux, and, IIRC, can give invalid results sometimes. The point of this tool was gpu benchmarking for linux. Only as a side note did they say they might port it to windows. Reply
  • AlphaFox - Friday, September 24, 2004 - link

    I recall seeing these graphs in past reviews, is this really new? Reply
  • yelo333 - Friday, September 24, 2004 - link

    Very nice work...nice to see some linux stuff going on here ;)

    Maybe this will invigorate ATI to make better drivers for linux...Image IQ + speed of drivers are terrible - In my informal tests on a radeon 9000np, the linux drivers have about 1/4 the image IQ/speed of the windows versions...
    Reply
  • Jalf - Friday, September 24, 2004 - link

    Wow, great work... :)
    So, now you just need to port it to Windows as well... ;)
    Reply
  • bdykes - Friday, September 24, 2004 - link

    Nice article! Is there any chance of making the benchmark tool available for download? :) Reply
  • bdykes - Friday, September 24, 2004 - link

    Reply
  • mercador - Friday, September 24, 2004 - link

    Anyone knows when it will be the next PC round up? Reply
  • mercador - Friday, September 24, 2004 - link

    Really good work, hope to see the mext round up, very anxious to choose a gfx card using your method

    Keep the good work
    Reply
  • sprockkets - Friday, September 24, 2004 - link

    Perhaps people need to know where OpenGL came from, hint, perhaps OPEN can help you with that. And then figure out that Linux can run OpenGL games just fine. Reply
  • appu - Friday, September 24, 2004 - link

    You guys are fantastic! Carry on the good work, and yes, I'm really looking forward to the final roundup. Reply

Log in

Don't have an account? Sign up now