An even more updated Test Suite

In Part 1 we introduced our new test suite; this edition brings some refinements and four additions, but (believe it or not) it is still not complete. It isn't our goal to simply throw numbers into space and see what happens, so we are really focusing on honing our benchmarks to make them as robust and accurate as possible. As such, we have had to forgo a few additions that we really wanted to make, and we've had to drop one of the titles we had included in Part 1. This is how the new suite looks as things stand for this article:

Aquamark3

C&C Generals: Zero Hour

EVE: The Second Genesis

F1 Challenge '99-'02

Final Fantasy XI

GunMetal

Halo

Homeworld 2

Jedi Knight: Jedi Academy

Neverwinter Nights: Shadow of Undrendtide

SimCity 4

Splinter Cell

Tomb Raider: Angel of Darkness

Tron 2.0

Unreal Tournament 2003

Warcraft III: Frozen Throne

Wolfenstein: Enemy Territory

X2: The Threat

Our previous Flight Simulator benchmark just didn't push the game far enough, and we are hard at work trying to find a benchmark that better reflects gameplay and is completely repeatable. We have really appreciated your feedback, and we ask that you continue to suggest games for possible inclusion in the suite. Just so you'll know what we already have slated to make it in "When their done" (to borrow from 3DRealms), these games will be added either as we finalize a benchmarking procedure for them or as they are released:

Doom3

MS Flight Simulator 2004

Battlefield 1942: Secret Weapons of WWII

Halflife 2

FIFA Soccer 2004

We wanted to include Battlefield in this review unfortunately we were still unable to come up with a repeatable test to include. We have looked at other tests on the net and would rather use something a bit more scientific if possible but it's going to take some more time. If anyone from the Battlefield community has any suggestions on how to reliably benchmark the game, we're all ears.

 

As we received some criticism that the CPU we used in Part 1 wasn't fast enough, we upgraded our testbed for Part 2; the test system we used is as follows:

AMD Athlon64 FX51

1GB DDR400 (2x512MB)

nForce3 motherboard

With all of that out of the way, it's time to get to the benchmarks…

Index Aquamark3 IQ
Comments Locked

117 Comments

View All Comments

  • Anonymous User - Wednesday, October 8, 2003 - link

    I'm impressed. I've never seen a review that actually has the games I play most frequently in it. I've been un-interested in FPS games since Quake II.

    In particular, I like Neverwinter Nights, C&C Generals, SimCity 4, and to some extent WarCraft III (and by extention, their expansions). I was under the impression that SimCity 4 was CPU bound under almost all circumstances, it's useful to have that shot down.

    I also like AA and AF. You can imagine the slideshows I play with my Athlon 2100+, 1GB DDR, and Radeon 64MB DDR (a.k.a. 7200)

    Now I just need to see the ATI AIW 9600 Pro reach general availability.
  • Anonymous User - Tuesday, October 7, 2003 - link

    Thank you so much for this review... the detail is spectacular. After reading and lookig at all 60 pages... I am really tired. Thanks again for your dedication!
  • Anonymous User - Tuesday, October 7, 2003 - link

    Um why are there no comparisons using two monitors with diffrent cards running . Gabe of valve said there is a set of drivers that detect when an screen shot is being taken. Or did anand just get duped by nvidia
  • Anonymous User - Tuesday, October 7, 2003 - link

    I would like to know:

    1. Why fps was left out of TRAOD
    2. Why the weirdo never seen before TRAOD PS2.0 percent loss graph? How about giving us good ole fps which is what we have been seeing for years and what we are use to, at least have both if you are going to introduce new graphs.

    3. How the reveiwer seems to know "Nvidia is aware of it" and never seems to know if ATI is aware of problems? I mean he would have had to talk to Nvidia to know this. Did Nvidia pre read the review and then tell him they are aware of a problem and will fix it??

    4. What motiviation does the reviewers have for helping Nvidia or at least seem optimistic. What has Nvidia done to earn this tip toeing around type of review? If anyting they have dug themselves a well deserved hole. I'm talking about Nvidias horrid behaviour as a company in the past 6 months. Why would they reward a company that pulls the stunts they have lately? Do they feel sorry for them?

    All I can say is the tone of this review leads me to think there is more to this than meets the eye.



  • Anonymous User - Tuesday, October 7, 2003 - link

    #52 yeah im sure people play games in window mode.
    How can u see the differences from such a small screen shots. Its well known that Nvidia hacks or shall I say "optimises" for benchmarks giving no thought to IQ. This article displays Blatant nvidia @ss kissing. There was good reason Gabe didn't want his game to be benched with det.50xx, take a guess, more hackery from nVidia. Also Anand mentions certain anomalties with the geforce fx on certain games but does not try to exlpore what those errors are and assumes nothings wrong. In homeworl the Fx isn't even doing FSSA. Geez wish the nvidia fanboys would get a clue and crawl out from under that rock the've been hiding under.
  • Anonymous User - Tuesday, October 7, 2003 - link

    This is the most interesting article I have ever read for sometime.. First of all, I agree with #41.. I think including this many games into benchmark prohibits Anand/Derek to make detailed analysis of the games.. But there is something more interesting..

    It seems that Anand and Derek tried to put an article that hides the problems with both cards.
    They also deliberately try to avoid giving one company favor. In one sentence, they claim ATI is best, in the next line, they state otherwise.
    As for the IQ comparison, many of screen captures are either dark or can not reflect what AF+AA intended to do.. If I just check the small pictures, I would say that the IQ are really similar. However, more detailed analysis reveals other problems. Besides, the review of the TROAD is the wrost I have ever seen.. If they post the frame rates, I am pretty sure that everybody will be shocked to see the results.. How won't they.. Think about it, the performance percentage loss of FX5950 is 77.5% for 1024x768 noAA/AF. Even if the game runs at 50 fps with PS1.1, the frame rate would drop to 10 fps when you switch to ps2.0 in this case.. However, refering to Beyond3d is interesting, because that site has a very detailed benchmarks of both 5900 and 9800 with this game ( I strongly recommend to anyone to see these articles who really wants to learn the actual performance of NV5900 and R9800 in the PS2.0 scenarios)

    But I totally disagree with Anand in one thing.. TROAD performance is a real indicator for the future games that will uses PS2.0 by default. The games v49 patch also uses HLSL to compile directly to ps2_0_x which is actually the Nvidia's NV30 architecture, and the compiled code runs faster than Cg compiled code. Even in this case, 9800Pro still runs much faster that 5900 ( I am talking about 70 fps vs. 35 fps.).

    I guess nobody want to see that his/her 500$ graphics card would crawl in the new games which uses ps2.0 by default just one year after he puchased the card.. And no! I am not a ATI fanboy.. Just a tech fan who does not tolerate to see how some sites really misdirects the readers because of their connections to the IHVs.
  • Anonymous User - Tuesday, October 7, 2003 - link

    Oh, come on, fanboys, stop yelling at Anand for not making nVidia look bad enough. His job is to benchmark, not to rant. Jesus Christ, you people annoy me. Try printing out the three images from any given test WITHOUT looking at which one's the Radeon.

    And no, I'm no nVidia fanboy, nor am I defending nVidia. I use a softmodded Radeon 9500 and I absolutely love it. I have never, ever put a GeForce FX in my system, and I'm happy to say this. But can't you people just let go?
  • Anonymous User - Tuesday, October 7, 2003 - link

    FIFA 2004 !!! That alone make this worth while !!!
  • Rogodin2 - Tuesday, October 7, 2003 - link

    You should use IL-2 Forgotten Battles with "perfect" detail settings (pixel shaded water and a system knee-bringer) for a simulation benchmark.

    rogo
  • Dasterdly - Tuesday, October 7, 2003 - link

    I could see IQ differences on the dune buggy left side top. The ATI pic has better detail.

    Please add 3dmark benchmark.

    Good review so far almost 1/2 way thru :)

Log in

Don't have an account? Sign up now