Who Scales: How Often?

A major topic in the multiGPU arena is software support. And there are two large factors here: how many titles benefit and how much do those titles benefit. In the past we've seen SLI provide scaling more frequently and consistently than CrossFire (especially right when games come out). With CrossFire we'll often see support for older games get broken in newer drivers and then fixed when a review site happens to stumble upon the issue. But we've also noted that when CrossFire worked, it worked really well. It's honestly been a long time since we did a quantitative analysis of how SLI and CrossFire really stack up as technologies, and there's no time like the present.

First we will explore whether performance scaling happened in our suite of games. We've looked at two different metrics to judge our cards, both of which look at percent increase from 2 GPUs. If we consider the success of a multiGPU solution to be contingent on a performance improvement of at least 30% out of a possible 100%, we can count the number of times we see success in our benchmarks as a benchmark. We ran 21 different tests (7 games at 3 different resolutions), so keep that in mind when looking at this of list successes per configuration.

NVIDIA GeForce GTX 285 17
NVIDIA GeForce GTX 280 18
NVIDIA GeForce GTX 260 20
NVIDIA GeForce 9800 GTX+ 19
ATI Radeon HD 4870 512MB 17
ATI Radeon HD 4850 19
ATI Radeon HD 4870 1GB 16

Since this takes into account CPU limited cases, our higher performance SLI and CrossFire solutions will see cases where 1680x1050 or even 1920x1200 isn't a high enough resolution to allow for any real improvement. Cards that look good by this metric are ones that both scale well and start off at a low enough performance point so as to allow good scaling to happen even at lower resolutions (well, lower for multiGPU application anyway). This shows the GTX 260 and the 4850 hit a sweet spot in terms of scaling and baseline performance in modern games to provide benefit for a larger number of users (many more people have 1680x1050 and 1920x1200 than 2560x1600 monitors). Because this 9800 GTX+ is older, we see headroom here too.

If we exclude the simply CPU limited cases and look at cases where the multiGPU solution got near zero or negative performance improvement we see a slightly different picture. Our data is on a per game basis, so all of these numbers are out of 7.

NVIDIA GeForce GTX 285 7
NVIDIA GeForce GTX 280 7
NVIDIA GeForce GTX 260 7
NVIDIA GeForce 9800 GTX+ 6
ATI Radeon HD 4870 512MB 6
ATI Radeon HD 4850 5
ATI Radeon HD 4870 1GB 7

This shows cases where certain multiGPU configurations have zero value to help improve performance because of some failing of the graphics solution. All these cases happen to be issues at 2560x1600 where the resolution proved too much to handle because of the limited amount of onboard RAM.

It's also important to point out that the Sapphire 4850 X2 doesn't suffer from the problems of the 4850 CrossFire we show here. The Sapphire card scales and performs well in every test we ran.

Index Who Scales: How Much?
Comments Locked

95 Comments

View All Comments

  • DerekWilson - Monday, February 23, 2009 - link

    It really is a great looking game for an MMO. It's not the most played MMO around, but it is definitely the easiest to test. There is an area near the beginning where the player is alone in the environment and it's always the same time of day and all that stuff ... It takes out some of the factors that make getting consistent data out of other MMOs incredibly difficult.

    I've never had any real "issues" with it or with the results either. It's been very consistent as well. It does add value, and it's clear that games can be coded in a way that looks really good and perform like this one, so we feel it's important to getting a better feeling for what's out there and what's possible.
  • IKeelU - Monday, February 23, 2009 - link

    Not really a big deal, but could you cut out the offhand game review comments when introducing benchmarks? I.e.: "Crysis Warhead, while not the best game around..." It feels out of place in a hardware analysis.
  • SiliconDoc - Wednesday, March 18, 2009 - link

    And Derek disses Far Cry 2 and Oblivioin where nvidia slaughters ati - then derek praises Bioshock where ati has an edge.
    Derek CAN'T HELP HIMSELF.
  • SiliconDoc - Wednesday, March 18, 2009 - link

    Oh yes, and below don't forget the age of conan that favors the ati card - Derek can't stop drooling all over the place.
    Then come to COD, where nvidia once again slaughters - red blood everywhere - Derek says "do we really need another war game~" or the like.
    Derek is red fan central and cannot stop himself.
  • The0ne - Monday, February 23, 2009 - link

    This game is poorly programmed in the first place, does it deserve to even be included in the benchmark tests? Yes, it has the programming necessary to for the test but they're poorly programmed.
  • IKeelU - Monday, February 23, 2009 - link

    The fact that CryEngine 2 is taxing on today's hardware (and that Crytek will no doubt use derivatives of it in future games), makes it very useful in benchmarks. I hope reviewers keep using it. But by all means, feel free to disassemble Crytek's binaries and point out their code's weaknesses.

    Yeah, I thought not.
  • poohbear - Wednesday, February 25, 2009 - link

    what do u mean they shouldnt include crysis warhead??? its the seminal game to see how graphics performance is to get an idea of how a particular video card will perfrom in the future. Cryengine2 is the most advanced graphics engine on the market. If a video card can provide 30 fps on a cryengine @ your resolution, then its good to last u for atleast 2 years.
  • Razorbladehaze - Wednesday, February 25, 2009 - link

    Yeah.... NO.

    I totally disagree with it being the most advanced. It is a decent game engine especially for benchmarking, but....

    In all reality the STALKER Clear Sky revamped xray engine is far and away more advanced and superior in almost every way. It is about the same or better in regards to taxing the system (low frame rates does not necessarily translate to the game is taxing the system.). Being that these are also used in similar FPS titles they would make a interesting comparrison.

    I would really like to see Anand include or swap a clear sky bench (there is a premade one available), for the Crysis or Crysis warhead. Either way no big deal many other sites post results with a CS bench that view all the time.

  • DerekWilson - Monday, February 23, 2009 - link

    i'll take care of it.
  • Stillglade - Monday, February 23, 2009 - link

    I would love to see more info about the 4850 X2 1GB version. For over $50 cheaper, is the 1GB memory enough to compete? Is it worth paying 24% more for the 2GB version that you reviewed here?

Log in

Don't have an account? Sign up now