Testing Methodology, Hardware Configurations

To start, we want to thank the many manufacturers who have donated kit for our test beds in order to make this review, along with many others, possible.

Thank you to OCZ for providing us with 1250W Gold Power Supplies.
Thank you to G.Skill for providing us with memory kits.
Thank you to Corsair for providing us with an AX1200i PSU and 16GB 2400C10 memory.
Thank you to ASUS for providing us with the AMD GPUs and some IO Testing kit.
Thank you to ECS for providing us with the NVIDIA GPUs.
Thank you to Corsair for providing us with the Corsair H80i CLC.
Thank you to Rosewill for providing us with the 500W Platinum Power Supply for mITX testing, BlackHawk Ultra, and 1600W Hercules PSU for extreme dual CPU + quad GPU testing, and RK-9100 keyboards.
Thank you to Gigabyte for providing us with the X5690 CPUs.

Also many thanks go to the manufacturers who over the years have provided review samples which contribute to this review.

Testing Methodology

In order to keep the testing fair, we set strict rules in place for each of these setups.  For every new chipset, the SSD was formatted and a fresh installation of the OS was applied.  The chipset drivers for the motherboard were installed, along with NVIDIA drivers then AMD drivers.  The games were preinstalled on a second partition, but relinked to ensure they worked properly. The games were then tested as follows:

Metro 2033: Benchmark Mode, two runs of four scenes of Frontline at 1440p, max settings.  First run of four is discarded, average of second run is taken (minus outliers).
Dirt3: Benchmark Mode, four runs of the first scene with 8 cars at 1440p, max settings.  Average is taken.
Civilization V: One five minute run of the benchmark mode accessible at the command line, at 1440p and max settings.  Results produced are total frames in sets of 60 seconds, average taken.
Sleeping Dogs: Using the Adrenaline benchmark software, four scenes at 1440p in Ultra settings.  Average is taken.

If the platform was being used for the next CPU (e.g. Maximus V Formula, moving from FX-8150 to FX-8350), no need to reinstall.  If the platform is changed for the next test, a full reinstall and setup takes place.

How to Read This Review

Due to the large number of different variables in our review, it is hard to accurately label each data point with all the information about that setup.  It also stands to reason that just putting the CPU model is also a bad idea when the same CPU could be in two different motherboards with different GPU lane allocations.  There is also the memory aspect to consider, as well as if a motherboard uses MCT at stock.  Here is a set of labels correlating to configurations you will see in this review:

CPU[+] [CP] (PCIe version – lane allocation to GPUs [PLX])

First is the name of the CPU, then an optional + identifier for MCT enabled motherboards.  CP indicates we are dealing with a Bulldozer derived CPU and using the Core Parking updates.  Inside the circular brackets is the PCIe version of the lanes we are dealing with, along with the lane allocation to each GPU.  The final flag is if a PLX chip is involved in lane allocation.

A10-5800K (2 – x16/x16): A10-5800K with two GPUs in PCIe 2.0 mode
A10-5800K (CP) (2 – x16/x16): A10-5800K using Core Parking updates with two GPUs in PCIe 2.0 mode
FX-8350K (2 – x16/x16/x8): FX-8350 with three GPUs in PCIe 2.0 mode
i7-3770K (3+2 – x8/x8 + x4): i7-3770K powering three GPUs in PCIe 3.0 but the third GPU is using the PCIe 2.0 x4 from the chipset
i7-3770K+ (3 – x16): i7-3770K (with MCT) powering one GPU in PCIe 3.0 mode
i7-3770K+ (3 – x8/x8/x8/x8 PLX): i7-3770K (with MCT) powering four GPUs in PCIe 3.0 via a PLX chip

Common Configuration Points

All the system setups below have the following consistent configurations points:

- A fresh install of Windows 7 Ultimate 64-bit
- Either an Intel Stock CPU Cooler, a Corsair H80i CLC or Thermalright TRUE Copper
- OCZ 1250W Gold ZX Series PSUs (Rosewill 1600W Hercules for The Beast)
- Up to 4x ASUS AMD HD 7970 GPUs, using Catalyst 13.1
- Up to 2x ECS NVIDIA GTX 580 GPUs, using GeForce WHQL 310.90
- SSD Boot Drives, either OCZ Vertex 3 128 GB or Kingston HyperX 120 GB
- LG GH22NS50 Optical Drives
- Open Test Beds, either a DimasTech V2.5 EasyHard or a CoolerMaster Test Lab

Configurations

An asterisk (*) indicates the new data for this update.

AMD

A6-3650 + Gigabyte A75-UD4H + 16GB DDR3-1866 8-10-10
A8-3850 + ASRock A75 Extreme6 + 16GB DDR3 1866 8-10-10
A8-5600K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
A10-5800K + Gigabyte F2A85-UP4 + 16GB DDR3-2133 9-10-10
X2-555 BE + ASUS Crosshair V Formula + 16GB DDR3 1600 8-8-8
X4-960T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
X6-1100T + ASUS Crosshair V Formula + 16GB DDR3-1600 8-8-8
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10
FX-8150 + ASUS Crosshair V Formula + 16GB DDR3-2133 10-12-11 + CP
FX-8350 + ASUS Crosshair V Formula + 16GB DDR3-2133 9-11-10 + CP

Intel

E6400 + MSI i975X Platinum + 4GB DDR2-666 5-6-6
*E6400 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*E6550 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
E6700 + ASUS P965 Commando + 4GB DDR2-666 4-5-5
*Q9400 + ASUS P965 Commando + 4GB DDR2-666 5-6-6
Xeon X5690 + EVGA SR-2 + 6GB DDR3 1333 6-7-7
2x Xeon X5690 + EVGA SR-2   + 9GB DDR3 1333 6-7-7
Celeron G465 + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i5-2500K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i7-2600K + ASUS Maximus V Formula + 16GB DDR3-2133 9-11-11
i3-3225 + ASUS Maximus V Formula + 16GB DDR3-2400 10-12-12
i7-3770K + Gigabyte Z77X-UP7 + 16GB DDR3-2133 9-11-11
i7-3770K + ASUS Maximus V Formula + 16GB DDR3-2400 9-11-11
i7-3930K + ASUS Rampage IV Extreme + 16GB DDR3-2133 10-12-12
i7-3960X + ASRock X79 Professional + 16GB DDR3-2133 10-12-12
*i7-4770K + Gigabyte Z87X-UD3H + 16GB DDR3-2400 10-12-12
*i7-4770K + ASUS Z87-Pro + 16GB DDR3-2400 10-12-12
*i7-4770K + MSI Z87A-GD65 Gaming + 16GB DDR3-2400 10-12-12

CPUs, GPUs, Motherboards, and Memory CPU Benchmarks
Comments Locked

116 Comments

View All Comments

  • yougotkicked - Tuesday, June 4, 2013 - link

    this sounds quite interesting, though I wonder if the AI is runtime bound rather than solution bound, as this could make the testing somewhat nondeterministic.

    To clarify what I mean; a common method in AI programming is to let algorithms continue searching for better and better solution, interrupting the algorithm when a time limit has passed and taking the best solution it has found so far. Such approaches can result in inconsistent gameplay when pitting multiple AI units against each other, which may change the game state too much between trials to serve as a good testing platform.

    Even if the AI does use this approach it may not bias the results enough to matter, so I guess the only way to be sure is to run the tests a few times and see how consistent the results are on a single test system.
  • Zoeff - Tuesday, June 4, 2013 - link

    Forget about SupCom2 - That game has been scaled down quite a bit compared to SupCom1 and isn't as demanding to CPUs. There's also an active SupCom1 community that has and still is pushing out community made patches. :-)

    SupCom actually has a build-in benchmark that plays a scripted map with some fancy camera work. Anyone can launch this by adding "/map perftest" to your shortcut. That said, it doesn't seem to be working properly anymore after several patches nor does it actually give any useful data as the sim score is capped at 10k for today's CPUs. And yet it's extremely easy to cripple any CPU you throw at it when simply playing the game. Just open up an 81x81km map with 7 AI enemies and watch your computer slow to a crawl as the map starts filling up.

    And yes, the AI is "solution bound". Replays of recorded games with AI in them wouldn't work otherwise.

    I wonder if somebody could create a custom SupCom1 benchmark... *Hint Hint*
  • FBB - Tuesday, June 4, 2013 - link

    They've had over 5 million concurrent online users. The total number will be much higher.
  • DanNeely - Tuesday, June 4, 2013 - link

    What exactly does Steam count as online? Does just having the client sit in my tray count; or do I need to be playing a steam game at the time to be counted?
  • wicko - Tuesday, June 4, 2013 - link

    Definitely just signed in: 823,220 Players In-Game | 4,309,324 Players Online
    Source: http://steamcommunity.com/
  • chizow - Tuesday, June 4, 2013 - link

    Thanks for the tests, there's a lot of data points in there so that's always appreciated.

    I would've liked to have seen some higher perf Nvidia solutions in there though, at the very least some Kepler parts. It looks like a lot of the higher end Intel parts hit a GPU bottleneck at the top, which is not unexpected at 1440p with last-gen Fermi parts.

    What it does show for sure is, you may give pause to going beyond 2-way CF/SLI if you have to go lower than x8 on that 3rd slot. Which means you will probably have to shell out for one of the pricier boards. Hard not to recommend X79 at this point for 3-way or higher, although the lack of official PCIe 3.0 support was a red flag for me.

    I went with the Gigabyte Z87x UD4 because I don't ever intend to go beyond 2-way SLI and the 3rd slot being x4 (2.0) was better than the x8/x4/x4 (3.0) config on most boards, which gives me the option to run a PhsyX card and retain x8/x8 (3.0) for my two main cards.
  • Gunbuster - Tuesday, June 4, 2013 - link

    So I'll stick with my 2600K @4.5ghz and continue to ponder what new Korean 27" LCD to get. Tech is pretty boring at the moment.
  • wicko - Tuesday, June 4, 2013 - link

    I haven't bothered overclocking my 2600K and I still feel it's plenty powerful. I think I may get a second GTX 670 though, Metro Last Light doesn't run all that great at 2560x1440.
  • kallogan - Tuesday, June 4, 2013 - link

    Haswell, haswell, haswell. Making one paper per day about it will not make it better. Boring cpu gen. Wake me up when something interesting shows up.
  • chizow - Tuesday, June 4, 2013 - link

    So I guess the solution is to just ignore the launch to placate all those who have no interest in the launch, rather than post reviews and info about it for the ones that actually do? Doesn't make a lot of sense.

    If it doesn't interest you, move along.

Log in

Don't have an account? Sign up now