Metro2033

Metro2033 is a DX11 benchmark that challenges every system that tries to run it at any high-end settings.  Developed by 4A Games and released in March 2010, we use the inbuilt DirectX 11 Frontline benchmark to test the hardware at 1920x1080 with full graphical settings.  Results are given as the average frame rate from 4 runs.

Metro2033 IGP, 1920x1080, All except PhysX

While comparing graphical results in the 5 FPS range may not seem appropriate, it taxes the system to its fullest, exposing whether at this high end memory actually makes a difference or if we are weighing on computation.  What we do see is a gradual increase in frame rate with each kit, up to 10% difference between the top end and the bottom kit.  The pivotal point of increase is from 1333 to 1866 – beyond 1866 our increases are smaller despite the increased cost of those kits.

Civilization V

Civilization V is a strategy video game that utilizes a significant number of the latest GPU features and software advances.  Using the in-game benchmark, we run Civilization V at 1920x1080 with full graphical settings, similar to Ryan in his GPU testing functionality.  Results reported by the benchmark are the total number of frames in sixty seconds, which we normalize to frames per second.

Civilization V IGP, 1920x1080 High Settings

In comparison to Metro2033, Civilization V does not merit a large % increase with memory kit, moving from 3% to 6.7% up the memory kits.  Again we do this test with all the eye candy enabled to really stress the CPU and IGP as much as we can to find out where faster memory will help.

Dirt 3

Dirt 3 is a rallying video game and the third in the Dirt series of the Colin McRae Rally series, developed and published by Codemasters.  Using the in game benchmark, Dirt 3 is run at 1920x1080 with Ultra Low graphical settings.  Results are reported as the average frame rate across four runs.

Dirt 3 IGP, 1920x1080, Ultra Low Settings

In contrast to our previous tests, this one we run at 1080p with ultra-low graphical settings.  This allows for more applicable frame rates, where the focus will be on processing pixels rather than post-processing with effects.  In previous testing on the motherboard side, we have seen that Dirt3 seems to love every form of speed increase possible – CPU speed, GPU speed, and as we can see here, memory speed.  Almost every upgrade to the system will give a better frame rate.  Moving from 1333 to 1600 gives us almost a 10% FPS increase, whereas 1333 to 1866 gives just under 15%.  We peak at 15% with the 2133 kit, but this reinforces the idea that choosing a 1600 C9 kit over a 1333 C9 kit is a no brainer for the price difference.  Choosing that 1866 C9 kit looks like a good idea, but the 2133 C9 kit is reaching the law of diminishing returns.

Market Positioning, Test Bed, Kit Order Gaming Tests: Portal 2, Batman AA, Overall IGP
Comments Locked

114 Comments

View All Comments

  • Peanutsrevenge - Friday, October 19, 2012 - link

    Thanks Ian.

    Well, except for making me feel ludicrously old, first memory kit of 4GB DDR2?

    Mine was back in SIMM days, when I think I added an 8MB 72pin stick to my existing 4MB stick.

    Although the external math co-processor might have come first.

    And I'm only 31.

    You shall now always be Dr Evil Cutress to me.
  • IanCutress - Friday, October 19, 2012 - link

    First *purchased* memory kit. I dealt with plenty of older memory thanks to hand me downs or prebuilt systems from my family at the time. I still have some SDRAM around somewhere, or some 8MB sticks of something or other. It's in a box under the desk ;)

    Haha, I've been called worse :D

    Ian
  • alpha754293 - Friday, October 19, 2012 - link

    I would have figured that with a memory test/benchmarking that you would be running Stream test.

    And with all this talk about the various latencies (measured in clock cycles) - a) a comparison should be given between the theorectical calculations and the actual performance and b) that you would think that you'd use something like lmbench in order to try to better quantify/test that (in addition to the actual games, tools, and applications).

    Most of the results are pretty much inconclusive since the standard deviation is within the margin of error.
  • IanCutress - Friday, October 19, 2012 - link

    Main reason is to steer away from synthetics. Synthetics frustrate me so - they will easily show the difference between a 1600 C9 and 2400 C10 kit, but what is that difference in real life? If latencies and burst speeds are x% difference in the synthetic, does that actually make a difference when playing Portal 2? Hence the requirement of this review to focus on the practical rather than the synthetic.

    Regarding being within standard deviations, the results you see are the culmination of multiple tests. The standard deviations are actually quite low as the results are enormously repeatable. I did a science doctorate, I make sure my numbers are valid.

    Ian
  • Tchamber - Friday, October 19, 2012 - link

    Back in 2009 I picked up a 3x2GB kit of Mushkin DDR3 1600 with timings of 6-7-6-18. Why don't we see low latency like that any more?
  • IanCutress - Friday, October 19, 2012 - link

    Those were linked to different types of memory chips at the time - the Elpida 'Hyper' ICs (http://www.anandtech.com/show/2799). Nice speeds, but high fail rates and low yields. They have been replaced by chips that are slightly slower, but a lot more reliable. Also to note that those Elpida Hyper kits worked great with Clarkdale and Nehalem, but are poor with Sandy Bridge and Ivy Bridge.

    Ian
  • CherryBOMB - Friday, October 19, 2012 - link

    Can you explain why you say Hyper' IC's are " are poor with Sandy Bridge and Ivy Bridge."
    As I stated "I have 16gb of the fastest money could buy around that era running on x79 @ 1666 6-6-6-18-1t right now."

    This was a tri channel run >
    http://www.overclock.net/t/872945/top-30-3d-mark-1...

    post #1054
  • IanCutress - Saturday, October 20, 2012 - link

    Because Hyper ICs fell out of favor, motherboard manufacturers are now reluctant to spend time in optimizing the Hyper IC kits to work with their systems. Thus the kits often have to fall back onto default settings, and they sometimes do not work. As one set of ICs is phased out, and new ICs come in, the newer ICs get priority.

    Ian
    PS. You'll find me on the overclock.net HWBot team :)
  • CherryBOMB - Friday, October 19, 2012 - link

    I have 16gb of the fastest money could buy around that era running on x79 @ 1666 6-6-6-18-1t right now.
    well over $1000 invested. Each 6gb kit was over $450 - bought the extra to future proof to quad lanes today.
    2x CMT6GX3M3A1600C6
    1x CMT4GX3M2A1600C6
    http://www.newegg.com/Product/Product.aspx?Item=N8...

    http://www.newegg.com/Product/Product.aspx?Item=N8...
  • saturn85 - Friday, October 19, 2012 - link

    how about adding a folding on cpu benchmark with different memory speed?

Log in

Don't have an account? Sign up now