Metro2033

Metro2033 is a DX11 benchmark that challenges every system that tries to run it at any high-end settings.  Developed by 4A Games and released in March 2010, we use the inbuilt DirectX 11 Frontline benchmark to test the hardware at 1920x1080 with full graphical settings.  Results are given as the average frame rate from 4 runs.

Metro2033 IGP, 1920x1080, All except PhysX

While comparing graphical results in the 5 FPS range may not seem appropriate, it taxes the system to its fullest, exposing whether at this high end memory actually makes a difference or if we are weighing on computation.  What we do see is a gradual increase in frame rate with each kit, up to 10% difference between the top end and the bottom kit.  The pivotal point of increase is from 1333 to 1866 – beyond 1866 our increases are smaller despite the increased cost of those kits.

Civilization V

Civilization V is a strategy video game that utilizes a significant number of the latest GPU features and software advances.  Using the in-game benchmark, we run Civilization V at 1920x1080 with full graphical settings, similar to Ryan in his GPU testing functionality.  Results reported by the benchmark are the total number of frames in sixty seconds, which we normalize to frames per second.

Civilization V IGP, 1920x1080 High Settings

In comparison to Metro2033, Civilization V does not merit a large % increase with memory kit, moving from 3% to 6.7% up the memory kits.  Again we do this test with all the eye candy enabled to really stress the CPU and IGP as much as we can to find out where faster memory will help.

Dirt 3

Dirt 3 is a rallying video game and the third in the Dirt series of the Colin McRae Rally series, developed and published by Codemasters.  Using the in game benchmark, Dirt 3 is run at 1920x1080 with Ultra Low graphical settings.  Results are reported as the average frame rate across four runs.

Dirt 3 IGP, 1920x1080, Ultra Low Settings

In contrast to our previous tests, this one we run at 1080p with ultra-low graphical settings.  This allows for more applicable frame rates, where the focus will be on processing pixels rather than post-processing with effects.  In previous testing on the motherboard side, we have seen that Dirt3 seems to love every form of speed increase possible – CPU speed, GPU speed, and as we can see here, memory speed.  Almost every upgrade to the system will give a better frame rate.  Moving from 1333 to 1600 gives us almost a 10% FPS increase, whereas 1333 to 1866 gives just under 15%.  We peak at 15% with the 2133 kit, but this reinforces the idea that choosing a 1600 C9 kit over a 1333 C9 kit is a no brainer for the price difference.  Choosing that 1866 C9 kit looks like a good idea, but the 2133 C9 kit is reaching the law of diminishing returns.

Market Positioning, Test Bed, Kit Order Gaming Tests: Portal 2, Batman AA, Overall IGP
POST A COMMENT

112 Comments

View All Comments

  • RayvinAzn - Friday, October 19, 2012 - link

    You got a Core 2 Duo E6400 back in '05? That's rather impressive.

    Typo aside, good article, gives me quite a bit to think about as I plan to migrate to IB after a solid 6-year run on my P965/Q6600 setup. I'll definitely be sticking with a DDR3 1600 C9 kit after seeing these results, as anything faster doesn't really seem to affect most of the things I do.
    Reply
  • mapesdhs - Saturday, October 20, 2012 - link


    I just bought 64GB of DDR3/2400 more to make it easier to achieve the desired 2133 target
    speed with a CPU oc rather than any expected performance gain from using 2400. Although
    CL10 at 2400, it should be CL9 at 2300 (GSkill TridentX). It's for a system running After Effects,
    3930K, ASUS P9X79 WS. Quadro 4000, RAID, SSDs, etc. Plus, the price was basically identical
    to 2133 kits, so I figured what the heck, why not.

    Ian.
    Reply
  • Senti - Saturday, October 20, 2012 - link

    From the beginning it looked like great article, but then it become less and less meaningful.

    First of all, who in sane mind will get 4x4 for dual channel 1155 cpu when there are 8x2 kits available? If you want to test 4x4 so badly – use 4 channel 2011 cpu (but there is no igp there, duh).

    Second major problem is overclocking tests. Even if we put aside that Linpack is no memory stability test (for example Prime95 is far better for this), rising frequency without adjusting timings is completely meaningless if module already can't handle more aggressive timings at the same frequency.

    What would be really interesting is can we run DDR3-1600 9-9-9-24 module at DDR3-1866 9-10-9-28? Or at least DDR3-1866 10-10-10-28 and what is the difference to base settings and module that officially rated DDR3-1866.
    Reply
  • IanCutress - Saturday, October 20, 2012 - link

    -With 2x8GB kits, you often pay a premium (the next kit up for review is a 2x8GB kit). 4x4 GB kits apply both to 1155 and 2011, and represent the bulk of the kits advertised on Newegg, hence their inclusion here.

    - OCCT has a version of Linpack specifically for memory that requires high memory usage (as stated in the review, but I'm sure you read that). The overclocking tests are designed to show if the kits were higher binned parts rated lower - and in some circumstances they were. For example, the TridentX kits are getting rave reviews on overclocking websites, and the kits I have in all seem to easily push up another memory strap on Ivy Bridge. As always with overclocking, your mileage may vary. I could spend a week overclocking each kit, dealing with voltages and sub-timings then testing thoroughly for stability. But the truth of the matter is there is little point baring in mind the severity of not even applying XMP among gamers, and going by the actual improvements you see moving up from 1866C9 and beyond (unless you are an extreme overclocker looking for a higher number in a synthetic benchmark).

    Don't forget this is a review of the kits themselves more than just looking at what different speed memory does. I rarely run any memory kit out of specifications - only if the kit is not that compatible with the board I am using do I bump voltages, or competitive overclocking when I want a higher number. Everything else is XMP.

    Ian
    Reply
  • Senti - Saturday, October 20, 2012 - link

    Well, my life taught me that it's well worth reducing number of memory chips on each channel as there are cases when 2+ modules per channel won't run without errors even on native speed while there are no problems with 1 module per channel. There is also concern of extensibility, but I guess it's less relevant now when you are already getting 16GB of ram in desktop.

    I don't have experience with "tweaked" Linpacks, but I see no much reason for such tweaks as Prime95 already does the job well and in practice it's easier to get stability when different tests stress different parts.

    About overclocking – there is difference in my case. 48% faster memory (from native DDR3-1066) can be felt in practice without synthetics and games in unpractical settings.

    As for gamers that can't even apply XMP, I seriously didn't thought it was the primary intended audience of Anandtech... Also, gamers with 5 fps in Metro2033, lol.

    For review of the kits themselves it was ok, but again quite useless for me as besides overclocking what is really interesting is how well do chips of different brands do compared with each other on equal price points.

    Overall, take my comments not as nitpicking about particular things, but rather that I hope to see here more in-depth articles.
    Reply
  • IanCutress - Saturday, October 20, 2012 - link

    I've reviewed 60+ motherboards at AnandTech since I started, and I the only issues I have running certain memory depends on the motherboard and how the manufacturer has optimised reading XMP profiles (e.g. some motherboard partners do not have G.Skill as a preferred memory partner, and thus do not work with them). The only thing I ever do is bump up the IMC voltage a little, and that alone is quite rare. The only issue running four modules rather than two that normally presents itself is overclocking - this is why ASUS started using T-Topology for their memory sub-system in order to remove any signalling irregularities when pushing a full set of modules to the limits.

    I agree that moving above 1066 makes a difference. That's not a point of contention. If in the current climate the machine you run offers 1866+ and people are choosing 1066 MHz memory, then that is your decision.

    Regarding AnandTech audiences, we have a wide range, from gamers to enthusiasts to engineers and financiers wanting to justify purchases. I would suspect that a fair few readers here build machines for friends and family, and are in all sorts of stages of understanding the technology under their feet. Hopefully everyone is applying XMP.

    Regarding overclocking, as always your mileage may vary. This was shown deeply in my Ivy Bridge overclocking article - many users reported worse than what I achieved and some performed better. Getting a good processor or set of memory sticks is like a chocolate chip cookie - if you take one out of the packet, some may have more chocolate chips in than others. We always hope the ones we get have the most chocolate chips, but sometimes we do not. When going from 1600 C9 to 1866 C10 for the most part the price difference in these kits (as well as the performance difference) is minimal - the main difference will be if the sub-timings are scaled accordingly, either by the BIOS on automatic or left at XMP settings. People are fooled that more MHz means better performance. In a couple of other kits I have coming up for review, (2400 C11 and 2666 C11), we see this is not always the case.

    Ian
    Reply
  • Swede(n) - Saturday, October 20, 2012 - link

    I fail to see how much more percentage in real performance those memory's at different speed has, this in regards of how much the price is compare to the relative performance.

    Now, if I look at the different graphs I can see little or almost none real life app. performance benefit from going from a 1600 cl 9 memory and upwards.

    Instead the article fail to recognize the most frequent problem with fast memory's; instability and shortened life span of the memory controller if added multiple modules.

    Question: have this changed since the last memory test by AnandTech:
    Sandy Bridge Memory Scaling: Choosing the Best DDR3
    http://www.anandtech.com/show/4503/sandy-bridge-me...

    Sincerely,
    Reply
  • IanCutress - Saturday, October 20, 2012 - link

    Over my Z77/Ivy Bridge reviews I have used a quad module DDR3-2400 C9 kit throughout, without any reduction in stability from the IMC. In order to test what you ask would require a large sampling and long testing - one month on Prime95 at 50C ambient to burn out one processor IMC then move onto the next one. It isn't going to happen - not enough processors, and by the time the testing is complete the article wouldn't matter so much.

    With so many people in the world using modules, under all sorts of scenarios, yes things will happen and *some* trends could be construed from the data. We do not have access to the data, and thus 'the most frequent problem with fast memory is instability and shortened lifespan' is not the most frequent - it may be the problem you most hear about, but I bet you do not hear about the 100s of others that have no issue. We can't confirm that on our end, and we can't provide any numbers that do so as they are held tightly by the company that makes the memory.

    This is a review of memory kits, not an overview of fast memory, and such it has been treated that way and we draw the conclusions that we can from the results at hand. This is the difference between a scientific method and random stabs in the dark regarding what was posted on forums. I can confirm the former, but I'd steer away from the latter unless I could provide concrete numbers.

    In answer to your question - Sandy Bridge processors can handle up to 2133-2400 MHz memory, but Ivy Bridge can go one further in the fact that my processor can handle 2950 MHz or thereabouts. As a result, memory vendors bring out kits to sell at these higher frequencies. They need to be tested to let you guys and gals know if there is any reason to buy them, but first we need an overview to see where we stand. The article you link to is from a different editor at AT, and I needed a series of my own results for comparison (as well as confirming I had a proper set of benchmarks on my own end.)

    Ian
    Reply
  • Swede(n) - Sunday, October 21, 2012 - link

    Hi Ian, Thanks a lot for Your answer. That clarified things.
    Have a nice and relaxed day.

    Btw. I enjoy reading articles and reviews here at AnandTech since many years back and I think it is one of the very best sites out there.
    Sincerely
    Reply
  • JonnyDough - Monday, October 22, 2012 - link

    where are the non-overclocked, non-heatsinked modules? Reply

Log in

Don't have an account? Sign up now