The L4-cache and Memory Subsystem

Each POWER8 memory controller has access to four "Custom DIMMs" or CDIMMs. Each CDIMMs is in fact a "Centaur" chip and 40 to 80 DRAM chips. The Centaur chip contains the DDR3 interfaces, the memory management logic and a 16 MB L4-cache.

The 16 MB L4-cache is eDRAM technology like the on-die L3-cache. Let us see how the CDIMMs look in reality.

Considering that 4Gb DRAM chips were available in mid 2013, the 1600 MHz 2Gb DRAM chips used here look a bit outdated. Otherwise the (much) more expensive 64GB CDIMMs use the current 4Gb DRAM chips. The S822L has 16 slots and can thus use up to 1TB (64GB x 16) in DIMMs.

Considering that many Xeon E5 servers are limited to 768 GB, 1 TB is more than competitive. Some Xeon E5 servers can reach 1.5 TB with 64 GB LR-DIMMs but not every server supports this rather expensive memory technology. It is very easy to service the CDIMMs: a gentle push on the two sides will allow you to slide them out. The black pieces of plastic between the CDIMMS are just place-holders that protect the underlying memory slots. For our testing we had CDIMMs installed in 8 of our system's 16 slots.

The Centaur chip acts as a 16MB L4-cache to save memory accesses and thus energy, but it needs quite a bit of power (10-20 W) itself and as a result is covered by heatsink. CDIMMs have ECC enabled (8+1 for ECC) and have also an extra spare DRAM chip. As result, a CDIMM has 10 DRAM chips while offering capacity of 8 chips.

That makes the DRAM subsystem of the S822L much more similar to the E7 memory subsystem with the "Scalable memory interconnect" and "Jordan Creek" memory buffer technology than to the typical Xeon E5 servers.

Inside the S822L: Hardware Components Benchmark Configuration and Methodology
Comments Locked

146 Comments

View All Comments

  • Mondozai - Friday, November 6, 2015 - link

    That's too bad. Over 90% of the world population exists outside of it and even if you look at the HPC market, the vast majority of that is, too.

    The world doesn't revolve around you. Get out of your bubble.
  • bji - Friday, November 6, 2015 - link

    He never claimed the world revolved around him, he just made a true statement that may be worth consideration. Your response is unnecessarily hostile and annoying.

    I would expand Jtaylor1986's statement: I believe that most if not all native English speaking populations use commas for thousands grouping in numbers. Since this site is written in English, it might be worthwhile to stick to conventions of native English speakers.

    It's possible that there are many more non-native English speakers reading this site who would prefer dots instead of commas, but I doubt it. Only the site maintainers would know though.
  • Jtaylor1986 - Friday, November 6, 2015 - link

    You read my mind :)
  • mapesdhs - Tuesday, November 10, 2015 - link

    Talking to numerous people around Europe about tech stuff, I can't think of any nation from which someone used the decimal point in their emails instead of a comma in this context. I'd assumed the comma was standard for thousands groupings. So which non-US countries do use the point instead? Anyone know?
  • lmcd - Friday, November 6, 2015 - link

    Cool on the rest of the world part, but the period vs comma as delimiters in the world numeric system ARE backward. In language (universal, or nearly), a comma is used to denote a pause or minor break, and a period is used to denote the end of a complete thought or section. Applied to numerics, and you end up with the American way of doing it.

    ^my take
  • JohanAnandtech - Saturday, November 7, 2015 - link

    Just for the record, this was not an attempt to nag the US people. Just the mighty force of habit.
  • ZeDestructor - Saturday, November 7, 2015 - link

    For future use: just use a space for thousands seperation (that's how I do it on anything that isn't limited to a 7seg-style display), and confuse readers by mixing commas and periods for decimals :P
  • tygrus - Sunday, November 8, 2015 - link

    I like to use a fullstop for the decimal point, an apostrophe for the thousands separator, a comma for separating items in the list, don't start a sentance with a digit.
    One list of numbers may be : 3'500'000, 45.08, 12'500.8, 9'500. Second list : 45'000, 15'000, 25'000. We use apostrophes when we contract words like don't so why not use it for contracting numbers where we would otherwise have the words thousand, millions, billions etc ?
  • mapesdhs - Tuesday, November 10, 2015 - link

    I have a headache in my eyeballs! :D
  • ws3 - Friday, November 6, 2015 - link

    North America is on the majority side on this issue. Asia, in particular, is almost completely on the side of using a dot as the decimal separator and a comma to put breaks in long numbers.

    Get with the program Europe. The world doesn't revolve around you!

Log in

Don't have an account? Sign up now