Last week AMD pre-announced its next-generation EPYC processors, code-named Rome. These new processors are set to be officially announced next year, but will feature up to 64 cores using eight 7nm chiplets surrounding a central 14nm IO die. This week is the annual Supercomputing conference, focusing on high-performance computing, where all the big OEMs with server offerings as well as supercomputing centers get to promote their latest and greatest. One of them is the High Performance Computing Center based in Stuttgart, Germany, who disclosed some information about their new ‘Hawk’ system.

Supercomputers are measured in many metrics: processor type, cores, power, peak throughput, peak performance, interconnect, memory, and many others. The first supercomputer disclosed to be using AMD’s upcoming EPYC Rome processors is ‘Hawk’, based at HLRS, and set to be installed in 2019. The base systems will be developed by HPE, listed as HPE’s ‘Badger’ portfolio.

Details for Hawk were given by the HLRS Director, Prof. Michael Resch, at a talk at the AMD booth here at Supercomputing. The title of the talk was given as ‘AMD in a Large Scale Computing System for Science and Industry’, with a focus on HLRS as a local driving force for compute as well as the work it does. The requirements for the new Hawk system were listed as high performance, professional support/collaboration, lowest possible TCO, and high level of sustainability.

The key slide for us in the talk is this one.


The slide has EPYC misspelled in it, as it is misspelled in a number of places in the slide deck, along with other mistakes – the speaker’s first language is not English.

The slide describes Hawk as a 640,000 core system using 64-core Rome CPUs. That’s 10000 CPUs, listed at a throughput of 24.06 PetaFLOPs. That gives 2.4 TeraFLOPS per CPU, which at 16 SP flops/cycle, works out about correct for a 64 core CPU for the 2.35 GHz frequency mentioned in the slide. This would appear to be a base frequency, although AMD’s Naples processors do offer a ‘constant frequency’ mode to ensure consistent performance. Main memory was listed as 665 TB, with 26 PB of disk space. It was not disclosed the breakdown of how the disk is split between NAND and HDDs.

Unfortunately Prof. Resch was not available for additional questions.

Related Reading

Comments Locked

29 Comments

View All Comments

  • tygrus - Tuesday, November 13, 2018 - link

    Maybe its 16 single-precision FP ops per core per clock cycle (2x256b AVX ops per cycle)?
  • IntelUser2000 - Tuesday, November 13, 2018 - link

    No, Zen 2 architecture has 2 256-bit width vector units capable of FMA.

    2 x 4 DP Flops/cycle x 2 FMA = 16
  • Urthor - Tuesday, November 13, 2018 - link

    2.35ghz seems like it's a pretty good target number for AMD to have hit. A lot of people were thinking they might be sub 2ghz given the step up to 64 cores and the shiny new chiplet architecture.

    Delivering above expectations.
  • dazz112 - Tuesday, November 13, 2018 - link

    Total cost for this supercomputer is 38million euros (43million dollars) https://www.hlrs.de/whats-new/news/detail-view/201...
    Could the 10k cpus cost about 10-15million? That would be only $1000-$1500 for each Rome, sounds extremely cheap.
  • homey2 - Tuesday, November 13, 2018 - link

    I believe that is the cost for a 5,000-node cluster. So ~$3000 per Rome
  • Boxie - Tuesday, November 13, 2018 - link

    Volume pricing is a wonderful thing
  • Alexvrb - Tuesday, November 13, 2018 - link

    I guarantee you, major FLOPs.
  • evanh - Wednesday, November 14, 2018 - link

    Possibly. Or they've not filled all channels. I'd guess the latter due to very high DRAM pricing for the last year or so. About time DRAM prices went back to normal!
  • drajitshnew - Wednesday, November 14, 2018 - link

    Unfortunately, the wish for cheaper RAM seems likely not to materialize in the near future -- Samsung has already announced officially that they are cutting production to keep prices up and no one outside china has even plans for a new FAB.
    I have deferred purchases of new systems for almost an year now do to RAM costs
  • evanh - Wednesday, November 14, 2018 - link

    Possibly. Or they've not filled all channels. I'd guess it's the latter due to very high DRAM prices for the last year or two.

    Time for DRAM prices to return to normal!

Log in

Don't have an account? Sign up now