Ashes of the Singularity Escalation

Seen as the holy child of DirectX12, Ashes of the Singularity (AoTS, or just Ashes) has been the first title to actively go explore as many of DirectX12s features as it possibly can. Stardock, the developer behind the Nitrous engine which powers the game, has ensured that the real-time strategy title takes advantage of multiple cores and multiple graphics cards, in as many configurations as possible.

As a real-time strategy title, Ashes is all about responsiveness during both wide open shots but also concentrated battles. With DirectX12 at the helm, the ability to implement more draw calls per second allows the engine to work with substantial unit depth and effects that other RTS titles had to rely on combined draw calls to achieve, making some combined unit structures ultimately very rigid.

Stardock clearly understand the importance of an in-game benchmark, ensuring that such a tool was available and capable from day one, especially with all the additional DX12 features used and being able to characterize how they affected the title for the developer was important. The in-game benchmark performs a four minute fixed seed battle environment with a variety of shots, and outputs a vast amount of data to analyze.

For our benchmark, we run a fixed v2.11 version of the game due to some peculiarities of the splash screen added after the merger with the standalone Escalation expansion, and have an automated tool to call the benchmark on the command line. (Prior to v2.11, the benchmark also supported 8K/16K testing, however v2.11 has odd behavior which nukes this.)

At both 1920x1080 and 4K resolutions, we run the same settings. Ashes has dropdown options for MSAA, Light Quality, Object Quality, Shading Samples, Shadow Quality, Textures, and separate options for the terrain. There are several presents, from Very Low to Extreme: we run our benchmarks at Extreme settings, and take the frame-time output for our average, percentile, and time under analysis.

All of our benchmark results can also be found in our benchmark engine, Bench.

MSI GTX 1080 Gaming 8G Performance


1080p

4K

ASUS GTX 1060 Strix 6G Performance


1080p

4K

Sapphire Nitro R9 Fury 4G Performance


1080p

4K

Sapphire Nitro RX 480 8G Performance


1080p

4K

AMD gets in the mix a lot with these tests, and in a number of cases pulls ahead of the Ryzen chips in the Time Under analysis.

CPU Gaming Performance: Civilization 6 (1080p, 4K, 8K, 16K) CPU Gaming Performance: Shadow of Mordor (1080p, 4K)
Comments Locked

347 Comments

View All Comments

  • launchcodemexico - Thursday, August 10, 2017 - link

    Why did you end all the gaming review sections with something like "Switching it to Game mode would have made better numbers..."? Why didn't you run the benchmarks in Gaming mode in the first place?
  • Ian Cutress - Thursday, August 10, 2017 - link

    Gaming mode is not default, and we run gaming mode alongside the default - there's two sets of values in each graming test.
  • DanNeely - Thursday, August 10, 2017 - link

    You might want to call that out more clearly in the text. I also missed that you have two sets of 1950X results; and probably wouldn't've figured out what the -G suffix meant without a hint.
  • Ian Cutress - Thursday, August 10, 2017 - link

    I mentioned it in the Game vs Creator mode page, but I'll propagate it through.
  • lordken - Thursday, August 10, 2017 - link

    read before you complain, it is stated at beginning of the review that -G is for game mode...
  • DanNeely - Thursday, August 10, 2017 - link

    Especially during the work day a lot of people just are doing quick glances at the most interesting parts. I'll end to end read it sometime tonight.
  • mapesdhs - Thursday, August 10, 2017 - link

    If people quick-glance, that's their problem for missing key info. :D When learning about something as new as this, I read everything. Otherwise, it's like the tech equivalent of crossing a road while gawping at a phone. :}

    Last time I read so much about a new CPU launch was Nehalem/X58.

    Ian.
  • smilingcrow - Thursday, August 10, 2017 - link

    It seemed really clear to me but for people who didn't read the long text on NUMA etc maybe not.
    The dangers of skimming!
  • mapesdhs - Friday, August 11, 2017 - link

    Indeed. :D Reminds me of when a long time ebay seller told me that long item decriptions are pointless, because most bidders only read the first paragraph, often only the first sentence.
  • Ian Cutress - Thursday, August 10, 2017 - link

    The test suite is a global glove: rather than have 20 tests for each segment, it's a global band of 80 tests for every situation. Johan does different tests as his office is several hundred miles away from where I am (and we're thousands of miles away from any other reviewer).

    For the gaming benchmarks, there are big differences in 99th percentile frame rates and Time Under analysis. As games become more and more GPU bottlenecked for average frame rates, this is where the differentiation point is. It's a reason why we still test 1080p as well. With regards the AI test, I've asked the Civ team repeatedly to make the AI test accessible from the command line so I can rope it into my testing scripts easily (they already do it with the main GPU test). But like many other game studios, getting them to unlock a flag is a frustrating endeavor when they don't even respond to messages.

Log in

Don't have an account? Sign up now