Benchmark Overview

For our testing, depending on the product, we attempt to tailor the presentation of our global benchmark suite down into what users who would buy this hardware might actually want to run. For CPUs, our full test suite is typically used to gather data and all the results are placed into Bench, our benchmark database for users that want to look at non-typical benchmarks or legacy data. For motherboards, we run our short form CPU tests, the gaming tests with half the GPUs of our processor suite, and our system benchmark tests which focus on non-typical and non-obvious performance metrics that are the focal point for specific groups of users.

The benchmarks fall into several areas:

Short Form CPU

Our short form testing script uses a straight run through of a mixture of known apps or workloads and requires about four hours. These are typically the CPU tests we run in our motherboard suite, to identify any performance anomalies.

CPU Short Form Benchmarks
Three Dimensional Particle Movement v2.1 (3DPM) 3DPM is a self-penned benchmark, derived from my academic research years looking at particle movement parallelism. The coding for this tool was rough, but emulates the real world in being non-CompSci trained code for a scientific endeavor. The code is unoptimized, but the test uses OpenMP to move particles around a field using one of six 3D movement algorithms in turn, each of which is found in the academic literature. 
The second version of this benchmark is similar to the first, however it has been re-written in VS2012 with one major difference: the code has been written to address the issue of false sharing. If data required by multiple threads, say four, is in the same cache line, the software cannot read the cache line once and split the data to each thread - instead it will read four times in a serial fashion. The new software splits the data to new cache lines so reads can be parallelized and stalls minimized.
WinRAR 5.4 WinRAR is a compression based software to reduce file size at the expense of CPU cycles. We use the version that has been a stable part of our benchmark database through 2015, and run the default settings on a 1.52GB directory containing over 2800 files representing a small website with around thirty half-minute videos. We take the average of several runs in this instance.
POV-Ray 3.7.1 b4 POV-Ray is a common ray-tracing tool used to generate realistic looking scenes. We've used POV-Ray in its various guises over the years as a good benchmark for performance, as well as a tool on the march to ray-tracing limited immersive environments. We use the built-in multi threaded benchmark.
HandBrake v1.0.2 HandBrake is a freeware video conversion tool. We use the tool in to process two different videos into x264 in an MP4 container - first a 'low quality' two-hour video at 640x388 resolution to x264, then a 'high quality' ten-minute video at 4320x3840, and finally the second video again but into HEVC. The low-quality video scales at lower performance hardware, whereas the buffers required for high-quality tests can stretch even the biggest processors. At current, this is a CPU only test.
7-Zip 9.2 7-Zip is a freeware compression/decompression tool that is widely deployed across the world. We run the included benchmark tool using a 50MB library and take the average of a set of fixed-time results.
DigiCortex v1.20 The newest benchmark in our suite is DigiCortex, a simulation of biologically plausible neural network circuits, and simulates activity of neurons and synapses. DigiCortex relies heavily on a mix of DRAM speed and computational throughput, indicating that systems which apply memory profiles properly should benefit and those that play fast and loose with overclocking settings might get some extra speed up.

 

System Benchmarks

Our system benchmarks are designed to probe motherboard controller performance, particularly any additional USB controllers or the audio controller. As general platform tests we have DPC Latency measurements and system boot time, which can be difficult to optimize for on the board design and manufacturing level.

System Benchmarks
Power Consumption One of the primary differences between different motherboads is power consumption. Aside from the base defaults that every motherboard needs, things like power delivery, controller choice, routing and firmware can all contribute to how much power a system can draw. This increases for features such as PLX chips and multi-gigabit ethernet.
Non-UEFI POST Time The POST sequence of the motherboard becomes before loading the OS, and involves pre-testing of onboard controllers, the CPU, the DRAM and everything else to ensure base stability. The number of controllers, as well as firmware optimizations, affect the POST time a lot. We test the BIOS defaults as well as attempt a stripped POST.
Rightmark Audio Analyzer 6.2.5 Testing onboard audio is difficult, especially with the numerous amount of post-processing packages now being bundled with hardware. Nonetheless, manufacturers put time and effort into offering a 'cleaner' sound that is loud and of a high quality. RMAA, with version 6.2.5 (newer versions have issues), under the right settings can be used to test the signal-to-noise ratio, signal crossover, and harmonic distortion with noise.
USB Backup USB ports can come from a variety of sources: chipsets, controllers or hubs. More often than not, the design of the traces can lead to direct impacts on USB performance as well as firmware level choices relating to signal integrity on the motherboard.
DPC Latency Another element is deferred procedure call latency, or the ability to handle interrupt servicing. Depending on the motherboard firmware and controller selection, some motherboards handle these interrupts quicker than others. A poor result could lead to delays in performance, or for example with audio, a delayed request can manifest in distinct audible pauses, pops or clicks.

Gaming

Our gaming benchmarks are designed to show any differences in performance when playing games. 

Board Features System Performance
Comments Locked

32 Comments

View All Comments

  • mkaibear - Monday, March 5, 2018 - link

    >dual Realtek audio chips

    Hrm

    >Killer based networking,

    Pass

    > and plenty of RGB LEDs to light up the case

    Hard pass
  • CheapSushi - Monday, March 5, 2018 - link

    Hating on Killer NICs has become a dumb meme. And guess what? The newer chips are often actual Intel. https://www.anandtech.com/show/12178/its-actually-...
  • mkaibear - Monday, March 5, 2018 - link

    I choose to "hate on them" because their USP is that they make the board somehow faster in online gaming, yet every independent test shows them to not do that - plus they increase the BOM significantly for no real benefit.

    The Killer chips on this board aren't Intel btw.

    (There's a bit of personal history involved too - I've had several machines with Killer networking chips and they've all had significant driver problems)
  • nevcairiel - Tuesday, March 6, 2018 - link

    Reputation is hard to fix, and if its just an Intel chip, whats the premium you get from those exactly?
    Personally I'll always prefer a board with plain Intel NICs, and WiFi on a PC board is meaningless to me anyway (the one you linked is Killer WiFi, not Ethernet)
  • Flunk - Tuesday, March 6, 2018 - link

    Still a waste of money on that BoM and you get the annoying Killer app.

    Something being mentioned in a meme (and all memes are dumb), doesn't make it untrue.
  • Pork@III - Monday, March 5, 2018 - link

    RGB LED give you +20 armor :D
  • 69369369 - Monday, March 5, 2018 - link

    RGB LED give me erection :D
  • PeachNCream - Monday, March 5, 2018 - link

    Yet another x299 motherboard review of yet another yawn-fest RGB and Killer NIC been there and done that also ran gaming product. What's missing here is a non-standard approach and reviews up and down the product stacks of various vendors. This is what happens when you rely exclusively on what companies are willing to send you for free in the mail. They spoon feed journalists a series of gaming-class products with stupid features so we readers rarely see any decent analysis on the wider cost ranges of boards out there because poor people like Joe end up wasting their time messing with boards that only a small number of people purchase. The same thing happens with phones, processors, GPUs, and so forth.

    I'm sorry if this sounds rude, but it's frustrating and makes this Peach not overly fond of tech journalism at large. Add that to the years of touting Rivet Networks Killer products without ever justifying it with a benchmark or two that demonstrates there's a reason for the boosting writers have to do and it the whole site feels disappointing even if there's value in other articles. I mean there's not even a networking benchmark at all so we can't even infer added value by comparing a Killer whatever to vanilla Intel using results elsewhere. If the opening shots of the article are going to cite networking connectivity, why isn't that given even a cursory examination in the subsequent pages? What's going on Anandtech?
  • Ian Cutress - Monday, March 5, 2018 - link

    Networking is extremely hard to get right as a test. It's easy to run it at peak speeds, but networks are rarely used in that instance.

    As for the marked benefit of Killer, it comes down to something not overly benchmarkable: online performance with concurrent data streams. If you are gaming, plus downloading, plus streaming, plus watching youtube on another monitor etc, the priority thing does its job. Most solutions are purely software-based - Killer's stuff is actually in hardware: for what isn't whitelisted, the packet analytics can work to decipher what sort of data is coming through, and from where: video, audio, direct downloads, torrents, and such all have detectable ways that the packet data is processed. Different codecs can have different packet profiles, and the Killer stuff is designed to detect them and adjust the return priority as appropriate. A packet will get tagged with a priority and sit in the incoming/outgoing queues, sometimes bypassing the queue altogether. Without deep networking knowledge, and hooks into the Killer hardware requirements, this is super difficult to benchmark. Unless you want a non-repeatable test with an uninterpretable result, or a repeatable test with no real-world value.

    I'd love to get some proper Killer testing in, combined with an interview with the CEO and CTO. I can just tell from the comments that it would be a piece that people come just to comment negatively, rather than read, because of the Killer experience in the past. It's a topic I've discussed with the Killer team on numerous occasions.

    As for the glut of X299 reviews, we have different reviewers for each chipset/socket: Joe on X299/Z370, Gavin on AM4, Tracy on TR4. Tracy has been waylayed due to lack of hardware, Gavin is new so getting up to speed, and Joe is powering through. Joe is only just moving to Z370 as well, and has a few of those already half-done.
  • timecop1818 - Monday, March 5, 2018 - link

    > I'd love to get some proper Killer testing in, combined with an interview with the CEO and CTO.

    Why not actually do that? I would come to read it and laugh at the graphs showing killer not excelling at anything in particular.

    I guess the reason there's not a killer nic review out there is because it would show how embarrassingly stupid the whole thing is, providing zero advantage at additional cost and actually making things worse by shitty drivers. I don't buy that QoS bullshit, Ian, you're not stupid, if some idiot is shittorenting on ADSL no amount of qos/killer is gonna make a difference when upstream is saturated. Most "gamers" that this is targeted at will either have appropriate broadband connection or be smart enough not to use bandwidth during their gaming sessions. Also with things like NAS etc having torrent/etc clients I just don't see many people using their primary gaming rig for downloading crap (or using shittorrent at all, i know i haven't for years).

    I was looking at buying new XPS13 from Dell, saw it had soldered (not socket) killer WiFi, passed it for another brand.

Log in

Don't have an account? Sign up now