Testbed Setup and Testing Methodology

Thunderbolt's adoption, till now, has mainly been driven by the Mac ecosystem. Solutions for DIY PC enthusiasts are not widespread. GIGABYTE has a few motherboard models with Thunderbolt integrated, while Asus's Thunderbolt-capable motherboards need an add-on PCIe card. Our Windows-based testbed for direct-attached storage (DAS) systems is based on the latest Z97 chipset from Intel. The build originally started out as a multimedia editing machine. The requirements of a DAS testbed fit in nicely with the original purpose of the build. The following table details the configuration of our testbed.

AnandTech DAS Testbed Configuration
Motherboard Asus Z97-PRO Wi-Fi ac ATX
CPU Intel Core i7-4790
Memory Corsair Vengeance Pro CMY32GX3M4A2133C11
32 GB (4x 8GB)
DDR3-2133 @ 11-11-11-27
OS Drive Seagate 600 Pro 400 GB
Optical Drive Asus BW-16D1HT 16x Blu-ray Write (w/ M-Disc Support)
Add-on Card Asus Thunderbolt EX II
Chassis Corsair Air 540
PSU Corsair AX760i 760 W
OS Windows 8.1 Pro
Thanks to Asus and Corsair for the build components

We decided to prepare the testbed with 32 GB of memory in order to make a large enough RAM drive available for our file copy tests. Similar to our NAS testbed, we used OSFMount to allocate 20 GB of the DRAM for a RAM disk partition.

The internal layout of the Z97-Pro (Wi-Fi ac) board is presented below.

It should be noted that the Thunderbolt add-on card can only be connected to PCIe lanes hanging off the PCH (and can't be connected directly to the CPU). Apparently, this is a requirement for vendors to obtain Thunderbolt certification from Intel. In the above layout, we see that the add-on card can only go to the bottom PCIe slot (PCIEX16_3). In addition to the hardware restriction, the BIOS actually operates this slot in x1 mode, with the other three lanes being shared with the ASMedia USB 3.0 ports in the rear panel and the x1 PCIe slot (PCIE X1 SLOT4). The BIOS setting was altered to operate the x16 slot in x4 mode (maximum possible bandwidth for the card). The BIOS entry also has a PCIe cache line setting for Thunderbolt. It was left at 32 bytes (the default) for our evaluation.

Our testing methodology for DAS units takes into consideration the usual use-case for such devices. The most common usage scenario is transfer of large amounts of photos and videos to and from the unit. The minor usage scenario is importing files directly off the DAS into a multimedia editing program such as Adobe Photoshop.

In order to tackle the first use-case, we created three test folders with the following characteristics:

  • Photos: 15.6 GB collection of 4320 photos (RAW as well as JPEGs) in 61 sub-folders
  • Videos: 16.1 GB collection of 244 videos (MP4 as well as MOVs) in 6 sub-folders
  • BR: 10.7 GB Blu-ray folder structure of the IDT Benchmark Blu-ray (the same that we use in our robocopy tests for NAS systems)

For the second use-case, we take advantage of PC Mark 8's storage bench. The storage workload involves games as well as multimedia editing applications. The command line version allows us to cherry-pick storage traces to run on a target drive. We chose the following traces.

  • Adobe Photoshop (Light)
  • Adobe Photoshop (Heavy)
  • Adobe After Effects
  • Adobe Illustrator

Usually, PC Mark 8 reports time to complete the trace, but the detailed log report has the read and write bandwidth figures which we present in our performance tables. Note that the bandwidth number reported in the results don't involve idle time compression. Results might appear low, but that is part of the workload characteristic. Note that the same CPU is being used for all configurations / will be used for future DAS reviews. Therefore, comparing the numbers for each trace should be possible across different DAS units.

Introduction Performance Evaluation - 2big Thunderbolt 2
Comments Locked

42 Comments

View All Comments

  • MikhailT - Friday, July 11, 2014 - link

    WTF? You do realize these are DAS and has nothing to do with NAS nor does the devices have any server running?
  • mschira - Friday, July 11, 2014 - link

    I can't help finding this review a funny one. So the devices are faster via USB3 than with thunderbolt. (on a PC that is).

    So where is the usage scenario? Daisy chaining? Is that it? Am I unfair here or or is that ridiculous?
    So the verdict should be brutal, right? Am I missing the sentence? Because I can't see it.
    So where is the bottleneck?
    M.

Log in

Don't have an account? Sign up now