System Benchmarks

Power

The two main aspects of power for a system like this are the idle and load measurements. For the CPU on its own, we have already tested the Threadripper Pro 3995WX in our 3995WX review, and it only draws the rated TDP, a maximum of 280 W. For the system as a whole however, we have the base power consumption with no load, and then additional loading with the GPU to consider. The official listing of the RTX 6000 24 GB here is 295 W, so a CPU+GPU should be 575 W .

  • Measurements taken at-wall
  • 75 W: Idle on OS
  • 630 W: Initial Peak with 100% CPU+GPU Load
  • 640 W: Sustained Peak with 100% CPU+GPU Load

For our metrics, we left the system at idle in the standard power profile but disabled sleep modes and display off modes. After 30 minutes, the at-wall power of the system was measured as 75 W in a long idle state. When firing both the CPU and GPU up with a high-performance cryptography workload, the system jumped up to 630 W at the wall. Over the next 20 minutes, as the fans sped up to deal with the increased thermals, we saw peak power at 640 W. This is easily sufficient for the 1000W power supply, and even with a second GPU, it should be plenty.

Temperature

A workstation wouldn’t be a good under-the-desk unit if the thermals spiraled out of control. Lenovo’s system is straightforward enough, with the unit split into two: the top half with the CPU has a passive intake in the front and blows out the rear, while the PCIe area has an active intake at the front and blows out of the back. We’re under the impression that the full retail units will have a dedicated air baffle between these two zones, but in our testing, the thermals were relatively tame.

We fired up the system in a traditional home/home office environment, with an ambient temperature of around 26ºC, using the default fan setting (which is the lowest). Both the CPU and the GPU were afforded a strong sustained cryptography load with the fans left on automatic. Even when at full loading for over 24 hours, the peak CPU temperature was only 78ºC, and the peak GPU temperature was only 81ºC. 

  • At Fan Level 1 (lowest) in BIOS, 100% CPU+GPU for 24 hour
  • CPU Peak at 78ºC
  • GPU Peak at 81ºC
  • Ambient of 26ºC

With such a sustained heat soak of the unit, the chassis was warm to the touch for sure, and we did additional measurements with an IR meter. On the side of the chassis, in the middle, 30ºC was recorded. Given that heat rises, the top of the case is where to look, and at the front of the case we saw 33ºC, while at the rear of the case it was 37ºC. Around the CPU exhaust fan, our meter recorded 50ºC for the fan casing, having to deal with the exhaust gases.

Something like this, a big 640W system pumping out hot air, will eventually warm up a room. This is always the danger with high powered workstations that have extended work to perform – gaming is at least somewhat varied for consumer systems that after a few hours the system can have a break.

Noise

Thermal results are not anything without rating the noise of a system, and Lenovo has a setting in the BIOS that allows the owner to select one of 7 fan profiles. The default setting as shipped was the lowest setting for the fans.

At this level, the system was inaudible over the background hum of other electronics, and when the system was pushed to the limit, 36 dBA was measured 30 cm from the rear exhaust, with the GPU hitting a peak of 80ºC. Using the highest fan setting, the system was 36 dBA at idle, rising to 46 dBA when at load (or 50+ if you are even closer than 30cm at the back). In this mode however, the GPU only peaked at 73ºC.

POST Time

With more professional-esque systems, the time from pressing the power button to when the OS is loaded is a lot longer than consumer systems, mostly due to the management control that goes on, as well as the fact that the POST time is not a direct optimization target in the same way. Enterprise systems typically have baseband management controllers (BMC), security aspects, and more memory channels to train, which all adds up to POST time. For example, our launch systems for dual-socket AMD Rome and Intel Cascade Lake take 3-5 minutes after pressing the power button.

Workstations are somewhat in the middle of all this. While they use processors with professional admin controls inside, only some have an added BMC for control. Workstations do have more memory channels than consumer grade hardware, so somewhere between the 20 seconds of consumer systems and 3 minutes of enterprise systems is probably a good balance.

For our test here, we shut down our system but kept the power cable plugged in. We started the timer from the moment we pressed the power button, and stopped it when the operating system was visible and accepted inputs. We also noted the POST time listed in the Startup section of Task Manager. This was repeated 5 times, with obvious outliers removed.

In our test, we had a very consistent 60 seconds to enter the operating system. Due to the manual timing here and waiting for the monitor to refresh into the OS resolution, then a timing resolution to the nearest second is probably most adequate. In each of our tests, the BIOS time as represented in Task Manager was also fairly consistent, showcasing 41.0 to 41.5 seconds.

  • Turn on POST Time: 41.0 to 41.5 seconds
  • Turn on to OS Time: 60 seconds

While these aren’t the fastest times in the world, this isn’t much of a machine that’s going to be turned off all that often, but when it is, at least it gets back into a useable shape very quickly.

USB Speed

This system has eight USB 3.2 Gen 2 slots, rated at 10 Gbps. Four are located on the rear, all of which are Type-A, and there are four on the front, two are Type-C and two are Type-A. One of those two Type-A ports on the front is also wired for always-on power, enabling it to act as a 5 W charging interface for smartphones and similar even when the machine is powered off but still plugged in.

For our test of USB speed, we are taking an NVMe SSD installed into a USB drive case. We have the Western Digital SN750 1TB drive, which is typically a PCIe 3.0 x4 drive, and placed it into an ASUS ROG Arion M.2 SSD Enclosure, built for speeds at USB 3.2 Gen 2 (10 Gbps). This enclosure has a Type-C output, but ASUS supplies both C-to-A and C-to-C cables in order to connect the drive to any number of devices.  With this combination of hardware, our theoretical maximum speeds should be at the 10 Gbps range, or 1250 MB/sec.

In our testing, only the front USB ports recognized our drive. The rear USB ports failed to register any device attached – I wonder if this is perhaps due to us receiving a test sample than a full retail system, nonetheless we tested the front ports with our drive using CrystalDiskMark. All four ports on the front performed identically within margin.

As you can see, the theoretical peak speeds are 1022 MB/s read, and 942 MB/s write, indicating some 20% overhead in the protocol for an absolute maximum.

To find a more real-world use case, we transferred files to and from the drive totaling 30 GB. In total there were a dozen compressed files relating to a video game being moved. Our realistic real-world speed was 709 MB/s, and so we’re another 30% off the actual peak of the port.

DPC Latency

Deferred Procedure Call latency is a way in which Windows handles interrupt servicing. In order to wait for a processor to acknowledge the request, the system will queue all interrupt requests by priority. Critical interrupts will be handled as soon as possible, whereas lesser priority requests such as audio will be further down the line. If the audio device requires data, it will have to wait until the request is processed before the buffer is filled.

If the device drivers of higher priority components in a system are poorly implemented, this can cause delays in request scheduling and process time. This can lead to an empty audio buffer and characteristic audible pauses, pops and clicks. The DPC latency checker measures how much time is taken processing DPCs from driver invocation. The lower the value will result in better audio transfer at smaller buffer sizes. Results are measured in microseconds.

  • DPC Latency: 180 microseconds

Our result on the Lenovo P620 was 180 microseconds. This is lower than the 300 microseconds usually recommended for good operation, and below the 200 microseconds we usually put as an upper limit for consumer grade systems. Out of all the motherboards we test, 180 μs is actually rather high: our Intel Z490 motherboards were 104-131 μs, and our AMD X470/B550/X570 motherboards varied from 46-156 μs. The only time we typically go higher is with more professional grade systems, and that is because DPC latency, while a target, isn’t always a priority.

BIOS and Software System Tests: Dual Channel vs 8-Channel
Comments Locked

47 Comments

View All Comments

  • Billy Tallis - Tuesday, February 16, 2021 - link

    Since Lenovo offers extended warranties out to five years for surprisingly low prices, it's reasonable to assume they'll be able to provide compatible replacement PSUs for at least five years past when they stop selling this machine. That's long enough to make this a non-issue in a corporate environment, even if it may hurt the secondhand market for these machines.
  • Calin - Wednesday, February 17, 2021 - link

    People that pay $20,000 for such a workstation will replace it in a couple of years with something better. However good this Threadripper Pro workstation is, five years from now it will be a dog (well, at least compared to another $20,000 workstation).
    I don't really see this level of performance being enough for more than about 3-4 years, and a well designed power supply will certainly last more than that.
  • DanNeely - Tuesday, February 16, 2021 - link

    I think I've only had 1 PSU fail in waranty over a dozenish self built PSUs over 20 years. The failure wasn't with the AC-DC hardware but the pins on the modular interface to attach one of one of the PCIe cables getting pushed into the PSU and no longer making contact.

    Other than that every PSU I've owned has lasted at least 7 (or more recently 10) years before failing. Most of them were in environments of 24/7 full CPU/GPU loads from distributed computing. Granted I don't buy cheap PSUs (at high continious load gold/platinum models increased efficiency actually does pay for itself over the life of the PSU). OTOH I doubt Lenovo is using low quality units in systems this expensive either.
  • Calin - Wednesday, February 17, 2021 - link

    While you might buy very good quality PSUs, in such flagship workstations Lenovo will put only the best power supplies money can buy
  • Hul8 - Tuesday, February 16, 2021 - link

    Really appreciate the rickrolling in these recent TR Pro articles. Always brings a smile.
  • Smell This - Tuesday, February 16, 2021 - link


    I asked for the base ThinkStation P620 Tower Workstation (xxxx FH00) and pulled the trigger ... my CC only has a $1,800 limit so Martin at Lenovo RTP hooked me up to the interest-free payment plan. LOL Suckers. HA! (j/k)

    Configuration Details
    ● Processor: AMD Ryzen™ Threadripper™ PRO 3945WX Processor (4.0 GHz, up to 4.30 GHz Max Boost, 12 Cores, 24 Threads, 64 MB Cache)

    ● Operating System: Windows 10 Pro 64
    ● Memory: 32 GB DDR4 3200MHz RDIMM ECC (2 x 16 GB)
    ● Hard Drive: 512 GB M.2 Gen 3 PCIe SSD, OPAL

    ● Graphics: NVIDIA® Quadro® P2200 5GB
    ● Optical Drive: DVD-RW

    ● Form Factor: Tower
    ● 1000W Fixed 92% Autosensing, 80 PLUS Platinum qualified
    ● Network Card: Integrated Ethernet
    ● Key lock: Key Lock Kit w/ Common Key
    ● Keyboard: USB Traditional - US English
    ● Pointing Device: USB Optical Mouse
    ● Memory Card Reader: 15 in 1 Card Reader

    ● 4Y Premier Support Upgrade from 3Y Onsite

    The 4-year support upgrade was a condition of the financing. The onboard 10 GbE is the Marvell AQtion AQN-107. The Quadro® P2200 5GB was a nice bump but no NV link.

    The 32 GB DDR4 3200MHz RDIMM ECC (2 x 16 GB) would appear to be the minimum. Didn't leap at the PCIe 4.0 NVMe 'upgrade.' I've used Lenovo keyboards before -- they're solid but maybe a little 'mushy' (not a great typist, anyway)

    Grand total: $2,423.18 with NC sales tax, shipped to my door -- gave me an additional $1,000 credit with $100-off on my next purchase.
  • Smell This - Tuesday, February 16, 2021 - link


    Link
    https://www.lenovo.com/us/en/think-workstations/th...
  • bobsmith1492 - Tuesday, February 16, 2021 - link

    Very nice. You can customize and add 8 channels of RAM. I've been planning a Threadripper build and their configuration with the recent coupon is pretty reasonably priced compared to a custom build.
  • Smell This - Tuesday, February 16, 2021 - link


    I'm hoping a standard modular GPU cable(s) will work!

    I'm thinking Rendering/Encoding with GPU compute in Vegas may not need the umphh of that 8-channels of RAM but we shall see. Maybe 4-channel 4x16GB could be a nice compromise.

    It may be of benefit using scratch drives in Adobe, but I try to avoid the big "A" for the most part. I'm heading toward a down-clocked RX Vega 56, or even a Fury on AMD Radeon Pro software, depending upon that Quadro P2200.
  • TanelPoder - Tuesday, February 16, 2021 - link

    It’s an excellent machine. Thanks to the 128 PCIe lanes, 4 PCIe root complexes and 8 memory channels, I got over 11M IOPS and 66 GiB/s scanning rate out of it (I used 10x Samsung 980 PRO SSDs with quad PCIe-M.2 adapters) for it.

    For anyone interested, here’s an article about it:

    https://tanelpoder.com/posts/11m-iops-with-10-ssds...

Log in

Don't have an account? Sign up now