Multi-Client CIFS Performance for Professional Workloads

NAS units used in SMBs / SMEs need to provide good performance under heavy load from multiple clients. The SPEC SFS 2014 benchmark uses real-life workloads (just like Intel NASPT), but makes it easier for users to understand the benchmark results. This is achieved by using the concept of business metrics. Given a particular NAS unit, how many concurrently accessed databases can reside in it? How many IP cameras or video streams can be simultaneously recorded? To determine this metric, each load point is associated with a target required op rate. If the NAS under test doesn't meet that op rate, it is deemed as an 'invalid run'. SPEC requires all published benchmarks to follow certain strict rules - such as presented results having no invalid runs for at least 10 load points. Unfortunately, small-scale NAS systems with 7200 RPM drives can't meet these requirements, Hence, we can't officially publish SPEC SFS 2014 benchmark results for the evaluation of the QNAP TS-451+.

Using a popular filer benchmarking program, we did play back multi-client real-world professional workload access traces on the NAS using up to 10 Windows 7 VMs. However, failing to meet the required op rate criteria at a particular load point made us stop the testing a couple of load points down the road. The QNAP TS-451+ with four 7200 RPM hard drives in RAID-5 can support recording of 10 or more video streams, 5 or less databases, 4 or less software builds and 2 or less virtual desktops.

Database Operations

The Database Operations workload seems to get / doesn't seem to get acceptable performance for up to 5 clients.The detailed metrics from our trace playback are available here

Database Operations - Op Rates

Database Operations - Bandwidth and Latencies

Software Builds

The Software Builds workload seems to get / doesn't seem to get acceptable performance for up to 4 clients.The detailed metrics from our trace playback are available here

Software Builds - Op Rates

Software Builds - Bandwidth and Latencies

Video Recording

The Video Recording workload seems to get / doesn't seem to get acceptable performance for up to 10 clients.The detailed metrics from our trace playback are available here

Video Recording - Op Rates

Video Recording - Bandwidth and Latencies

Virtual Desktops

The Virtual Desktops workload seems to get / doesn't seem to get acceptable performance for up to 2 clients.The detailed metrics from our trace playback are available here

Virtual Desktops - Op Rates

Virtual Desktops - Bandwidth and Latencies

Multi-Client CIFS Performance for Consumer Workloads Multi-Client NFS Performance for Professional Workloads
Comments Locked

34 Comments

View All Comments

  • ant6n - Thursday, October 29, 2015 - link

    I know this is a common kind of complaint under these reviews; but I often poke at NAS reviews as something that would be a nice-to-have, and then can't get myself to read past the price tag. I know these aren't really home devices. But aren't there multi-bay (4+) NAS systems with, say, an arm, for less than 300$?
  • DanNeely - Thursday, October 29, 2015 - link

    A quick search on Amazon and Google shows that there are a number of entry level 4 bay NASes for $250-300. Filtering solely by brand name, the $282 QNAP TS-431 would be my initial recommendation. Synology, the other nas maker (along with QNAP) with what's generally regarded as top flight software wants over a hundred more for the DS414j; which appears to be their cheapest 4x3.5" drive model.
  • Savardm - Thursday, October 29, 2015 - link

    I own a T-431 and so I'm always interested in these reviews because I find there isn't that many NAS reviews around. This particular review seems way more advanced then what I actually do with mine. I use mine to download/seed torrents and hold my Library of content which I access from several devices. I also really like the personal cloud features. I was worried when I bought my unit that the RAM and processor would be a major issue but it never lags. I'm not sure how it could get any better really. I think this must be because I am not using it as a typical NAS user? Anyway, all this to say, the TS-431 is the best gadget purchase I have ever made, I really do love it.
  • ivyanev - Friday, October 30, 2015 - link

    You could build a dedicated NAS for less than 300$ with the capability of 4+ drives. It is easy, and you may already have the parts. The question is do you NEED 4 drives? Why don't you get basic 1 drive unit and test if you need one. If you love it but still want redundancy you can later upgrade.
  • random2 - Wednesday, November 4, 2015 - link

    "Why don't you get basic 1 drive unit and test if you need one."

    Oh, you mean an external drive? I think you might be missing the whole point of redundant storage.
  • Moishe - Wednesday, November 4, 2015 - link

    The cost is certainly high for a diskless system. Crazy.
  • manly - Monday, November 23, 2015 - link

    With all the consolidation in the hard disk industry, I think the price curve is still somewhat dominated by the cost of 4 hard drives with TLER support. 3 TB NAS drives are somewhat affordable, but 4 TB is still a bit pricey in my opinion even for consumer NAS drives. "Enterprise" SATA drives are flat out pricey at higher capacities, because the last few manufacturers can absolutely get away with it.

    The QNAP TS-451 (apparently now an older model) was on sale numerous times over the past 12 months for $350 + tax. I think that's a pretty attractive price point considering the performance. IIRC, Synology's somewhat comparable units were at least $100 higher although until recently DSM had always been favored by reviewers.

    The sale price may have been in anticipation of the release of the TS-451+ but since it happened somewhat frequently over the course of an entire year-long period, it was a commonly available deal here in the U.S. Not sure how aggressive QNAP will be for the year ahead though.
  • Dunkurs1987 - Tuesday, January 5, 2016 - link

    This is the price you can expect from 8GB version. There is 2GB option available too. Should be ok with limited tasks.
    http://www.span.com/product/Qnap-Desktop-NAS-TS-45...
  • Der2 - Thursday, October 29, 2015 - link

    Very nice NAS review.
  • Reflex - Thursday, October 29, 2015 - link

    One feature that I really want to see is Sync to OneDrive and other cloud providers. These days a lot of these services offer unlimited or incredibly large backups for free, and being able to sync to them frees a SOHO environment from having to find an offsite backup solution.

Log in

Don't have an account? Sign up now