Multi-Client CIFS Performance for Consumer Workloads

The workloads experienced by a NAS unit in a typical home consumer setting have changed quite a bit over the last few years. Multiple mobile devices in a typical household raise the possibility that a NAS could be subject to the streaming out of multiple video files simultaneously. The popularity of IP cameras also make it necessary for NAS units to be able to record multiple video streams at the same time.

In our previous NAS reviews, we evaluated multi-client scenarios using synthetic workload traces and IOMeter. While there is nothing wrong in presenting numbers from such benchmarks, the reader is often left confused as to what those numbers might mean for his particular use-cases. Intel's NASPT benchmarking program gives us a good idea of the performance of the NAS unit when accessed by a single client. We took the source code of Intel's NASPT along with the supplied application traces and tweaked them to be able to run from more than one Windows client simultaneously in a co-ordinated manner. The graphs below present the results from tracking various metrics during the course of the benchmark runs. It must be noted that the average service times refer to what is obtained for all the traces when some of the data has already been cached in the client's memory. Unfortunately, NASPT doesn't provide any sort of guideline on what the optimal bandwidth and service times are for a good user experience.

Content Creation

The Content Creation workload seems to get acceptable performance for up to 6 clients. Beyond that, we have a noticeable drop in the per-client bandwidth numbers. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

Content Creation - Multi-Client Benchmark

Folder Copy from NAS

The Folder Copy from NAS workload seems to get acceptable performance for up to 10 clients (maximum that we tested). The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

Folder Copy from NAS - Multi-Client Benchmark

Folder Copy to NAS

The Folder Copy to NAS workload seems to get acceptable performance for up to 6 clients. Beyond that, we have a saturation of the total throughput despite being on a 802.3ad link. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

Folder Copy to NAS - Multi-Client Benchmark

File Copy from NAS

The File Copy from NAS workload seems to get acceptable performance for up to 4 clients. Beyond that, the total available bandwidth plateaus well below the link-aggregation limit, indicating an IOPS issue. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

File Copy from NAS - Multi-Client Benchmark

File Copy to NAS

The File Copy to NAS workload seems to get acceptable performance for up to 6 clients. Beyond that, we have a sudden spike in the average response time. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

File Copy to NAS - Multi-Client Benchmark

HD Video (1x) Playback

The HD Video (1x) Playback workload seems to get acceptable performance for up to 3 clients. Beyond that, we have a plateau slightly below the link-aggregation limit. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

HD Video (1x) Playback - Multi-Client Benchmark

HD Video(1x) Playback and Record

The HD Video(1x) Playback and Record workload seems to get acceptable performance for up to 4 clients. Beyond that, we have a plateauing of the total bandwidth number. Thanks to the full-duplex nature of the NICs, we are able to cross the 250 MBps mark (thanks to the simultaneous reads and writes through the LAN). The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

HD Video(1x) Playback and Record - Multi-Client Benchmark

HD Video (1x) Record

The HD Video (1x) Record workload seems to get acceptable performance for up to 4 clients. Beyond that, we have a sudden spike in the average response time. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

HD Video (1x) Record - Multi-Client Benchmark

HD Video (2x) Playback

The HD Video (2x) Playback workload seems to get acceptable performance for up to 3 clients. Beyond that, the total available bandwidth plateaus. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

HD Video (2x) Playback - Multi-Client Benchmark

HD Video (4x) Playback

The HD Video (4x) Playback workload seems to get acceptable performance for up to 3 clients. Beyond that, the total available bandwidth plateaus. The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

HD Video (4x) Playback - Multi-Client Benchmark

Office Productivity

The Office Productivity workload seems to get acceptable performance for up to 10 clients (maximum that we tested). The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

Office Productivity - Multi-Client Benchmark

Photo Album

The Photo Album workload also seems to get acceptable performance for up to 10 clients (maximum we tested). The detailed table with a breakdown of all the throughput numbers as well as the service times is available here

Photo Album - Multi-Client Benchmark

The detailed logs from the processing of our benchmarks - inclusive of metrics such as the file open times for each workload on each of the clients - can be found here

Encryption Support Evaluation Multi-Client CIFS Performance for Professional Workloads
Comments Locked

34 Comments

View All Comments

  • Brianbeastsu - Thursday, November 26, 2015 - link

    This has been available since the most recent firmware upgrade.....sync to most cloud services like google drive etc.....not 100% on one drive but I'm guessing unless Microsoft doest have an api for it you can do it with qnap
  • Shambles31 - Thursday, October 29, 2015 - link

    I know this review didn't go into QTS much but I thought I'd ask a related question. Is there any way for QTS 4.2 to support shadow copy, or previous versions in windows? I picked up the 2 bay model for my parents hoping to use it as a backup for them. I wanted to use snapshots and shadow copy. I've got snapshots running but can't seem to get it to support shadow copies on networked files. Surely a NAS would support this?
  • Minion4Hire - Friday, October 30, 2015 - link

    I think network file VSS support was only just introduced with Windows Server 2012 R2. Otherwise you only have local volume support. But you should be able to get it working if you can connect it as an iSCSI LUN.
  • kgardas - Thursday, October 29, 2015 - link

    Does it support ECC RAM? IMHO a must have for such NAS...
  • DanNeely - Thursday, October 29, 2015 - link

    Not at this pricepoint/market segment. The J1900 doesn't support it. You need to step up from prosumer to small/medium enterprise level hardware for ECC. QNAP apparently doesn't offer ECC in anything below an 8bay model.
  • mcveigh - Thursday, October 29, 2015 - link

    Any comments on the remote? How was it's build quality?
  • Kutark - Friday, October 30, 2015 - link

    Can someone explain to me why basic NAS like this are $650. It makes no sense. You could easily build a box that would have far more processing power, with an awesome raid controller, for less than this. Only advantage i can see would be size?
  • milkod2001 - Friday, October 30, 2015 - link

    It is expensive because it's ready go to solution. You throw HDDs into that, spend 30 minutes with setup /install and that's it. You also have option to contact customer support if something goes wrong.

    Your own solution might be much better / cheaper but it requires knowledge / experience to put together hardware parts, install NAS OS and make it all work. There is no customer support, you are on your own.
  • Kutark - Friday, October 30, 2015 - link

    That definitely makes sense. I always forget about the customer support angle because i don't even remember the last time i had to do customer support for any piece of hardware ever. Not trying to toot my own horn, but thats part of the fun of being a hardware enthusiast.
  • Chloiber - Saturday, October 31, 2015 - link

    You also pay for the software. I own a Synology DS415+ and use it (apart from the usual NAS stuff) for a OpenVPN Server, Docker with Jenkins, Download Station and have mobile apps available. A quite good backup software is already included and you have set that stuff up (well, apart from a robust, secure OpenVPN, which takes a bit longer) in a matter of minutes. Relatively sophisticated security / logging mechanisms are also included. I don't even want to imagine how long that stuff would take me with a self built NAS. I rather spend 100-200$ more and have a very good and versatile NAS than spend weeks fiddling around with linux.
    If you are up for it, go for it. For me, it was a no-brainer.

Log in

Don't have an account? Sign up now