Single Client Performance - CIFS and NFS on Linux

A CentOS 6.2 virtual machine was used to evaluate NFS and CIFS performance of the NAS when accessed from a Linux client. In order to standardize the testing across multiple NAS units, the following parameters were used to mount the NFS and Samba shares:

mount -t nfs NAS_IP:/PATH_TO_NFS_SHARE /PATH_TO_LOCAL_MOUNT_FOLDER

mount -t cifs //NAS_IP/PATH_TO_SMB_SHARE /PATH_TO_LOCAL_MOUNT_FOLDER

Note that these areslightly different from what we used to run in our previous NAS reviews. We have also shifted from IOMeter to IOZone for evaluating performance under Linux. The following IOZone command was used to benchmark the shares:

IOZone -aczR -g 2097152 -U /PATH_TO_LOCAL_CIFS_MOUNT -f /PATH_TO_LOCAL_CIFS_MOUNT/testfile -b <NAS_NAME>_CIFS_EXCEL_BIN.xls > <NAS_NAME>_CIFS_CSV.csv

IOZone provides benchmark numbers for a multitude of access scenarios with varying file sizes and record lengths. Some of these are very susceptible to caching effects on the client side. This is evident in some of the graphs in the gallery below.

Readers interested in the hard numbers can refer to the CSV program output here. These numbers will gain relevance as we benchmark more NAS units with similar configuration.

The NFS share was also benchmarked in a similar manner with the following command:

IOZone -aczR -g 2097152 -U /nfs_test_mount/ -f /nfs_test_mount/testfile -b <NAS_NAME>_NFS_EXCEL_BIN.xls > <NAS_NAME>_NFS_CSV.csv

Some scenarios exhibit client caching effects, and these are evident in the gallery below.

The IOZone CSV output can be found here for those interested in the exact numbers.

Single Client Performance - CIFS and iSCSI on Windows Multi-Client Performance - CIFS
Comments Locked

51 Comments

View All Comments

  • JayJ - Friday, December 27, 2013 - link

    In at least 2 of the links it is stated that when a RAID 5 rebuild is in process and a URE is encountered, all data is lost.

    I'm not sure what crap hardware that author has been using. When a URE is encountered during a rebuild the rebuild halts and you're back where you started - with a degraded array.

    Now I'm not saying "RAID 5 is the BEST!" but the "facts" presented are false.

    FYI I've rebuilt several hundred RAID 5 arrays over the last 15 years and have experienced a URE during rebuild exactly 2 times. You can cut down on UREs by performing a scheduled "Patrol Read" or functional equivalent. There is no way to know if the data is readable unless you read it. You can have a (fictional) "SUPER DUPER RAID 3000" with a ridiculous amount of redundancy but it's still theoretically possible to lose your data due to URE unless it's read and verified.
  • Computer Bottleneck - Saturday, December 28, 2013 - link

    How do you feel about drives like the Western Digital Re which has a URE spec of 10^15 compared to other drives with a URE spec of 10^14 in RAID 5?
  • 802.11at - Friday, December 27, 2013 - link

    Given the choice, I'll take RAID 10 all day in my enterprise environment.
  • 802.11at - Friday, December 27, 2013 - link

    But FWIW, our HP LeftHand SAN is comprised of 6 nodes with 8 HDDs each in RAID 5 with the volumes actually running on a networked RAID 10.
  • theangryintern - Monday, December 30, 2013 - link

    Nice try, guy who writes for smbitjournal
  • Brutalizer - Wednesday, January 1, 2014 - link

    The second link is quite wrong in the premises. It says that filesystems are really reliable today, well, they are not. There are lot of research showing how all filesystems are flawed today (except ZFS) with respect to data corruption protection. Only ZFS protects the data against data corruption. Read the research papers you will find here:
    http://en.wikipedia.org/wiki/ZFS#Data_integrity
    http://en.wikipedia.org/wiki/Hard_disk_error_rates...
  • tomdb - Thursday, December 26, 2013 - link

    How much are consumer grade (if any exist) 10 GbE NAS's, switches and PCIe cards?
  • bobbozzo - Thursday, December 26, 2013 - link

    $3000 for a 6-bay Netgear w 10gigE
    http://www.anandtech.com/show/7523/netgear-launche...
  • bobbozzo - Thursday, December 26, 2013 - link

    I don't think there are any 'consumer' 10gb switches yet.
  • Master_shake_ - Saturday, December 28, 2013 - link

    infiniband is getting cheaper in price

Log in

Don't have an account? Sign up now