Overall System Performance using PCMark Vantage

Next up is PCMark Vantage, another system-wide performance suite. For those of you who aren’t familiar with PCMark Vantage, it ends up being the most real-world-like hard drive test I can come up with. It runs things like application launches, file searches, web browsing, contacts searching, video playback, photo editing and other completely mundane but real-world tasks. I’ve described the benchmark in great detail before but if you’d like to read up on what it does in particular, take a look at Futuremark’s whitepaper on the benchmark; it’s not perfect, but it’s good enough to be a member of a comprehensive storage benchmark suite. Any performance impacts here would most likely be reflected in the real world.

PCMark Vantage

Light usage performance as represented by PCMark Vantage is about 9% faster compared to the old Indilinx Barefoot. The Martini controller looks and acts like a modern SSD controller.

The memories suite includes a test involving importing pictures into Windows Photo Gallery and editing them, a fairly benign task that easily falls into the category of being very influenced by disk performance.

PCMark Vantage - Memories Suite

The TV and Movies tests focus on on video transcoding which is mostly CPU bound, but one of the tests involves Windows Media Center which tends to be disk bound.

PCMark Vantage - TV & Movies Suite

The gaming tests are very well suited to SSDs since they spend a good portion of their time focusing on reading textures and loading level data. All of the SSDs dominate here, but as you'll see later on in my gaming tests the benefits of an SSD really vary depending on the game. Take these results as a best case scenario of what can happen, not the norm.

PCMark Vantage - Gaming Suite

In the Music suite the main test is a multitasking scenario: the test simulates surfing the web in IE7, transcoding an audio file and adding music to Windows Media Player (the most disk intensive portion of the test).

PCMark Vantage - Music Suite

The Communications suite is made up of two tests, both involving light multitasking. The first test simulates data encryption/decryption while running message rules in Windows Mail. The second test simulates web surfing (including opening/closing tabs) in IE7, data decryption and running Windows Defender.

PCMark Vantage - Communications Suite

I love PCMark's Productivity test; in this test there are four tasks going on at once, searching through Windows contacts, searching through Windows Mail, browsing multiple webpages in IE7 and loading applications. This is as real world of a scenario as you get and it happens to be representative of one of the most frustrating HDD usage models - trying to do multiple things at once. There's nothing more annoying than trying to launch a simple application while you're doing other things in the background and have the load take forever.

PCMark Vantage - Productivity Suite

The final PCMark Vantage suite is HDD specific and this is where you'll see the biggest differences between the drives:

PCMark Vantage - HDD Suite

Sequential Read/Write Speed Overall System Performance using SYSMark 2007
Comments Locked

61 Comments

View All Comments

  • jordanclock - Tuesday, November 16, 2010 - link

    Garbage collection is file-system agnostic. It happens on a level between hardware and the file-system. It will work for any and all file-systems.
  • Jaybus - Tuesday, November 16, 2010 - link

    Unlike a spinning disk, there is no penalty for where blocks are physically placed. The controller therefore maps the address of the requested block to the real physical location of the block. This mapping is internal to the drive controller and at a lower level (the block level) than the file system. When a SATA request comes in to write a block that has previously been written to and already contains data, the controller would normally have to erase the block before writing the new data. What garbage collection does is change the mapping so that the write is made to a block that is already erased, while the old block is mapped to a list of blocks that now contain stale (ie. garbage) data. The idea is that this speeds up the writes, since the erase is delayed and performed later when disk activity is idle.

    This doesn't require a TRIM command, since it is all handled internally by the drive controller. It is at the block level, so file system used doesn't matter.
  • melgross - Tuesday, November 16, 2010 - link

    So, and I asked this before, in another thread, is there an advantage to trim. If so, what else is it doing that would make that true? I received no answer there.
  • akedia - Tuesday, November 16, 2010 - link

    TRIM is a command from the operating system to the drive to clean up its dirty sectors and ready them for new data. Background garbage collection is the hard drives quietly doing the same thing by themselves when they're idle. Either way it's a process that must be undergone to keep the SSD operating well.
    The benefit of TRIM is that the operating system is much better at knowing when it's about to access the drive than the drive is at guessing when it's going to be accessed by the operating system, so TRIM can fulfill the function more efficiently and diligently. The big drawback to TRIM is that not all operating systems have it. Thus the Crucial RealSSD C300, which can receive TRIM commands but cannot do background garbage collection, is arguably the best available SSD on Windows 7, which has TRIM, but would have its performance degrade very badly over time on OS X, which does not, while the SandForce SSDs like the OCZ Vertex 2 performs about equally on either system, their own garbage collection taking care of things.
    In short, yes, there is a benefit to TRIM in keeping SSDs functioning optimally over time better than idle garbage collection most of the time, IF you have an operating system AND an SSD that utilize the command.
  • cdillon - Tuesday, November 16, 2010 - link

    Garbage collection doesn't have ANY knowledge of file-systems like some people seem to think. That would be entirely too dangerous for your data. Block devices have absolutely no business erasing your data without the OS asking it to.

    Garbage Collection and TRIM are orthogonal. When new data is written to the SSD, it is written to the pre-erased blocks that exist in the spare block pool. The LBA for that data will now point to the new flash block. Since the contents of the logical blocks are now stored in different physical flash blocks, the old flash blocks now contain orphaned "garbage" data and can be erased and returned to the spare pool. The purpose of Garbage Collection is to erase these previously used blocks and put them back into the spare pool.

    This allows for fast writes and some wear-leveling. If you over-run the spare pool with your writes then you'll see the writes slow down until garbage collection and/or TRIM has recovered at least some of the spare block pool.

    The advantage of TRIM is that it gives the SSD information about ADDITIONAL blocks that can be erased and put into the spare pool above and beyond the fixed spare pool. The smaller the fixed spare pool size is on an SSD, the more TRIM will benefit.
  • melgross - Wednesday, November 17, 2010 - link

    Well, this is what I thought from what I've read.

    But, it also seems to me that you can get performance at least as good as trim with controllers that are aggressive, as aggressive as the trim itself may be. We can see from the new Toshiba controller that performance can remain at about 100% if it's aggressive. Yes, that may lead to reduced life, but that's got to be tested.

    One advantage I see for garbage collection by the drive itself is that it's matched to the drivef and the extra flash should help determine how aggressive it can get. But trim is independent of the drive, as so treats each drive the same. That could result in poorer performance, and possible shorter lifetime.

    I still don't see where any advantage to trim exists.
  • dbt - Tuesday, November 16, 2010 - link

    And.... more importantly, another good article - thankyou !
  • cactusdog - Tuesday, November 16, 2010 - link

    I have a vertex2 that im very happy with it but cant OCZ come up with a different name instead of having different controllers under the same model of "vertex" with very different performance levels. Its a good way to confuse consumers.
  • Shadowmaster625 - Tuesday, November 16, 2010 - link

    I guess this is why you can buy one of the original vertexes (vertices?) for $40 after rebate.
  • mschira - Tuesday, November 16, 2010 - link

    All these 2.5" SSD's are fine for desctops and for replacement in existing Laptops.
    But where is the move towards 1.8" models or better the super small form factor the MacBook air uses? (btw. does anybody know what sort of SSD the Sony Z-Series uses?)

    2.5" drives are getting a limitation for small thin notebooks. Time to get rid of them!!!!
    M.

Log in

Don't have an account? Sign up now