Game Load Performance

I looked at three games for load time performance and I picked these titles because they run the whole spectrum of how well an SSD will work in a gaming machine. First up is Spore.

Here I'm timing how long it took to load the next stage of evolution in the game, my character just grew legs and is about to walk on land for the first time:

Spore Level Load Time 

You'll see that the results are pretty much the same on all of these drives, we're reading from the disk but we're bound elsewhere in the system - an SSD won't do anything for you here and there are many games where you won't see improvements in load times.

Next up, Oblivion - I'm simply loading a savegame:

Oblivion Level Load Time

Compared to notebook drives, the SSDs do extremely well. Against the 3.5" competitors, the margins are smaller but there - you shave a couple of seconds off of the VelociRaptor's time, more off of the 1TB WD drive (or any other 5400RPM drive). For some reason these sorts of performance gains are far less noticeable in real world usage than the improved application launch times. Perhaps it's because when you're playing a game it's all you've got going on and you're more patient, whereas when launching a web browser or an application you're trying to complete a task where time is more valuable. I'll refrain from any more psychological analysis and stick to the drives though.

Finally we get to Crysis, and this is the other end of the spectrum because Crysis is a game that is very demanding on the I/O subsystem. We've got three results here: 1) How long it took to launch the game and load the benchmark level, 2) Minimum FPS, 3) Average FPS. I'm only reporting the minimum and average frame rate of the first run, because in that run of the benchmark the textures and level data are still being streamed off the disk and it actually impacts both minimum and average frame rate.

Crysis Game/Level Load Time

The Intel X25-M manages to load the game and benchmark level in around 80% of the time of the VelociRaptor and about 90% of the time of the Samsung SLC SSDs. Compared to notebook drives the performance advantage is staggering. Game load and level load performance can be improved and Crysis is a good example of that.

The minimum frame rate graph is very interesting because it shows the impact loading textures from a slow disk can have on minimum frame rates in a game. The Crysis test is a bit exaggerated since it's streaming data as fast as possible, which you don't always do in a game, but if you've ever felt your game grind to a halt and hear your disk thrash this is a good test of that.

Crysis GPU Bench (Min FPS)

The X25-M has a 33% advantage here over the VelociRaptor, and I won't even mention the utter destruction of conventional 2.5" HDDs. Compared to other SSDs, the Samsung SLCs come the closest but Intel still manages a 25% advantage. The JMicron based MLC drives suffer terribly here, Intel's MLC drive is 63% faster. I will also point out that for a couple of runs the JMicron MLC drives managed a minimum frame rate of 3 fps, several of those lovely pauses happened in the middle of the benchmark which really changed things. The phenomenon was random enough that I reported the more common frame rate but it's worth pointing out that the pausing issue can happen while gaming, which would be bad if you're playing any sort of multiplayer game.

Average frame rate is obviously affected, but you can see that the numbers are much closer indicating that the minimum frame rates are at least not sustained for long periods of time.

Crysis GPU Bench (Avg FPS)

What can we conclude here? SSDs can be good for gaming, but they aren't guaranteed to offer more performance than a good HDD. And where SSDs do offer an impact on gaming performance, Intel's X25-M continues to dominate the charts.

Application Loading Performance The Killer App: Multitasking Performance
Comments Locked

96 Comments

View All Comments

  • mindless1 - Thursday, September 11, 2008 - link

    Sometimes the cure is worse than the problem.
  • Gannon - Tuesday, September 9, 2008 - link

    Don't worry derek I still heart you guys! :P

    Here's some cool software to check out (they have free trial version)

    http://www.whitesmoke.com/landing_flash/free_hotfo...">http://www.whitesmoke.com/landing_flash...otforwor...

    Maybe it will help escape complaints from the grammar nazi's, I think a lot of grammar is BS anyway. Language evolves constantly. It's a flexible tool to communicate.
  • Nihility - Monday, September 8, 2008 - link

    An excellent review. The benchmark results were always confusing in the past. No one would try to explain why an SSD with seemingly superior specs can't outperform a 7200 drive in media test. Thanks for putting the time in to resolve this issue.

    As for buying a drive like that, the price is still too steep for me to consider and you definitely made it clear that buying a jmicro SSD is out of the question.
    As for further testing, I'm very interested in seeing how a good SSD performs as an external drive over USB. The robustness and sturdiness of the drive is very important for something you lug around. We all know how bad bandwidth is over USB but I wonder how the latency will fair.

    Keep up the good work.
  • kmmatney - Monday, September 8, 2008 - link

    One of the other reviews I read said this SSD's controller will learn hard drive usage patterns, and get faster over time. Any tests of this feature?
  • leexgx - Monday, September 8, 2008 - link

    not sure how thay can lern

    i did wunder why thay never put any DRAM buffer on SSD drives as i was expecting SSD to suffer badly from lack of buffer any MLC drives basicly suck (16kb buffer per flash chip) unless its the intel MLC drive lol or an SLC drive seem mostly ok, but an intel SLC going to rock when thay get tested
  • Anand Lal Shimpi - Monday, September 8, 2008 - link

    The Intel drive will learn hard drive usage patterns however it does so over an extremely long period of time, not something I could develop a test for in my time with the drive.

    Take care,
    Anand
  • whatthehey - Monday, September 8, 2008 - link

    ...that doesn't think too much about HDD performance, particularly when we're talking about insane prices. Sure, rebooting and reloading all of your apps will feel much faster. Personally, when I reboot I walk into the kitchen or bathroom, walk back a few minutes later, and I don't notice the delays. Not to mention, I only reboot about once a month (usually when nVidia releases a new driver that I need to install).

    Another major problem I have is the tests as an indication of the "real world". Take the whole antivirus thing. I hate AV software and software firewalls, which is why I don't use Norton, AVG, Avast, McAfee or any other product that kills performance, sucks up memory, and only prevents virii/trojans after an update. AV software is just a BS excuse to pay a $60/year subscription and get nags every time your subscription expires. So there's on "real" scenario I don't ever encounter.

    Archive extraction can be pretty disk intensive as well, but how often do you need to extract a 5GB archive? Okay, so let's say you're a pirate and you do that daily... great. Now you can extract faster, but you have an SSD that can only hold 14 or so large archives. It's a nice illustration of SSDs being faster, but it's completely impractical. I have a 1TB drive just for all the movies, images, music, and disc images I have floating around.

    The tests show that SSDs can help a lot, but I for one use capacity far more. Between several games, my standard apps, and Vista I think I would use most of the 80GB. Then I think of the price and I could grab a couple VelociRaptors or even four 1TB Samsung F1 drives. I'll be truly impressed when I can get at least 320GB of SSD for less than $200. Actually, it's more like I want a good SSD with a reasonable capacity for under $100. Until then I'll just stick with my slower drives and avoid worst-case situations where HDD performance is a problem as much as possible.

    The article was good, and I appreciate the info on the MLC issues with JMicron. That confirms my suspicion that inexpensive flash drives are worse than standard mechanical drives. Intel has addressed the problem, but price is now back to where we were last year it seems. I guess the real problem is that I'm just not enough of an "enthusiast" to spend this much money on 80GB of storage... not counting stuff like that old 4GB hard drive back in the day that set me back over $200. Give it a few more cycles and I think I'll be ready for SSDs.

    PS - Also, who cares about $600 CPUs when you can buy $200 CPUs and overclock to higher performance levels? I don't think we'll ever see overclocked SSDs or HDDs.
  • DerekWilson - Tuesday, September 9, 2008 - link

    i wouldn't be so sure about not seeing overclocked SSD ...

    as this article points out, intel puts a focus on reliability ... but to do so they do sacrifice performance. the voltage applied to the transistors to store data is calibrated to write the cells quickly while maintaining a good life span. a higher voltage could be applied that would allow the cells to be written faster but would reduce the number of writes that a cell could handle.

    if intel says 100gb a day for 5 years ... i don't need that by a long shot. i would be very willing to sacrifice a lot of that for more speed.

    i actually spoke with intel about the possibility of overclocking their ssd drives at idf -- it is something that could be done as it is controlled via the firmware of the drive. if intel doesn't convolute their firmware too much or if they allow enthusiasts to have the necessary control over settings at that level we could very well see overclocked SSDs ...

    which would be very interesting indeed.
  • shabby - Monday, September 8, 2008 - link

    I was so close in buying one of those ocz drives, in fact the reason i didnt buy it was because it was a special order that took 2 weeks.
    Excellent write up, especially about the jmicron/mlc "glitch".
  • OCedHrt - Monday, September 8, 2008 - link

    Any reason why the WD GP drive does so well in the multitasking test? Even better than the VelociRaptor?

Log in

Don't have an account? Sign up now