Multitasking Performance

As we discovered in the first article, multitasking performance requires a slightly different approach to benchmarking methodology.  While for single application performance in which we test with a system that's in a very clean state with nothing but the benchmark and drivers loaded, for our multitasking tests, we have the system configured as what a real system would be.  That means tons of programs and lot's of tasks running in the background.  If you missed Part I, here's a quick recap of what our system configuration is like for our multitasking tests; the following applications were installed:

Daemon Tools
Norton AntiVirus 2004 (with latest updates)
Firefox 1.02
DVD Shrink 3.2
Microsoft AntiSpyware Beta 1.0
Newsleecher 2.0
Visual Studio .NET 2003
Macromedia Flash Player 7
Adobe Photoshop CS
Microsoft Office 2003
3ds max 7
iTunes 4.7.1
Trillian 3.1
DivX 5.2.1
AutoGK 1.60
Norton Ghost 2003
Adobe Reader 7

What's important about that list is that a handful of those programs were running in the background at all times, primarily Microsoft's AntiSpyware Beta and Norton AntiVirus 2004.  Both the AntiSpyware Beta and NAV 2004 were running with their real-time protection modes enabled, to make things even more real world.


Multitasking Scenario 1: DVD Shrink

For this test, we used DVD Shrink, one of the simplest applications available to compress and re-encode a DVD to fit on a single 4.5GB disc.  We ran DVD Decrypt on the Star Wars Episode VI DVD so that we had a local copy of the DVD on our test bed hard drive (in a future version of the test, we may try to include DVD Decrypt performance in our benchmark as well).  All of the DVD Shrink settings were left at default, including telling the program to assume a low priority, a setting that many users check in order to be able to do other things while DVD Shrink is working. 

Next, we did the following:

1) Open Firefox and load the following web pages in tabs (we used local copies of all of the web pages):

We kept the browser on the AT front page.

2) Open iTunes and start playing the latest album of avid AnandTech reader 50 Cent on repeat all.
3) Open Newsleecher.
4) Open DVD Shrink.
5) Login to our news server and start downloading headers for our subscribed news groups.
6) Start backup of Star Wars Episode VI - Return of the Jedi.  All default settings, including low priority.

DVD Shrink was the application in focus. This matters because by default, Windows gives special scheduling priority to the application currently in the foreground (we will test what happens when it's not in the foreground later in this article).  We waited until the DVD Shrink operation was complete and recorded its completion time. Below are the results:

Multitasking Performance - Scenario 1

The results here aren't too surprising. With dual core, you can get a lot more done at once, so the Pentium D 2.8 cuts the DVD Shrink encode time by about half when compared to the Athlon 64 3500+. 

There is one element that caught us off guard, however. When looking at these numbers, we noticed that they were unusually high compared to the numbers from our first article.  Yet, we ran and re-ran the numbers and had fairly consistent results.  Even running the CPUs at the same speeds as in our first article yielded lower performance than what we saw in that piece.  Comparatively, the processors all performed the same with reference to each other, but the DVD Shrink times were all noticeably higher.  So, we started digging, and what we uncovered was truly interesting.

Gaming Performance The Impact of NCQ on Multitasking Performance
Comments Locked

106 Comments

View All Comments

  • mlittl3 - Wednesday, April 6, 2005 - link

    Hey Anand,

    A really cool multitasking scenario for gaming would be running a game with something like Skype in the background. Everyone saying that a respectable gamer (whatever that means) would not run multi applications in the background is not thinking about VoIP.

    I am in Louisiana and I like to game with my friend in Georgia. We talk to each other using Skype will playing Halo on the same server. I know the overhead necessary for VoIP must slow things down some.

    Won't dual core help in this case?
  • Aikouka - Wednesday, April 6, 2005 - link

    I know I personally have a lot of things open when gaming, especially if I'm playing World of Warcraft. I'll typically alt-tab out of the game to check IRC or Firefox (with a bunch of tabs open) to look something up or if I'm bored, just browse the net a little bit.

    The only problem I ever have with slowdowns is if the game is highly CPU-bound and uses up 100% of my CPU, which WoW does almost all the time.
  • Rand - Wednesday, April 6, 2005 - link

    #10- I'm inclined to agree, but people did request it so presumably some people ar interested in doing so for whatever reason.

    "I don´t close AVG and MS Antispyware and MSN and outlook and IExplorer everytime i open warcraft or half life 2, so...WHO MADE ME BELIEVE AMD WAS FASTER?"

    Merely running applications in the background isn't going to do much to benefit DualCore/SMP unless those applications are actually utilizing the processor. Odds are MSN/Outlook/Spyware/Anti-virus probably aren't doing a thing but sitting idle when your gaming.

  • marcusgarcia - Wednesday, April 6, 2005 - link

    #10: There surely is.

    I play warcraft III online, which is a RTS game.
    Being so, not all actions are dependant on my reflex (in fact i can many times minimize the game for around 20 seconds which is the time my char takes to walk to a certain place on a given map).

    That being said, i am ALWAYS with a few instances of internet explorer open, MSN open, outlook express open and of course AVG and MS Anti spyware loaded on memory with real time protection.
    Add the fact that sometimes i am viewing and being viewed on MSN webcam.

    I'm sure MANY more people do that.

    Remember not all players are FPS gamers...in fact, FPS is far behind MMORPG in sales, which doesn't require near as much attention and reflex.
  • marcusgarcia - Wednesday, April 6, 2005 - link

    OK.
    Something is very wrong here.

    I mean, WHY DIDN'T ALL SITES DO THESE TESTS WHEN HT WAS LAUNCHED?

    It clearly shows here what is MUCH better when it comes under regular usage.
    A Pentium 4 3.0 ghz is beating AMD's trash on 3500+....i mean, WTF?

    Almost noone (does anyone at all?) goes closing all applications before gaming or doing any other activity and HT is clearly giving AMD a serious beating on the multi-tasking scenario (read: EVERYONE's usage).

    I don´t close AVG and MS Antispyware and MSN and outlook and IExplorer everytime i open warcraft or half life 2, so...WHO MADE ME BELIEVE AMD WAS FASTER?

    I mean...dude...are we talking about servers here to compare single threaded performance?
    Are we still on Windows 3.11?


    By the way, how in the hell aren't they including Half Life's 2 performance?

    Surely the physics engine plays quite a bit on processing and even more surely it is done on separate threads, which would show the dual core being strong even on a single application, let alone on a multi-tasking one.

    I'm quite repented for having an Athlon 64 3000+ as my CPU right now when the Pentium 4 3.0 HT would be clearly outspacing the Athlon in every respect as long as i was multi-tasking/opening/closing/minimizing things (e.g.: ALWAYS).

    Damn at all these sites.
  • boban10 - Wednesday, April 6, 2005 - link

    i think that this real-world multitasking testing done by Anandtech is 1000 times better than one syntetic benchmark, that is most time optimized for one or another cpu....
    someone agree ?


    ronaldo
  • mbhame - Wednesday, April 6, 2005 - link

    I'm sorry but I find the premise of Page 11 borderline absurd. I *cannot* fathom there's a respectable amount of gamers that actually do that on a regular basis.
  • Anand Lal Shimpi - Wednesday, April 6, 2005 - link

    WooDaddy

    Multi-core multitasking is already quite difficult, you have no idea how frustrating last weekend was. The issue is that I can sit with you on a computer and show you all the areas that dual core will improve performance, but quantifying it so I can stick a bunch of bars in a graph is far more difficult. AMD and Intel are actively working with BAPCo on SYSMark 2006 that should be much more multi-core friendly, but until then we're left with a lot of hard work. We're trying to write our own benchmarks as well, it's just that they take quite a bit of time to put together.

    Take care,
    Anand
  • Anand Lal Shimpi - Wednesday, April 6, 2005 - link

    Thanks for pointing out the graph error, the labels just got messed up it looks like; should be fixed now.

    Remember AMD is talking about a 2H 2005 launch for dual core Athlon 64 on the desktop, don't expect to see reviews of desktop parts anytime soon.

    As far as the encoding comment goes, it's tough for me to actually elaborate without stepping into areas I can't get into just yet. Let's just say that the dual core Athlon 64 running at 2.2GHz won't be compared to a dual core Pentium D running at 2.8GHz.

    Take care,
    Anand
  • WooDaddy - Wednesday, April 6, 2005 - link

    Ok Anand, either you're slick or you're slipping. History shows you're slick..

    You said a dual-core A64 won't help in encoding apps. I know you're not one to say stuff just because you THINK it's true, but because you KNOW so. I'm not at T0M H4rdware..

    So.. Since you're alluding to it, WHEN'S THE DUAL CORE A64 TEST COMING OUT!?!?! *pant**pant*

    Seriously though, I see that this multicore, multi-tasking benchmarking is going to get quite difficult. How do you know just how fast it really is considering all the combinations of different apps you will have running in the background? It Madonion or those other benchmarking guys going to be coming out with a synthetic benchmarking tool to gauge the max performance of these new multi-core processors?

Log in

Don't have an account? Sign up now