Development Performance - Compiling Firefox

Our Quake 3 compile test was getting a bit long in the tooth, so we're introducing a brand new test: compiling Firefox. We followed the instructions diagramed here.

Firefox Build

This particular test is only single threaded, and so we see that the fast single core CPUs take the lead. Intel's performance in this compiling test, as always is the case with our compiling benchmarks, is not up to par with AMD.

The Real Test - AnandTech's Multitasking Scenarios

Before our first dual core articles, we asked for feedback from the readers with regards to their multitasking usage patterns. Based on this information, we formulated some of our own benchmarks that would stress multitasking performance. We've already gone over the impacts of dual core CPUs on subjective interactions, so we'll just point you back to previous articles for our take on that if you haven't read them already. In the end, we know that dual core CPUs make our systems much more responsive and provide the same sort of smooth operation that SMP systems have done for years. But, the question now is: who has better multitasking performance? AMD or Intel? And that's exactly what we're here to find out.

We started with a test bed configured with a number of fairly popular applications:
Daemon Tools
Norton AntiVirus 2004 (with latest updates)
Firefox 1.02
DVD Shrink 3.2
Microsoft AntiSpyware Beta 1.0
Newsleecher 2.0
Visual Studio .NET 2003
Macromedia Flash Player 7
Adobe Photoshop CS
Microsoft Office 2003
3ds max 7
iTunes 4.7.1
Trillian 3.1
DivX 5.2.1
AutoGK 1.60
Norton Ghost 2003
Adobe Reader 7
Cygwin
gcc
mingw
Doom 3
Splinter Cell: Chaos Theory
What's important about this list is that a handful of those programs were running in the background at all times, primarily Microsoft's AntiSpyware Beta and Norton AntiVirus 2004. Both the AntiSpyware Beta and NAV 2004 were running with their real time protection modes enabled, to make things even more real world.

3D Rendering Multitasking Scenario 1: DVD Shrink
Comments Locked

144 Comments

View All Comments

  • Opteron - Monday, June 20, 2005 - link

  • mikeshoup - Wednesday, June 15, 2005 - link

    I think a better option for testing compiling speed would be to pass a -j argument to make when compiling FireFox, and tell it to run as many parallel operations as the processor can take threads. IE: -j2 for a dual core or ht cpu
  • fritz64 - Thursday, May 5, 2005 - link

    I know what I will be getting after fall this year. Those numbers are impresive!
  • jvarszegi - Friday, April 29, 2005 - link

    So they're reproducible, but only in secret. And you knew, as usual, about mistakes you were making, but made them anyway to, um, make a valid comparison to something else that no one can verify. Nicely done. Whatever they're paying you, it's not enough.
  • Ross Whitehead - Thursday, April 28, 2005 - link

    Zebo -

    You are correct you can not reproduce them, but we can and have 10's of times over the last year w/ different hardware. I do not believe that because you cannot reproduce them discounts their validity but it does require you have a small amount of trust in us.

    We have detailed the interaction of the application with the database. With this description you should be able to draw conclusions as to whether it matches the profile of your applications and database servers. Keep in mind, when it comes to performance tuning the most command phrase is "it depends". This means that there are so many variables in a test, that unless all are carefully maintained the results will vary greatly. So, even if you could reproduce it I would not recommend a change to your application hardware until it was validated with your own application as the benchmark.

    The owner of the benchmark is not AMD, or Intel, or anyone remotely related to PC hardware.

    I think if you can get beyond the trust factor there is a lot to gain from the benchmarks and our tests.
  • Reginhild - Thursday, April 28, 2005 - link

    Wow, the new AMD dual cores blow away the "patched together" Intel dual cores!!

    I can't see why anyone would choose the Intel dually over AMD unless all the AMDs are sold out.

    Intel needs to get off their arse and design a true dual core chip instead of just slapping two "unconnected" processors on one chip. The fact that the processors have to communicate with each other by going outside the chip is what killed Intel in all the benchmarks.
  • Zebo - Thursday, April 28, 2005 - link

    Ross,

    How can I reproduce them when they are not available to me?

    From your article:
    " We cannot reveal the identity of the Corporation that provided us with the application because of non-disclosure agreements in place. As a result, we will not go into specifics of the application, but rather provide an overview of its database interaction so that you can grasp the profile of this application, and understand the results of the tests better (and how they relate to your database environment)."

    Then don't include them. Benchmarking tools to which no one else has access is not scientific because it can't be reproduced so that anyone with a similar setup can verify the results.

    I don't even know what they do. How are they imporatant to me? How will this translate to anything real world I need to do? How can I trust the mysterious company? Could be AMD for all I know.
  • MPE - Wednesday, April 27, 2005 - link

    #134

    How can it be the best for the buck ? Unless you are seeing benchmarks from Anand that says so how could come to the conclusion?
    At some tests the 3800+ was the worse performer while the X2 and PD where the best.

    You are extrapolating logic from air.
  • Ross Whitehead - Wednesday, April 27, 2005 - link

    #131

    "no mystery unreproducable benchmarks like Anand's database stuff."

    It is not clear what you mean by this statement. The database benchmarks are 100% reproducable and are real life apps not synthetic or academic calcs.
  • nserra - Wednesday, April 27, 2005 - link

    You are discussion price and it's not correct since intel goes from 2800 to 3200 and amd goes from 3500+ into 4000+ (i'm ignoring amd new model numbers, still based on older).

    I complete disagree the AMD model numbers, the should be = to single core, the should just had the X2.

    The TRUE X2 will be more performer than opteron, by 2% to 5%.

Log in

Don't have an account? Sign up now