Synthetic Benchmarks

Our Nocona server was setup in a remote location with little access, so we had limited time to run as many real world benchmarks as we are typically accustomed to. Fortunately, there are multitudes of synthetic benchmarks that we can use to deduce information quickly and constructively.

Sieve of Atkin (primegen)

Primegen is an older, but still useful library for generating prime numbers in order using the Sieve of Atkin. We compiled the Bernstein implementation by simply running "make". We ran the program as so:

# time ./primes 1 100000000000 > /dev/null

primegen 0.97

We found the benchmark to be extremely reliable and we replicated our figures continually with less than 1% difference.

Super Pi

We ran the Linux compilation of Super Pi 2.0, which is a closed source application. We are not aware of which optimizations are compiled with the program and we are prohibited from redistributing the binaries. Please download the latest binaries from ftp://pi.super-computing.org/Linux. We ran the command:

# ./super_pi 20

Below is the program's output of calculation time in number of seconds.

Super Pi 2.0

After re-running the program several times, our benchmarks never deviated outside of 1%. In a mathematical operation-only situation, the Intel processor has outpaced the AMD offering twice now.

Content Creation Synthetic Benchmarks (continued)
Comments Locked

275 Comments

View All Comments

  • redpriest_ - Monday, August 9, 2004 - link

    Better quality than a rush job IMO. I don't think the systems were even set up right. Remember the extremetech fiasco where the memory was running at *half* speed the entire time they had the FX51 and for a good portion of the FX53 time period?
  • manno - Monday, August 9, 2004 - link

    fifi
    "So keep on the sarcasm and hopefully it will improve your mental abilities which are clearly being impaired by the background EM waves, you SHOULD have bought those aluminium hats like I told you to..."
    Yeah I can be a bit of a sarcastic pr#$%. Sorry about that :)

    But look here's my thing AT posted a preliminary review, and that's obvios I mean they're using a A64 3500 and comparing it to Intels latest and greatest. And they posted numbers that showed that in some benches the new intel chip is better than AMD's 3500. It's a quick little heads-up review. And there are posters on here treating it like a full fledged benchmark suite. The numbers they got were the numbers they got. Do with them what you will. They told you what the benches were if you think there's somthing fishy going on do us all a favor and run the benches yourself and post your results for the rest of us, I for one wouldn't mind seeing another set of numbers quote:

    "The delicate bit for this review was using the SuSE 9.1 Pro (x86_64) installation rather than compiling it from scratch (à la Gentoo). This was done to preserve the ability to replicate our benchmarks easily."

    Look they stuck their head out and released some early numbers, and rather than thank them for doing it, people are throwing tomatoes at them. That's where I stand. Yes I would like to see more numbers on more chips, and that will come in time. For right now however this is what they have and it's what they released. So again I'de like to say thanks for giving me a heads up.

    -manno
  • redpriest_ - Monday, August 9, 2004 - link

    Something is seriously wrong with the 3500+ setup. Independent verification with the exact same compiler settings, only on a worse configuration (3200+ A64) show this:

    http://www.siliconinvestor.com/stocktalk/msg.gsp?m...
  • tpinckney - Monday, August 9, 2004 - link

    I don't think anyone would be pissed off if it was a simple matter of the Xeon beating the A64 (probably disappointed would be a better word). The issue is the poorly done, inaccurate, and questionable benchmarks as well as a comparison between two chips that makes little sense.

    Manno and JohnsonX, please try and keep your posts above a third grade level.

  • redpriest_ - Monday, August 9, 2004 - link

    There's a lot more wrong than just the MySQL numbers. Using TSCP, this guy gets phenomenally better results than what is portrayed. I would suspect the Xeon results would be much better as well if compiled under the same flags:

    http://www.aceshardware.com/forum?read=115093819

    The fact of the matter is, these binaries do not seemed tuned for AMD64 at all.
  • jshaped - Monday, August 9, 2004 - link


    yes, i too joined just so i could comment on this article.

    i agree with johnsonx - most of Anand's readers must be illiterate, or half-way oblivious.

    take this article for nothing more than it was meant - it was a quick and dirty benchmark of a non-existent processor - that's it.

    quit whining about A64 vs. Xeon - as johnsonx said the Xeon is 99% the same as a p4 - it's always been that way. please read what the author of the article said - this is just a primer for future articles.

    anand's received this non-existent processor from unnamed sources, and they did what any of us would've done - quick and dirty benchmarks with what they had readily available.
    chill
  • johnsonx - Monday, August 9, 2004 - link

    Dear KK,

    Please don't post any more articles that don't show AMD stomping over Intel in every benchmark (except of course video encoding, which AMD Fan has graciously allowed Intel to win).

    This way we can avoid furhter diarrhea of the keyboard.

    Regards,

    Dave
  • johnsonx - Monday, August 9, 2004 - link

    Yes, it would be nice to have an edit feature on these...

    I meant of course:

    XEON 3.6 EM64T = Prescott core, 3.6Ghz, 800Mhz FSB, 1Mb L2, EM64T enabled.

    Pentium 4 3.6F = Prescott core, 3.6Ghz, 800Mhz FSB, 1Mb L2, EM64T enabled.
  • johnsonx - Monday, August 9, 2004 - link

    to #20, srg,

    oooh, ouch, you called me an Intel fanboy.

    First, as I pointed out, the only difference between the tested AMD cpu and the very best FX-53 or Opteron x50 is 200Mhz and 512K more cache. 200Mhz isn't going to make the difference, nor is the extra cache. Anandtech has shown numerous times that K8 is not cache starved at all. At best, the top AMD CPU would be 10% faster.

    Second, as KK pointed out, the difference between the tested XEON and the P4 3.6F is NOTHING, aside from the 603-pin socket and the E7525 chipset. A P4 3.6F on a 925X chipset would produce exactly the same numbers.

    XEON 3.6 EM64T = Prescott core, 3.6Ghz, 800Mhz FSB, 1Mb L2, EM64T enabled.

    XEON 3.6 EM64T = Prescott core, 3.6Ghz, 800Mhz FSB, 1Mb L2, EM64T enabled.

    Many of the comments here make me think much of the Anandtech readership is bordeline illiterate. For example KK points out that "The entire Prescott family of Intel CPUs received a dedicated integer multiplier rather than continually using the floating point multiplier. This becomes extremely useful in some of our other benchmarks." I guess the Dick and Jane readers had trouble sounding that one out, or they couldn't apply that nugget of info before flaming that the Opteron was faster than XEON before, so why isn't it faster now!?!?!? XEON has changed quite a bit since then Reader Rabbit.

    About the only comment in this whole rant I agree with is the one just after my first: #19 fifi pointed out that there is likely a mistake in the MySQL Select numbers, as the last place showing of the A64 doesn't match KK's comments about A64 winning this test.

  • Stinger22 - Monday, August 9, 2004 - link

    Horrible review... Please get an Opteron 150, provide more details on the testing done, and please throw some more variety in there (like additional cpus (32/64bit/different speeds etc..) and how they perform on these err.. tests lol), oh and do it right next time.

    Btw, I registered for the forum just to post this. Yes, it is that bad!

Log in

Don't have an account? Sign up now