Synthetic Benchmarks

Spec Viewperf 8.0.1 (GCC 3.4.2)

SPEC released their newest benchmarks just a couple of months ago, and we have been doing our best to validate SpecViewperf 8.01 as our main synthetic benchmark for some time. Our Viewperf was compiled via GCC 3.4.2. Much to our surprise, Viewperf 8.0.1 compiles without much tweaking. We only needed to edit the Makefile to change a few X11 lib references from lib to lib64 (we are running a 64-bit environment).

You may wish to check out Anand's analysis of the FX-55 processor. Anand has a very good breakdown of each individual test, and what they mean. Do keep in mind that his analyses are done in a 32-bit, single CPU Windows environment and are very difficult to assess comparatively next to our SMP Linux tests.

SpecViewperf 8.01 3dsmax-03

SpecViewperf 8.01 catia-01

SpecViewperf 8.01 ensight-01

SpecViewperf 8.01 light-07

SpecViewperf 8.01 maya-01

SpecViewperf 8.01 proe-03

SpecViewperf 8.01 sw-01

SpecViewperf 8.01 ugs-04

We found some very interesting results here. Almost all of our applications favored the 32-bit Linux 2.4 kernel over the 64-bit Linux 2.6 kernel! As you will see in our next few benchmarks, the 32-bit JDS platform actually performed poorer than our 64-bit platforms in almost every instance. While SPEC's benchmarks are the industry standard, we put more weight on real world rendering benchmarks, like Shake and MentalRay, which you will see on the following pages.

When compared to Anand's windows benchmarks, some applications favor our Linux setup thoroughly, although they could be benefiting from our dual processor setup. In any case, they are not particularly comparable as we are comparing "32-bit Windows" apples to "64-bit Linux" oranges. Perhaps, we will explore the differences between the performances on the two OS's again in the future. Also keep in mind that Anand uses a PCIe Radeon X800XT video card whereas we are using an AGP Quadro FX 3000. Differing video cards will change the results significantly.

We attempted to run Viewperf 7.1.1 as well, but we ran into several issues. The first time that we ran 7.1.1, the machine actually rebooted with no errors or warnings. We suspect something may have overheated, but there were no indications of that from our thermal tests that we ran after the reboot. Faulty code may also be to blame; the benchmark always crashed 2/3 of the way through on our RedHat 9 workstation.

The Test 3D Rendering Benchmarks
Comments Locked

47 Comments

View All Comments

  • t - Thursday, October 28, 2004 - link

    oh... i better clarify before i get labelled as a 'zealot' or a 'mac hater' or a 'pc lover'

    by 'cache starved' i mean that the power4 is _very_ dependent upon its cache architecture, take some of that away and u of course impact performance... a power4 and a G5 at the same clockspeed, the power4 wins. The G5 is still an impressive chip.

    t.
  • t - Thursday, October 28, 2004 - link

    heh...this thread is hilarious...can u ppl like talk past each other some more?

    please :)

    G5 = cut down, somewhat cache starved power4
    Blue Gene/L = power4+

    they are a fair bit different: l3, l2, altivec, dual v. single core...just for a couple.
  • gromm - Wednesday, October 27, 2004 - link

    "and I'm sure that there's nothing special about the way the G5's were linked... "

    Actually, they have a communication network based on InfiniBand, which isn't something that you'd buy for home (especially considering how much it costs). The cards themselves are $200+ each (in quantities of 10,000 for the only price I could find for their HCA cards) and I can't even find how much the switches cost (I'm sure several thousand dollars each).
  • Reflex - Wednesday, October 27, 2004 - link

    Thanks for the correction, its been a while since I read up on that stuff. However you still illustrated my point that this is pretty much an irrelevant benchmark for general purpose computing. People do not simply use thier PC's for floating point performance...
  • slashbinslashbash - Wednesday, October 27, 2004 - link

    Reflex: "First off, once again, you are misunderstanding what you are looking at. Total number of CPU's is only part of the equation. There are *many* factors that go into the 'most powerful supercomputer' equation. How much memory and what type/speed? How are they linking the individual nodes? What kind of software optimizations have been done, and what software is being used to benchmark it?"

    Wrong. The top supercomputers are rated solely by FLOPS (Floating Point Operations Per Second, as I'm sure you know) as measured by the Linpack benchmark. See www.top500.org. I've never heard of memory having an impact on FLOPS; I guess it *could* if you absolutely starved the CPUs of work, but presumably all of these computers are balanced enough that the RAM can keep up with the CPUs. The nodes can be linked in any way; presumably they're linked optimally for price/performance, and I'm sure that there's nothing special about the way the G5's were linked... you don't build a supercomputing cluster and let the linking drag the performance down. As for the optimization question, I'm not sure but I'll bet Linpack is optimized for every platform/architecture.
  • Reflex - Wednesday, October 27, 2004 - link

    I have not been arguing about superiority for the PC platform. My point is that they are not directly comparable as related to this particuliar review. The product being reviewed does not have an equivilent on the Mac side of things, so going on about how this article proves that the 'price' arguement is wrong is rediculous.

    My original question has not been answered, and that is that I am wondering who is building these since I have an identical workstation here on my lab bench but with an IBM label on it.
  • karlreading - Wednesday, October 27, 2004 - link

    enuff of the mac vs. pc B$ dudes!!!
    this is a comments section about a opteron workstation, not about how a g5 spanks / get spanked by opterons ass.

    that said there is one part of this that gets me excited. Whilst coming across mac / pc arguments on forums, i have noticed one trend. AMD is now always the PC's defender. i never hear anybody citing the p4 / xeon as a mac comparison. its always opteron / a64 vs. g5. this is excellent news from AMD's standpoint, as it cements the trend that AMD is a respectable company, and also is impressive to see AMD as the lead PC saviour in the ongoing annoying "my pc's better than your mac " debate. Intel should be worried, very very worried. never thaught id see the day when my beloved AMD were championing the pc / x86 cause :)
  • gromm - Wednesday, October 27, 2004 - link

    As far as cost, I'd like to see how much Apple (and other sponsors) subsidized X. The networking infrastructure it has alone would normally be massively expensive and I can't see how it fits into the $10M pricetag quoted by them along with all compute hardware.

    From benchmarks I have run, the G5 and the Athlon64 are neck-to-neck in performance (actually the difference is small enough to be noise) in 'normal' codes (mostly FPU) and the Athlons are a little faster in integer performance. I haven't seen what Altivec/SSE2 optimizations would do for either.

    If you want some rough estimates, go to Ars Technica and look in the Battlefront forum under the Cinebench thread. There are lots of scores under there to compare for this benchmark (includes a raytracer and some other stuff).
  • michael2k - Wednesday, October 27, 2004 - link

    I'd like to see Anand run SpecViewPerf on his Dual G5, now :)
  • Reflex - Wednesday, October 27, 2004 - link

    I am aware of Apple's 'server' aspirations. That does not change anything at all. They do not have the kind of corporate support Sun or other large venders provide, and as a result the Xserve is not a large player in the market. Furthermore, its only proof that your comparing the wrong product to the Sun product this review was about. Xserve was designed to compete with workstations like this, not the PowerMac which is a desktop system.

    My comment about Sun relates to the fact that for a long time they were a detriment to the industry at a whole, pushing concepts like Java PC's with no local storage, trying to keep prices very high, and generally siding with 'Big Iron' in the market rather than embracing the future. In the past year, as Microsoft/Intel/AMD have made the Sparc obsolete they have had to get with the program, choosing AMD as their partner made perfect sense as they had no motivation to improve Intel's position considering they are still competing with them in some markets.

    In summation, Sun is finally seeing the light, however their past is one of high prices, legal shennanigans(especially in Europe where price fixing has been a common charge against them), and a strategy of defining themselves as Microsoft/Intel's opposition rather than charging their own course. The future will tell where they go, and I'll cross my fingers and hope that x86 Solaris and Opteron workstations are a sign that they are finally producing products their customers demand, rather than locking them into a model and then telling them what they need...

Log in

Don't have an account? Sign up now