Our New Benchmark: FrameGetter

OK, FrameGetter is not the best name for a benchmarking utility - but we are engineers and computer scientists, not marketing geniuses. Last week, we took some time to introduce everyone to our new Linux GPU benchmark. Fortunately, it was received with incredible success - both by our industry peers and our readers. You can read more of the program specifications as described by the lead developer, Wiktor Kopec, here. Just to recap, here is how the program works again:
  • We install a few libraries in the lib directory that are passed data from each game.
  • A shell program in the FG suite copies and modifies the game executables. All references to libGL and libSDL in the copy are replaced with our library installed in the first step.
  • The modified game executable runs while happily sending data to our libraries. Our libraries look for swap while dumping the input occasionally to the /tmp directory.
  • Frames per second and time are written to the screen on some games.
  • The frames per second are written into /tmp/fg_logfile.
  • A batch program included in the suite converts the FG screenshots into PNG files.
Obviously, there is a lot of room for improvement here. We made our program open source with the intention of allowing anyone to modify and edit the program to suit to their liking. Some of the additions that we are working on include dumping the screenshots in a readable bitmap format and binding keys to start/stop frame capture. Be warned that capturing a program with the FG modified executable on a 1280x1024 resolution consumes approximately 30GB/hour. Converting to PNG during capture consumes too much CPU usage, so we have not done that yet.

Here, you can download version 0.1.0 of the AnandTech FrameGetter source and executables. Please read the documentation very carefully. FrameGetter uses a BSD style license. Even though FrameGetter is geared toward GPU benchmarking, it can provide excellent information for CPU benchmarking as well. Using the same video card, but different CPU configurations, has a lot of outcome on the frame rate. Different branching and prediction show different results from card to card - we will be using this in some upcoming Linux CPU tests.

Index Let's talk about Drivers


View All Comments

  • directedition - Monday, October 04, 2004 - link

    Oh, and a note on some SDL games on SUSE. On games like UT (original) and many other games using the same old installer, you need to create /mnt/cdrom and mount your cdrom there, as the installers don't tend to look for SuSE's /media/dvd nonsense, and it will often keep asking you to insert the CDROM. Reply
  • directedition - Monday, October 04, 2004 - link

    I can't belive noone's mentioned it yet, but Warcraft is an odd example of a game that tends to run better emulated under Cedega (SuSE 9.1) than natively on Windows. Blizzard has a decent relationship with Transgaming. While they won't do a native port of Warcraft III, they are willing to help Transgaming make their game compatible.

    I would definately like to see AnandTech take a look into this and why various Cedega games run better than others.
  • Ardan - Monday, October 04, 2004 - link

    Gaming in linux doesn't take hours to achieve. If it took you hours to properly install something like, say, Enemy Territory, then you are doing it all wrong.

    I have set up gaming in linux on both an ATI and an nvidia card lately and neither are hassles. ATI's Linux development team has been making great strides, so don't sell them short. I fully expect them to start rolling along with new features and better support. Comparing them to when I used nvidia's older linux drivers to what they have now, it took a VERY long time to achieve. However, ATI is making strides in a shorter amount of time. Don't worry about that:)

    I loved the article a lot as well, but I would like to point out that the latest ATI drivers are 3.14.1. I do not think that everything has to be open-source to be good in linux. ATI and nvidia are clearly capable of engineering great cards and great drivers, so I am okay with closed-source. Surely it must be an even bigger benefit to them to be able to see the source of the OS they're programming for.

    Anandtech, keep up the good work on the Linux articles! They keep getting better and better.
  • ballero - Monday, October 04, 2004 - link

    Great article.
    you can use "nvidia-settings" (the control panel) to set up both AA and AF
  • Pannenkoek - Monday, October 04, 2004 - link

    UT is not a SDL game, but an OpenGL game in Linux. SDL is a library for making graphical applications easier (made by Epic, open source) and is comparable to DirectX excluding Direct3D.

    Graphics is a weak spot in Linux, mostly due to the fact that NVIDIA and ATi are paranoid to open their hardware spec so no open source cutting edge video drivers can be made. Stable video drivers, now that would be refreshing.

    A stable Linux system will never lock completely, but insert proprietary closed source drivers and redirect all input to X and you get pretty close to the Windows experience.

    Fortunately there is finally fast development in the X compartment now that Xfree is dying and with Xorg.
  • Illissius - Monday, October 04, 2004 - link

    Nice article. Mostly mirrors my experience - I haven't been able to get ATi drivers to install at all (this was a few months ago) on either Mandrake, Knoppix (disk install), or Xandros, which was the point at which I gave up and got an nVidia card, and moved to Gentoo at the same time. Installing the drivers was pretty damn easy as far as Gentoo goes* - 'emerge nvidia-glx', add nvidia to the modules autoload list, change the driver in xorg.conf from 'nv' to 'nvidia', and I think that's about it. Of the games I tried (UT2003 demo, UT2004 demo, Wolfenstein: ET) all worked flawlessly, and as far as I can tell the same speed as under Windows. AA/AF worked also - nVidia has a nice graphical control panel for them too (called 'nvidia-settings' in portage); it's not as full featured as their Windows drivers, but it does the job.

    * What I like about Gentoo is that although you have to setup most things manually, you generally don't have to touch them again after you do. The distro gives you a lot more control over your entire system than 'user friendly' ones like SuSE/Mandrake/Fedora, as well. ie, if you're fascinated with customization, have tried far too many Windows tweak utilities, and can find your way around the registry well enough, there's a good chance it's the distro for you.
  • Lonyo - Monday, October 04, 2004 - link

    #3, ATi is generally poorer with OpenGL games than nVidia, and Linux doesn't support DirectX (a Windows thing), so it's fairly obvious that the nVidia cards (which are better at OpenGL), will be better than the equivelant ATi cards (which are generally better at Direct 3D stuff - looking at NV3x vs R3xx) Reply
  • Lonyo - Monday, October 04, 2004 - link

    Have you been working with the 3Dc people? (I notice one of their forum members featuring in a screenshot, an immature one IMO at that ;))
    Congratulations for putting up a Linux gaming article, it would be nice if you could do older cards though (I was thinking of setting up a machine with a GF4 Ti4400 to run Linux).
  • adt6247 - Monday, October 04, 2004 - link

    Good article. The one thing that I thought was lacking is the comparison to FPS's under Windows. That would be incredibly useful.

    One more thing -- nVidia actually has a graphical configuration panel for Linux. I forget what it's called; I use it all the time to set AA/AF settings on my box, but my machine is at home, and I'm at work now. I'll post later with the name of the binary.
  • adt6247 - Monday, October 04, 2004 - link


Log in

Don't have an account? Sign up now