As mentioned earlier, if this was a $329 Windows 8 notebook, it would be considered severely compromised, especially compared to notebooks priced closer to $500. When we heard about the presence of a mechanical disk, we wondered what sort of an impact this would have on performance. The embedded SSDs we're used to in Chromebooks don't exactly offer breakneck speeds, but we've shown time and again that there is often a performance difference of several orders of magnitude between the fastest mechanical drives and the slowest modern SSDs. Thankfully, we're never lacking in NAND-based storage, so we swapped in an idle 120GB OCZ Agility 3. Most of our suite of web tests can live comfortably in RAM, and with nothing but Chrome as our platform the user really shouldn't ever experience how slow the mechanical drive is really, except in boot times.

Acer C7 Chromebook HDD v. SSD
HDD SSD % Delta
Sunspider (in ms) 527.1 499.4 5.26
Browsermark 2.0 3403.7 3356.7 -1.38
RIABench Focus-tests (in ms) 1193.7 1185.7 0.67
Kraken (in ms) 6817.2 6758.7 0.86
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 16 -5.88
Maze Solver (in s) 17 17 0
Solar System (fps) 31.67 31.0 -2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

The only difference of statistical significance is the WebGL Aquarium test. Like all operating system's, Chrome OS relies on a page file on local storage for those occasions where memory is insufficient for the active tasks. Typically you would see inactive bits shuttled into the page file and then recalled to memory when RAM is available and those particular bits are necessary. We run our test suites with no other programs or browser instances running, so anything that spills over to local storage is the result of that 2GB RAM limitation. The WebGL Aquarium test is bulky enough that it spills into the cache and the result is a huge increase in performance when an SSD is used. How does this difference manifest in the real world? Most likely users might perceive some speed increase when swapping between tabs, and better boot times. So if the HDD doesn't do much for performance, what about the RAM? The C7 comes with a scant 2GB of memory, on a single SO-DIMM; that's well below what we'd recommend for even the most budget notebook experience in Windows or OS X, but perhaps enough for the small footprint of Chrome OS. Let’s find out if it’s enough by swapping the single SO-DIMM for a pair totaling 4GB.

Acer C7 Chromebook 2GB v. 4GB
2GB 4GB % Delta
Sunspider (in ms) 527.1 500.3 5.03
Browsermark 2.0 3403.7 3334.0 -2.05
RIABench Focus-tests (in ms) 1193.7 1218.7 -2.09
Kraken (in ms) 6817.2 6617.1 2.94
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 17 0
Maze Solver (in s) 17 18 5.88
Solar System (fps) 31.67 32.33 2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46


Acer C7 with back cover removed, 2x2GB SO-DIMM installed

The data is quite reminiscent of the deltas we saw after swapping in the SSD, and that validates the suspicion that even in our test environment, 2GB of RAM can be overwhelmed quickly and the device can end up hitting local storage more than we'd like. By raising memory to 4GB we still see negligible performance changes in the majority of tests, but a huge increase in the Aquarium test.

There's more to it than synthetics, though. We're used to having an excess of browser tabs and windows open at once here at AnandTech. My workflow generally involves at least three windows, and several tabs in each, and I may hop between many tabs in quick succession to look through research or move between GMail and Google Reader or Twitter. While working with the stock configuration it wasn't uncommon to have tabs I had just moved away from refresh when I moved back to them. At first I wondered if this was an expected response, an effort by Chrome to ensure that the most current content was presented to the user, but this strategy seemed foolish in too many instances to make it logical. Take for instance shopping; if you're working on a computer configuration, it would be a nuisance to have to repeat your selections whenever you switch tabs, triggering a refresh. What became clear once I'd switched to the 4GB configuration was that the behavior was really related to memory capacity. When a tab is moved from memory to the local disk, a flag is tripped telling Chrome to refresh the content when the user returns to it. With an appropriate amount of memory the only tabs that would end up in local storage would be ones that hadn't been accessed for quite a while. Here, though, the tabs end up getting refreshed every time they are accessed. From a user perspective it was night and day; one configuration could hardly handle a half dozen tabs, the other seemed unfazed by my regular workflow.

So, more memory and better storage are all it takes to juice up the C7, right? Not quite. The single biggest performance improvement required just a few clicks. Just as Google is constantly pushing updates to the Chrome browser, Chrome OS is frequently updated and several build channels are available. We did all of our testing on the Stable channel, which sees fewer updates than either the Beta or the Unstable (Dev) channels. Performance and stability tweaks will be the most common aims for updated dev builds, though occasionally features may be added to the Dev channel and slowly make their way to the Stable builds. So, how does the Dev build compare to Stable?

Acer C7 Chromebook Stable v. Dev Build
Stable Dev % Delta
Sunspider (in ms) 527.1 512.4 2.79
Browsermark 2.0 3403.7 3561.7 4.64
RIABench Focus-tests (in ms) 1193.7 1260.3 -5.59
Kraken (in ms) 6817.2 6411.8 5.95
Bubbles (fps) 19 14 -26.3
Fishbowl (fps) 17 39 129.4
Maze Solver (in s) 17 18.7 9.8
Solar System (fps) 31.67 28 -11.6
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

Often, when software is tweaked for performance in one area, it's at the expense of performance in others. Here you see some marginal improvements in JavaScript performance, and some enormous improvements in tests that leverage the GPU. The increase in the HTML5 Fishbowl test is enormous and likely indicates that the Stable build doesn't feature GPU acceleration for the HTML5 techniques being used. A loss in performance in the Bubbles test could indicate that other changes to the JavaScript engine limited performance in some elements. When you look at the WebGL tests, the results show a clear improvement in GPU performance, despite the negligible drop in performance in the Solar System test.

In addition, the Dev channel features options for extending the OS's desktop onto a second display, though I'm not sure the utility, except for those that often need to see two browser windows side by side and are hampered by the limited screen space. So are their any deficits to using the Dev build? During testing the Dev build featured no major instability and had no lock-ups or other hinky behavior. So, ultimately, my only complaint with switching to the Dev channel is that returning to the stable channel requires a full recovery.

Performance: Core vs. ARM A15 Battery Life and Conclusion
Comments Locked

63 Comments

View All Comments

  • JasonInofuentes - Tuesday, January 22, 2013 - link

    In the terminal I was able to run cat /proc/cpuinfo during lots of scenarios and the output was always 800MHz. Since there's no way to run monitoring programs in a Chrome OS instance, and since the clock and voltage tables aren't exposed as they were in the Samsung Chromebook, we don't know whether this is an intermediate state, but based on the results I'm confident of that figure as the max clock.
  • Exophase - Tuesday, January 22, 2013 - link

    Are you sure it said 800MHz for both cores? Can you test it while running a workload you know is pegging the CPU indefinitely, preferably a backgrounded command line task like dd?

    Frankly I think the scores don't really add up for 800MHz. Look at what the lower end Samsung Chromebox achieves here:

    http://www.tomshardware.com/reviews/chromebox-chro...

    That uses a Celeron B840 which is clocked at 1.9GHz, and since it isn't running on a battery they'd have no reason to underclock it. If you scale its Sunspider score of 296ms from 1.9GHz to 1.1GHz you get 511ms, which fits perfectly with the values you got in this review. At 800MHz you would expect a number closer to 700ms. This is assuming linear scaling, but given Sunspider is single threaded and these are fairly low clocks for both I doubt you'd get much worse. I also doubt that V8 made huge improvements in its x86 performance since then.
  • sonnyrao - Sunday, January 27, 2013 - link

    Hi, it is definitely a 1.1Ghz processor, but has cpu frequency scaling enabled like any other modern system. I'm not sure what scenarios you ran but looking at /proc/cpuinfo isn't really the best way to determine frequency. At the minmum, you should be looking at /sys/devices/system/cpu/cpu*/cpufreq/scaling_cur_freq
    but running something like powertop or i7z would be even better (you can copy them onto the C7 from another 32-bit Linux system)

    I'd do something like this, put it into dev mode, open a window for crosh (ctrl-alt-t) and run the shell from there sudo to become root
    then run
    watch -d cat /sys/devices/system/cpu*/cpufreq/scaling_cur_freq

    and then run your benchmarks in another window.
  • jabber - Tuesday, January 22, 2013 - link

    I've been trying out Lenovo Q180 Nettops recently. The ones I've been rolling out have the top end 2.1Ghz Atom in them, with 4GB of ram and a HD6450 GPU in them.

    Tally this together with a Sandisk Extreme 120GB SSD and the computing experience is pretty good. In all the usual computing tasks I couldn't tell it was an Atom based machine. It felt as fast and fluid as any full size x86 PC I have around. I've rolled a few of them out to small businesses and feedback has been excellent.

    The problem with Atom is that makers feel they have an excuse to pair them up with even crappier hardware. Throw in an Atom chip with some decent supporting hardware and you have a pretty good low power setup.
  • lmcd - Saturday, January 26, 2013 - link

    The graphics tied with Atom are probably the most hindering aspect.
  • max347 - Tuesday, January 22, 2013 - link

    Great review!

    I think the pics could use a little less bokeh though :-)
  • nathanddrews - Tuesday, January 22, 2013 - link

    LOL - first thing I thought of. DOF is cool, but not if you can't even tell what's on the IO panel.
  • JasonInofuentes - Wednesday, January 23, 2013 - link

    Fair enough, I'm trying to get a nice light set-up that would facilitate more bokeh-free shots, but in the meanwhile I'm generally just trying to keep people from seeing the mess my house is generally in. :) Thanks for the compliment.

    Jason
  • Notmyusualid - Wednesday, January 23, 2013 - link

    And it was so dog dam slow, that I GAVE IT AWAY, as soon as I got back from my deployment in the USA.

    Really, it gave me chest pains waiting for it to do anything.

    I tried upgrading the RAM, and that made very little difference.

    I realised quickly that I was wasting my time.

    The 10yr old niece was happy to receive it though....
  • dj christian - Thursday, January 24, 2013 - link

    Justin where did Anand cover the Chrome OS? It would be nice if you could provide us with a link to it.

    Thanks!

Log in

Don't have an account? Sign up now