As mentioned earlier, if this was a $329 Windows 8 notebook, it would be considered severely compromised, especially compared to notebooks priced closer to $500. When we heard about the presence of a mechanical disk, we wondered what sort of an impact this would have on performance. The embedded SSDs we're used to in Chromebooks don't exactly offer breakneck speeds, but we've shown time and again that there is often a performance difference of several orders of magnitude between the fastest mechanical drives and the slowest modern SSDs. Thankfully, we're never lacking in NAND-based storage, so we swapped in an idle 120GB OCZ Agility 3. Most of our suite of web tests can live comfortably in RAM, and with nothing but Chrome as our platform the user really shouldn't ever experience how slow the mechanical drive is really, except in boot times.

Acer C7 Chromebook HDD v. SSD
HDD SSD % Delta
Sunspider (in ms) 527.1 499.4 5.26
Browsermark 2.0 3403.7 3356.7 -1.38
RIABench Focus-tests (in ms) 1193.7 1185.7 0.67
Kraken (in ms) 6817.2 6758.7 0.86
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 16 -5.88
Maze Solver (in s) 17 17 0
Solar System (fps) 31.67 31.0 -2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

The only difference of statistical significance is the WebGL Aquarium test. Like all operating system's, Chrome OS relies on a page file on local storage for those occasions where memory is insufficient for the active tasks. Typically you would see inactive bits shuttled into the page file and then recalled to memory when RAM is available and those particular bits are necessary. We run our test suites with no other programs or browser instances running, so anything that spills over to local storage is the result of that 2GB RAM limitation. The WebGL Aquarium test is bulky enough that it spills into the cache and the result is a huge increase in performance when an SSD is used. How does this difference manifest in the real world? Most likely users might perceive some speed increase when swapping between tabs, and better boot times. So if the HDD doesn't do much for performance, what about the RAM? The C7 comes with a scant 2GB of memory, on a single SO-DIMM; that's well below what we'd recommend for even the most budget notebook experience in Windows or OS X, but perhaps enough for the small footprint of Chrome OS. Let’s find out if it’s enough by swapping the single SO-DIMM for a pair totaling 4GB.

Acer C7 Chromebook 2GB v. 4GB
2GB 4GB % Delta
Sunspider (in ms) 527.1 500.3 5.03
Browsermark 2.0 3403.7 3334.0 -2.05
RIABench Focus-tests (in ms) 1193.7 1218.7 -2.09
Kraken (in ms) 6817.2 6617.1 2.94
Bubbles (fps) 19 19 0
Fishbowl (fps) 17 17 0
Maze Solver (in s) 17 18 5.88
Solar System (fps) 31.67 32.33 2.11
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46


Acer C7 with back cover removed, 2x2GB SO-DIMM installed

The data is quite reminiscent of the deltas we saw after swapping in the SSD, and that validates the suspicion that even in our test environment, 2GB of RAM can be overwhelmed quickly and the device can end up hitting local storage more than we'd like. By raising memory to 4GB we still see negligible performance changes in the majority of tests, but a huge increase in the Aquarium test.

There's more to it than synthetics, though. We're used to having an excess of browser tabs and windows open at once here at AnandTech. My workflow generally involves at least three windows, and several tabs in each, and I may hop between many tabs in quick succession to look through research or move between GMail and Google Reader or Twitter. While working with the stock configuration it wasn't uncommon to have tabs I had just moved away from refresh when I moved back to them. At first I wondered if this was an expected response, an effort by Chrome to ensure that the most current content was presented to the user, but this strategy seemed foolish in too many instances to make it logical. Take for instance shopping; if you're working on a computer configuration, it would be a nuisance to have to repeat your selections whenever you switch tabs, triggering a refresh. What became clear once I'd switched to the 4GB configuration was that the behavior was really related to memory capacity. When a tab is moved from memory to the local disk, a flag is tripped telling Chrome to refresh the content when the user returns to it. With an appropriate amount of memory the only tabs that would end up in local storage would be ones that hadn't been accessed for quite a while. Here, though, the tabs end up getting refreshed every time they are accessed. From a user perspective it was night and day; one configuration could hardly handle a half dozen tabs, the other seemed unfazed by my regular workflow.

So, more memory and better storage are all it takes to juice up the C7, right? Not quite. The single biggest performance improvement required just a few clicks. Just as Google is constantly pushing updates to the Chrome browser, Chrome OS is frequently updated and several build channels are available. We did all of our testing on the Stable channel, which sees fewer updates than either the Beta or the Unstable (Dev) channels. Performance and stability tweaks will be the most common aims for updated dev builds, though occasionally features may be added to the Dev channel and slowly make their way to the Stable builds. So, how does the Dev build compare to Stable?

Acer C7 Chromebook Stable v. Dev Build
Stable Dev % Delta
Sunspider (in ms) 527.1 512.4 2.79
Browsermark 2.0 3403.7 3561.7 4.64
RIABench Focus-tests (in ms) 1193.7 1260.3 -5.59
Kraken (in ms) 6817.2 6411.8 5.95
Bubbles (fps) 19 14 -26.3
Fishbowl (fps) 17 39 129.4
Maze Solver (in s) 17 18.7 9.8
Solar System (fps) 31.67 28 -11.6
Cubes (fps) 30 30 0
Aquarium (fps) 43.3 60 38.46

Often, when software is tweaked for performance in one area, it's at the expense of performance in others. Here you see some marginal improvements in JavaScript performance, and some enormous improvements in tests that leverage the GPU. The increase in the HTML5 Fishbowl test is enormous and likely indicates that the Stable build doesn't feature GPU acceleration for the HTML5 techniques being used. A loss in performance in the Bubbles test could indicate that other changes to the JavaScript engine limited performance in some elements. When you look at the WebGL tests, the results show a clear improvement in GPU performance, despite the negligible drop in performance in the Solar System test.

In addition, the Dev channel features options for extending the OS's desktop onto a second display, though I'm not sure the utility, except for those that often need to see two browser windows side by side and are hampered by the limited screen space. So are their any deficits to using the Dev build? During testing the Dev build featured no major instability and had no lock-ups or other hinky behavior. So, ultimately, my only complaint with switching to the Dev channel is that returning to the stable channel requires a full recovery.

Performance: Core vs. ARM A15 Battery Life and Conclusion
Comments Locked

63 Comments

View All Comments

  • Spoelie - Tuesday, January 22, 2013 - link

    mhz doesn't matter, it's just a function of architecture on a given process node.

    With the celeron, you get 15% better cpu performance for 65% of the battery life, which is a pretty lousy showing imo.

    On the other hand, at least the GPU is an improvement.
  • madmilk - Wednesday, January 23, 2013 - link

    MHz does matter. Sandy Bridge is not optimized to actively run at 800MHz - its sweet spot is around 3GHz. You pay a huge perf/watt penalty through leakage. An i7 doing the same tasks can go to sleep and power gate in 1/4 the time.
  • BedfordTim - Monday, January 21, 2013 - link

    Agreed. I was surprised how close the A15 was. Given the level of development that has gone into x86 processors, you would expect the code to be faster, and the gap should close with time.
  • silverblue - Tuesday, January 22, 2013 - link

    I think it could be the case that making an architectural change yields significant benefits, however after you while you'd end up like Intel, spending a huge amount of money to eke out a few more percent. I doubt that the next big step for ARM would be anything like A9 to A15 was.
  • andrewaggb - Tuesday, January 22, 2013 - link

    I know when I saw the benchmarks I had to go back and look at the x86 specs. For a second I thought the A15 was way faster than I expected. But then I saw just how crippled the celeron is and everything made sense...
  • JasonInofuentes - Monday, January 21, 2013 - link

    Others pointed this out, but the take away from performance a performance standpoint is that if you take the second fastest x86 core designs in the market today, gut them, take out their legs, wrap a chain around their neck and put blinders on them, they're still faster than the fastest ARM Cortex-based SoC on the market today.

    The big play with A15 is that they have finally reached IPC parity with small notebooks. And while that would have definitely been true 5 years ago when Atom was still fresh and Sandy Bridge was off the edge of Intel's road map slides, it is now not nearly so strong a case. In terms of performance/watt, ARM has done a very very good thing and they should be commended for that. And I have no doubt that a Chromebook equipped with Exynos 5 clocked at 2.3GHz would wipe the floor with the Acer C7. But we're still talking about putting a featherweight champion against a heavyweight punching bag.

    We'll explore this relationship a little further, indeed you can get some feel of it in Anand's reviews of the Win8 tablets that have been coming out. Stay tuned.
  • lmcd - Saturday, January 26, 2013 - link

    Hmm, but the graphics are an important point, and it seems like ARM (Mali-series) and Nvidia have a better roadmap there. Maybe a T4 Chromebook could take down an Ivy or Haswell ULP? Or an Exynos-Quad?

    Worth seeing.
  • bleh0 - Monday, January 21, 2013 - link

    I'll wait till there is a reliable way to put Mint 14 on it. Until then you might as well put money towards the Samsung chromebook.
  • mutatio - Monday, January 21, 2013 - link

    Never mind the fact that this product, in similar fashion to the Droid phones, is designed entirely with the focus of mining, harvesting, and exploiting your personal data for their profit. No thank you, Google. Hell, I'll pay the Dell/HP "premium" of a $299 or $399 laptop/ultrabook to avoid that whole arrangement. Mind you, I've already happily paid the Apple premium to have devices focused on my ease of using them rather than the ease of which my information is exploited. Apple has a much better track record in respecting user's privacy, making the disclosure of it voluntary rather than inherent to the products being used.
  • phillyry - Monday, January 21, 2013 - link

    That's a good point.

    It really does seem like Google's dark side is starting to show now that they've got a death grip on the market.

    It's like, "Mawahaha, now that we've got you in, we'll just monitor and monetize every aspect of your virtual life. Hahaha!"

Log in

Don't have an account? Sign up now