OS X Performance

Now that we’ve had a chance to take a look at the construction and component selection of the MacBook, it’s time to get down the business end of the review: performance.

For the sake of brevity I’m not going to completely rehash how Core M works, especially since we just did an in-depth look at the CPU last week. But briefly, from a performance standpoint Core M behaves a lot more like a modern tablet processor than it does a traditional Intel x86 processor. Which is to say that its performance is heavily tuned around performance bursting and racing back to idle, as opposed to more traditional Intel processors which turbo as well, but overall are also designed to hold at relatively high clockspeeds under sustained workloads. Of course all of this is in part dependent on how OEMs go and design their laptops – go stuff a Core i5 in a Surface Pro 3 and watch it throttle – but at the end of the day the point is that Core M is not designed to offer the same kind of high performance under sustained workloads that Intel’s more powerful processors do.

Core M is at its heart still a power optimized Intel Broadwell design, so despite the different Core M branding it’s not all that far removed from the dual-core Broadwell-U processors in the MacBook Air and 13” Retina MacBook Pro. What sets it apart along with its package and power optimizations are its much lower power threshold – the official TDP is just 4.5W, while it can burst higher for short periods of time – and the fact that it’s designed for systems with less cooling than Broadwell-U. Case in point of course is the MacBook, which utilizes a simple aluminum case without any kind of fans (active cooling). The end result is that for workloads that go longer than a short burst, Core M’s performance is tightly coupled to the cooling capabilities of the laptop it’s in.

Ultimately what this means is that we expect that the MacBook should be able to compete with its larger brothers in those short, bursty workloads that Core M is optimized for, while in sustained workloads it’s going to fall behind MacBook Air and other laptops using Intel’s larger 15W processors.

Boot Time

We’ll kick things off quickly with a look at boot time. On an absolute basis the MacBook doesn’t do too poorly, but on a relative basis it’s behind a lot of our other MacBooks. To be clear here this is a historical chart – each machine is running the version of OS X it launched with – so the only Yosemite MacBook here is the 2015 MacBook. Still, whether it’s Core M or Yosemite, it shows that Apple’s boot times here aren’t quite as good as they have been in the past.

Mozilla Kraken 1.1

WebXPRT

Switching gears, we have an example of a semi-bursty workload with a couple of our web benchmarks. These benchmarks run a number of sub-tests, and as a result the MacBook gets a brief respite between benchmarks. Plus this gives us a chance to compare the MacBook to tablets, including of course the iPad Air 2. Meanwhile since we’ve also just recently looked at several Core M devices, I’ve also included those to provide a point of comparison to other Core M devices.

Truth be told these results are a bit surprising, though not for good reasons. The MacBook ends up being a laggard against both of our other Core M devices. Since each platform is running a high performance browser (either Safari or Chrome) and from hardware capabilities standpoint these Core M devices are all relatively close, I suspect what we’re seeing here is that OS X Safari as not as well tuned as iOS Safari is.

Compared to the tablets on the other hand the MacBook is still well ahead of any of the tablets – as it should be with Core M’s greater power consumption and the larger chassis – but there’s no denying that by scaling down the MacBook so far, the performance gap between tablet and laptop has shrunk significantly. The MacBook is less than 2x faster than the iPad Air 2 in both benchmarks, which means that within a couple of generations it’s likely that the iPad will exceed the current MacBook’s scores. If my earlier hunch about Safari optimizations is correct and OS X needs some more tuning, then the MacBook is farther ahead than what these benchmarks show. Still, it goes to show that although the MacBook is well ahead of tablets, it’s not leaps and bounds ahead like more powerful laptops would be.

3D Rendering - Cinebench 11.5 (1 thread)

3D Rendering - Cinebench 11.5 (multithreaded)

Meanwhile our large collection of Cinebench 11.5 results helps put Core M’s sustained performance in perspective. In both single-threaded and multi-threaded workloads it’s well behind the pack, though in different ways. Single-threaded performance is essentially on par with the 2012 11” MacBook Air (Ivy Bridge), and even as recent as the Core i5-equipped 2014 13” MacBook Air the 2015 MacBook is within 10%. In this case what we’re seeing is a case where a lighter workload allows one of Core M’s CPU cores to stay highly clocked (remember, it turbos up to 2.4GHz), which means it’s actually rather competitive with recent Ultrabooks. Unless forced to throttle, Core M is still Broadwell, and Broadwell flies.

Which means that when Core M is forced to throttle under the multi-threaded workloads, the performance gap widens. Ignoring the rMBP and its 4 cores, where exactly the MacBook places depends in part on the generation of the MacBook it’s compared against, followed by the CPU configuration. The base Core i5s in the MBAs and 13” rMBP are quite capable, with the most powerful of these surpassing the MacBook by upwards of 20%. In that respect the new MacBook is offering multi-threaded performance between the 2011 and 2012 MacBook Airs. On the other hand though we’re talking about the MacBook coming within 20% of larger laptops with much more powerful (15W+ CPUs), so while the MacBook can’t keep up, it’s also delivering quite a bit of performance for its size and power consumption.

3D Rendering - Cinebench 15 (1 thread)

3D Rendering - Cinebench 15 (multithreaded)

Our more recent Cinebench 15 results on the other hand find the MacBook at the bottom. Though this is in part due to a much smaller dataset we have (and mostly composed of rMBPs), it does drive home the point of just how wide the gap is between the rMBP and the new MacBook. If you want a powerful Mac capable of fast sustained performance, you’re going to want a MacBook Pro. That said, compared to the 2014 13” MBA, we once again see the MacBook holding up well in the single-threaded benchmark, outright tying last year’s larger MBA. This once again handily illustrates how Core M is no slouch with lightly threaded workloads, and how it’s heavily threaded workloads where it’s really going to need to pull back.

Adobe Photoshop Performance

Moving on, we have a look at Photoshop performance with the Retouch Artists Speed Test. This being another multi-threaded test, the MacBook throttles harder and this leaves it towards the rear of the pack. Performance is roughly on par with many of the Core i5 MacBook Airs, but it becomes a more significant gap once we step up to the i7, and I’d expect something similar if compared to a 2015 MacBook Air.

From a throttling standpoint, at just 28 seconds long I don’t believe we’re seeing any kind of significant thermal throttling in this benchmark. Rather the MacBook is falling behind on the basis of maximum clockspeeds and power limits, having to pull back because sustaining 2.4GHz for 28 seconds puts it outside of its power envelope for too long. Meanwhile on a conceptual basis I don’t see such a small laptop as the MacBook being used too much for Photoshop, but out of all of Apple’s ultra-portables, the MacBook does end up being the best fit due to its excellent screen.

Geekbench 3 Scores (64-bit)
  Single-Threaded Multi-Threaded
12" MacBook (2015) 2358 4604
11" MacBook Air (2015) 2866 5723

For our last benchmark we have Geekbench 3. Though a rather synthetic benchmark overall, it’s as close to a standard OS X benchmark as there can be. Pulling the standardized score for the 2015 Core i5 11” MacBook Air, what we find is that the MBA is ahead of the MacBook by a bit over 20% in both the single-threaded and multi-threaded tests. In terms of workloads I’d consider the single-threaded test to be a moderate workload and the multi-threaded test a heavy workload, so these results are generally what I’d expect to find. As neither workload is particularly light, it forces the MacBook to slow down a bit more, putting a bit more of a gap in between it and its Ultrabook-sized sibling.

Meanwhile I also ran the Geekbench 3 stress test for a couple of dozen loops on the MacBook to see how much performance degrades over the long term. The MacBook reaches equilibrium at around 4200, which is a 9% performance regression over a fresh run of the multi-threaded benchmark. Given the MacBook's low thermal limits it actually reaches this point rather quickly, and other sustained workloads should reach equilibrium at a similarly quick pace.

12" MacBook Skin Temperatures
  Top Bottom
Cinebench R15 38C 42C
DOTA 2 39.5C 43C

Finally, while looking at performance under OS X I also took some temperature readings while running Cinebench R15 and DOTA, to get an idea of how hot the MacBook gets under full load. Of the two benchmarks DOTA is the more intensive, pushing the GPU as well as the CPU. Consequently it also ends up being the warmest.

Taken from the top of the MacBook, along the top speaker grill and roughly above where the MacBook’s CPU is, the MacBook heats up to 38C when running Cinebench, and 39.5C when running DOTA 2. These temperatures are similar to the skin temperatures found on most mobile devices, and even then, with the hot spot being in the grill above the keyboard, users shouldn’t be coming in contact with this hot spot.

Meanwhile flipping the MacBook over and measuring the equivalent hot spot on the bottom finds that it’s appreciably warmer. We still haven’t seen a complete teardown of the MacBook, but we expect that the bottom casing is the closest to the CPU and consequently conducts the most heat. In any case we’re looking at 42C when running Cinebench and 43C when running DOTA 2. These temperatures are at the upper end of the comfort spectrum, but shouldn’t be an issue even with long-term use. More importantly, unless actually used in a lap, the MacBook’s rubber feet will keep the laptop propped up and avoiding contact with any surfaces, skin or otherwise.

The MacBook’s SSD: NVMe & an Apple Developed SSD Controller? Windows Performance
Comments Locked

354 Comments

View All Comments

  • modulusshift - Tuesday, April 14, 2015 - link

    Dudebro, Anand's out. He's at Apple now.

    Ooh, performance over time would have been good.

    Definitely with you on the performance per watt and silence, Apple has never been more environmentally friendly.

    That said, I don't think this review was bad. Could have used a little more editing, and discussion of the different models as you said. But it had some good material I've yet to see in the rest of the reviews. I wish it lived up to the standard of Anand's review of the SP3 where he gave more of his subjective opinion of how it actually ran. This guy said, yeah, it's thinner and lighter, and I like how it feels, but it's slower than my current 11 inch, so there's a little bit of a tradeoff... And I wonder, why is it slower? Is it actually less capable? What sort of experiences didn't work as you expected? What is really wrong with it?
  • wave84 - Tuesday, April 14, 2015 - link

    The point is I didn't see anything here that I haven't already read on all the other websites all the way from New York Times to the Verge to ArsTechnica. The reason we all visit AnandTech is for those really detailed, in depth 25 page reviews where every single one of our questions gets an answer. Not the case here.

    The reason why I'm being so determined is that this is a very important review. Like it or not, Apple fanboy or not, the Macbook Air has probably been the most important laptop of the last 10 years. It has basically defined the laptop market of our times and it has been studied, copied and emulated by every manufacturer out there.
    Similarly, the new Macbook is probably on a quest to do the same. I would have preferred to wait 2 weeks and read the real thing, not the same article that I've already read 10 times so far (by the way, isn't it strange that all these articles are so similar?)

    I'm in a strange boat myself. Started out getting a 2011 13" Macbook Air as a secondary computer, then it slowly transformed into a desktop replacement with an external monitor with the old desktop sold for parts (doing web development, mostly). I would currently kill for the weightlessness / screen / quietness of the Macbook, if the questions above would have been answered. Should I go for the updated 2015 Air? A somewhat bulky Pro? Or maybe just wait for Skylake?

    Why have you deserted us, Anand?!... :)
  • BillBear - Tuesday, April 14, 2015 - link

    I don't get the feeling that this would be a viable desktop replacement if you're at all concerned about gaming.
  • lilo777 - Tuesday, April 14, 2015 - link

    Hence the term "hybrid". This device is not good either as a desktop replacement or a tablet replacement (or even as a regular laptop replacement). It's a "hybrid" then (probably good for nothing).
  • Ryan Smith - Tuesday, April 14, 2015 - link

    Hi Wave, thanks for the feedback. To get right to answering your questions.

    1) This was the base model, so the $1299 5Y31 model. Apple only samples a single model, so I do not know how the higher end model would fare. However what we've found when looking at other Core M devices is that faster processors can end up throttling sooner, which can be counter-productive. http://www.anandtech.com/show/9117/analyzing-intel...

    2) If a load is going to cause the laptop to throttle, it does so almost immediately. As noted in the review, even the 28 second Photoshop benchmark is long enough to require some throttling. As a result pretty much anything longer than a long webpage load is going to face power limits, and longer use will also bring on thermal limits.

    Also, while it's not in a chart, I mentioned in the Geekbench 3 section that we ran the stress test. the MacBook reaches equilibrium almost immediately; by the second run it's already down to its steady-state score of 4200.

    What this means is that the MacBook can only run at its higher clockspeeds for very, very short periods of time. As a result "performance over time" would be on the order of seconds. This isn't like an Ultrabook or other laptop where performance slowly degrades over time as the cooling system slowly falls behind.

    3) Poorly. I wouldn't suggest it. DOTA 2 is about as strenuous as it's going to be able to take. Unfortunately we can't test any of those games as there isn't a suitable FRAPS-like utility for Yosemite to let us do proper benchmarking.

    4) The issue with testing efficiency is that to properly test it we need to isolate the CPU and measure it directly. You're not wrong, this is a very efficient processor, but there isn't currently a great way to systematically show that since there's no way to separate the CPU's power consumption from the display's power consumption.

    Anyhow, I'm sorry to hear the review didn't live up to your full expectations, but none the less thank you for the feedback and thank you for reading it.
  • wave84 - Wednesday, April 15, 2015 - link

    Thank you for answering all of my questions, Ryan. I withdraw all my complaints :)
  • Kevin G - Wednesday, April 15, 2015 - link

    3) I thought Apple's developer tools for OpenGL has a FRAPs-like tool included. I'll have to check when I get home later today.

    I do know for certain that it has the ability to record VRAM usage over time. Found this out playing around with a GTX 770 and 970 to see just how difficult it was to go over 3.5 GB.
  • Ryan Smith - Thursday, April 16, 2015 - link

    It shows you the frame rate, but it doesn't allow you to record it to find the average frame rate over time.
  • yticolev - Wednesday, April 22, 2015 - link

    Hi Ryan, thanks for the excellent review. It supplied details that no other review did. I do have one question that I was hoping would be addressed and that wave84 also asked: buying advice related to Skylake. If what I read is correct, Skylake will be out in just a few months with significant changes to chip architecture promising both better performance and battery life. Better GPU is part of that. It would kill me to purchase now and miss out on an extra hour of battery life with a midyear update.

    I certainly can wait. I have a perfectly cromulent late 2007 Blackbook that I have not been tempted to upgrade until this new MacBook (which is a huge upgrade to be sure). Now I've got buying fever despite the hassle and expense of upgrading a number of applications that require Rosetta.

    One other very minor point, I was surprised you didn't mention iSight as it is a downgrade over other current Apple machines.
  • modulusshift - Tuesday, April 14, 2015 - link

    Replaceable instead of replicable, page 2
    table instead of cable, DisplayPort instead of DisiplayPort, page 6
    could you fix the number for 2010 MBA (last entry) in the 4KB Random Write (8GB LBA, QD3) chart? page 8
    tuning instead of turning page 9
    On the one hand instead of For one the one hand, second to last page as mentioned by earlier comment.

    Thank you for your review.

Log in

Don't have an account? Sign up now