The Performance Implications of Multitasking

I noticed that many users were frustrated that the split screen multitasking in iOS 9 was only being brought to the iPad Air 2 and future iPads. If you’re an iPad Mini 3 owner then I think you’re rightfully upset, as your tablet launched at the same time as the Air 2. Users who aren’t aware of things like how much RAM an iOS device has may see this as artificial segmentation. Unfortunately, it’s really a result of the fact that every iOS device before the iPad Air 2 had only 1GB of RAM at most. The iPad Air 2 has 2GB of RAM, and this is crucial to enabling multitasking. But with iOS already running into RAM limitations just running a single intensive app on 1GB devices, it’s very reasonable to question whether or not even 2GB is enough to be running two applications. There’s also the question of whether or not the CPU is up to the task. To try to answer these questions about CPU and memory usage I’ve constructed a couple of use cases which attempt to saturate these components of the system.

Since Apple’s default apps are so lightweight, it’s difficult to set up an actual CPU test for multitasking right now. During this test I had Photos in a 50/50 split with Safari, along with a video playing using picture-in-picture. Since nothing was going on in Safari the CPU usage was very low. Decoding video occurs on its own fixed function blocks as well, so there’s very little CPU usage there. If you decide to try and play Hi10P or HEVC files in another application then you might see CPU usage rise very high during video decoding, but that’s a very limited set of users.

I found that editing in the Photos app seemed to be the most intensive task that you can do with Apple’s default apps, and even it only uses 50-60% of a single core on A8X. Backboardd is also using an additional 24% of a core as it handles information coming from various device sensors and input. As far as Apple’s apps go, A8X is more than fast enough to handle running two applications at once.

Once you consider some more intensive third party apps things get a bit more stressful for the system. While I can’t test this with a split view due to the fact that no third party apps support it yet, you can see above that Adobe’s Photoshop Express application can use an entire CPU core and 65% of another simply by applying photos to filters and rendering the changes in real time. If you were to run two apps of this intensity you would still likely not saturate A8X’s CPU capabilities as you would need to be interacting with both apps at the same time, but it does highlight the possibility that if one application is doing any sort of intensive work on its own it could end up having a negative impact on the performance of the other active application. However, I think for 99% of use cases there’s nothing to worry about as far as CPU performance goes when multitasking on the iPad Air 2.

My test of RAM naturally involved Safari. Safari is an app that quite frankly does not work incredibly well on any iPad except for the Air 2. The reason I say this is because there’s a very rapid eviction of tabs due to the limited amount of memory on those devices. I can recall situations on iOS 7 where an iPad Mini Retina was unable to keep three heavy tabs in memory at the same time. In my test case I have Safari with 6 tabs open. These tabs are all pages from a certain technology website which has particularly heavy pages. With all six pages loaded into memory, I then open the Apple Maps app and enter a split screen view, and I then proceed to bring the map to a 3D city view which requires the caching of various models and textures in memory. Below you can see my observed memory usage.

As you can see, the Safari process and all its tabs ends up using a whopping 728.12MB of RAM. A 3D view of New York City in Maps uses another 322.73MB on top of that, for a total of 1.05GB. On top of that you’ll have something between 100 and 200MB used for general background processes and the iOS system. This makes it pretty clear why Apple has limited multitasking to only the iPad Air 2, as a use case with only two default apps can already use over 1GB before you even consider what the system needs. One could argue that Safari could evict tabs to free up memory, but there are other applications that can’t jettison memory that easily, and even then evicting tabs from memory creates a poor user experience. That brings us to the next question: is even 2GB of RAM enough?

Since most of Apple’s included applications are fairly lightweight, it’s safe to say that you won’t come close to using 2GB of memory even when multitasking unless you open a very large number of Safari tabs. However, many third party applications can be very complex. You could be handling very large images, or drawing complicated 3D scenes. Naturally, these applications will require more memory to keep all of the assets that they’re working with accessible.

The above image shows you the memory usage when the foreground app on a device is Paper by FiftyThree. This is my favorite mobile drawing application, and it’s what one would call a very simple 2D drawing app. You’re not working with extremely high res bitmaps, or RAW image files, or 3D models. Despite that, I was able to see memory usage peak as high as 376MB. In a theoretical case where one had paper in split screen view with Safari, your total RAM usage for the entire system would be somewhere between 1.1 and 1.2GB. This is still well below the total amount of memory the iPad Air 2 has, but a web browser and a simple 2D drawing app in split screen is hardly the most RAM intensive situation I can imagine. If you were to have two applications with a memory footprint as large as or even larger than my Safari example then you could end up running into the 2GB memory wall. This isn’t even considering the memory impact of picture-in-picture windows, or spikes in memory caused by loading in new assets due to the user resizing the split between two apps or interacting with the applications themselves. Even if you can manage two active apps and the system processes with 2GB of RAM, you may end up having to evict every other background application to do so.

The question now is what the solution to this potential issue is. The most obvious is to start shipping devices with more RAM. Apple has traditionally been very conservative with the amount of memory they include in both their mobile devices and even their computers, but in the mobile world it’s becoming a more pressing issue as applications become far more advanced to make use of the enormous increases in mobile processing power, while the amount of memory they can use hasn’t increased nearly as much. Outside of more physical memory, developers can optimize their applications to manage and use RAM as effectively as possible. There’s only so much that a developer can do to minimize memory usage, and beyond that there’s really only one more solution, and it’s not something that I ever expected to see in mobile in the same way it was implemented in PCs. That solution is memory mapped data, which you may also know as swapping to disk or paging.

iOS has actually supported memory mapped data for a number of years, but in iOS 9 Apple is making it more well known to developers and recommending that it be used to manage the memory use of applications rather than its traditional purpose of streaming large files or groups of files that couldn't all fit into memory at once. Apple’s recommendation is that it be used for unchanging read only data, such as images. While this is a “solution”, it introduces the possibility of the user encountering page faults, which is an error/exception that occurs when the system is trying to access memory that is mapped into virtual memory but not actually loaded into RAM. This is something that, for the most part, has never existed on mobile devices. The reason for this is that even with NAND based storage solutions that are several orders of magnitude faster than spinning disk storage, your system memory and cache are significantly faster. Quite frankly, this situation is embarrassing when one considers how much users pay for iPhones and iPads.

I think in most cases, the 2GB of RAM in the iPad Air 2 will be enough to handle two foreground applications. That being said, with 2GB of RAM it’s still possible that you could get dangerously close to having an active app evicted from memory if they're very RAM heavy, such as applications that work with complicated 3D models. Multitasking may also require many background applications to be killed. Even with tricks like compressed memory and high levels of memory optimization, the fact of the matter is that the amount of RAM shipping in iOS devices has needed an increase for a while now, and in the case of the iPad I think it needed to go beyond 2GB. Not only could there be issues in the future with the iPad Air 2, but Apple has been forced to block the split screen feature from every other existing iPad, which is ridiculous when you consider that the best iPad Mini you could go and buy before last week is on the list incompatible devices. Paging is not really an acceptable solution, as the latency of NAND is somewhere around 10x higher than DRAM, and 25x higher than L3 cache.

As for CPU usage, I think A8X is more than fast enough to handle 99% of use cases. If you have an app rendering a video and are also editing photos at the same time you may run into issues, but beyond those edge cases you can expect very fluid performance in both active applications. I'm interested in seeing how the iPad Mini 4 handles multitasking with its dual core Apple A8 SoC.

What would have been optimal for RAM would be if Apple had moved to 2GB with A7 to offset the additional memory usage of 64bit applications, and moved to 4GB in the next generation iPads (Air 2, future devices) to accommodate multitasking. An accidental leak from Adobe implies that the iPad Pro actually will come with 4GB of RAM which is great, but it's possible that the user experience may suffer in heavy use cases with multitasking occurring on existing iPads. Alternatively developers will be limited in the functionality and experiences they can provide in order to function within the limited amount of memory they have to work with, which wouldn't be a good situation either.

Multitasking On The iPad Under the Hood: UI Navigation, Input, App Thinning
POST A COMMENT

227 Comments

View All Comments

  • ama3654 - Wednesday, September 16, 2015 - link

    " In my view, the addition of multitasking just puts the iPad experience even farther ahead of other tablets. Obviously Windows has a similar implementation, but the unfortunate truth is that the Windows tablet market is almost non-existent at this point outside of the Surface lineup"

    I wonder why Samsung TouchWiz was not mentioned there as it has a much better multitasking multi-split implementation together with the S-Pen, and Samsung tablets represent a majority of Android tablets.
    Reply
  • Morawka - Wednesday, September 16, 2015 - link

    The windows tablet market is the surface market. Surface is a billion dollar a year business now, and apple obviously is taking it personal because surface was able to grab so much attention. It is a huge threat to iPad, because of it's versatility. It makes iPad's look like $600 facebook/email machines when you have competitors running full blow photoshop and illustrator in a similar form factor. Display out, USB drive support, SD Camera Card Support, A File System so people can download and move around files between any machine, these are all things iOS can't do in it's current form, meanwhile android and windows can and will take all the prosumer market.

    Think of what it will look like in 5-6 years with intel core i7's are running at 5w TDP and can do without a fan. Apple devices are about to hit a brick wall in performance improvements because new nodes are 2-3 years away. I would say that this is the last 90% performance gain year over year generation claims. Apple so far has been lucky and has been getting a new node every year for the past 3 years.

    next year ipads/iphones will maybe get 10-15% gains in Cpu/gpu unless they make the silicon really big which has lower yields. meanwhile intel surface will have skylake and kabylake and Nvidia might be able to do something incredible once it finally gets access to 16nm FF on their 5w K lineup
    Reply
  • jmnugent - Wednesday, September 16, 2015 - link

    It's humorous how you believe Chip/Hardware advancements will benefit only 1 company (Microsoft). As if Apple,.. a company with such a respected history of hardware-design and innovation.. will just let itself fall behind on Chip-design. Hilarious. Reply
  • kspirit - Wednesday, September 16, 2015 - link

    They'll still use iOS on the iPad and not OSX so... yeah, Microsoft wins out on usability. Unless Apple outs a full-on laptop replacement. So until then your comment makes no sense. Reply
  • Matthmaroo - Wednesday, September 16, 2015 - link

    Man you have totally missed his point.

    Chip design and os choice are totally different
    Reply
  • OCedHrt - Thursday, September 17, 2015 - link

    Considering that OS X runs on x86 and iOS doesn't, chip design and os chioce are not totally different. Of course they can port iOS to x86, but they have their work cut out for them. Reply
  • JeremyInNZ - Friday, September 18, 2015 - link

    porting iOS to x86 is simple. considering both OSX and iOS run on Darwin. In fact I suspect the iOS simulator that comes with XCode is running natively on x86. Reply
  • beggerking@yahoo.com - Tuesday, October 13, 2015 - link

    Trust me, it's not simple nor efficient to emulate from risc To cisc or likewise.

    Not happening.period.
    Reply
  • Kalpesh78 - Friday, September 25, 2015 - link

    As usual, Apple will be late to that party as well. Reply
  • xype - Saturday, September 26, 2015 - link

    If you think Apple doesn’t have iOS compiling and running on x86 I have a bridge to sell you. Big, red one, in San Francisco.

    You should read up on OS X, its transition to x86 and where iOS came from.
    Reply

Log in

Don't have an account? Sign up now