Multitasking

iOS has had some level of multitasking for a long time now. iOS 4 introduced the app switcher, along with APIs to allow certain background tasks like audio, location services, push notifications, and task completion. iOS 7 expanded multitasking by allowing applications to perform background updates at certain intervals. None of these features are really multitasking in the same sense as a computer, and they don’t even match the word itself very well because you as the user aren’t able to perform more than one task at the same time. While this is fine on a smartphone, on the iPad it has always felt a bit strange as there’s definitely enough room to run multiple apps at once. In iOS 9 this changes, and the iPad gains several abilities that allow you to truly multitask.

To describe how Apple has enabled multitasking on the iPad it's necessary to go over a brief history of app development on iOS. In the beginning, a developer would create a pixel perfect interface for their application. The reasoning behind this was that there was only one iOS device with the same display size and virtual resolution for many years. The introduction of the iPad introduced another device target which put extra work on developers, but one could argue that iPhone apps being so terrible on the iPad is what pushed developers to make great iPad specific apps anyway. Unfortunately, this method of creating app layouts wasn't very forward thinking, and it didn't allow apps to scale properly to new devices like the iPhone 5, and the iPhone 6. With developers now having to support a number of different display sizes and resolutions it was necessary for Apple to implement a method of designing apps that would work across multiple display sizes.

Apple began pushing developers to design applications that would work across multiple displays at WWDC 2014. This involves adopting Auto Layout, which is a method of creating iOS application interfaces that can scale to different screen sizes while still giving the developer a degree of control over the placement of objects by allowing them to create virtual constraints. Auto Layout defines two size classes, which essentially define the attributes of the interface on a certain device based on its resolution and size along a given axis. For example, the iPad always uses the regular size class in both dimensions regardless of its orientation, while the iPhone 6 uses the regular height but compact width size classes in portrait, and both compact size classes in landscape. The iPhone 6 Plus is an interesting situation due to its size, and it uses the same regular size class for its width in landscape as the iPad, which is why you'll see applications that use Auto Layout almost acting like mini iPad apps on it when in landscape mode.

At the time, the recommendation to use Auto Layout made sense for developers who wanted to support every iPhone along with the iPad, as it meant they didn't have to maintain several entirely different layouts for different devices, but could still make interfaces that took advantage of larger displays. At WWDC 2015 it was made clear that Auto Layout was created with additional purposes in mind, with one of them being the multitasking capabilities coming to the iPad.

Before explaining the different methods of multitasking in iOS 9 it’s probably a good idea to explain how you even access the features. Despite what one might think, you don’t start multitasking by going to the recent apps tray. Apple has instead added a new menu which you can access by swiping in from the right edge of the device when inside an application. Rather than showing you all of your open/recent apps, this menu only shows you applications that are compatible with multitasking. To open an app you simply tap it, and to return to the list of apps you swipe down from the top of the open application. To close the menu you can tap elsewhere on the display, or swipe to the right. Something I'd like to note is that this feature does not break the ability to swipe from the right in Safari to go forward a page, as in Safari you need to swipe from the middle of the edge to open the multitasking menu.

The first aspect of iOS 9 multitasking, and the one I think most iPad users will end up using for device compatibility reasons, is the new slide over feature. This allows you to slide in a compatible application overtop of your current one. This can be really useful for quickly sending a message, or looking up something in Safari while writing a document in Microsoft Office. This may sound very cliché, but it really does transform how you use an iPad just due to how much easier it makes the experience of working on one.

Slide over windows appear in a bar which is the exact same size as the new multitasking menu. They cannot be resized, and I don’t think readers will be surprised to know that the applications have a width of 320 points, or 640 pixels. This is due to what I explained earlier about size classes, and in this case Apple has just decided to use what is, for all intents and purposes, a very long 3.5/4” iPhone app.

The next multitasking feature in iOS 9 is picture-in-picture (PiP) mode. If you’ve ever used Google’s YouTube application then you already have some idea how this works. Essentially, it’s just a floating window that can play video content. At the moment it’s limited to the iOS videos app and video content using the standard HTML5 player (not YouTube) in Safari, but in theory it would eventually be implemented in all applications that play video. To activate the feature you can press the button in the app you’re using which will pop the video out. If you already had the video in full screen then iOS will automatically move it to a PiP window if you switch apps or return to the home screen.

Once you have the PiP window open, it will position itself in one of the display's four corners. If you need to see something underneath it you can either move it or swipe it off to the side where it will just stick out enough for you to move it back on screen. The window will also move with other parts of the interface. An example of this can be seen when the window moves upward whenever Control Center is opened while the window is in one of the bottom display corners. The use cases for a picture-in-picture feature are fairly obvious, and in my case I used it often to watch WWDC sessions while writing parts of this review in Office for iPad.

The last, most powerful, and most exclusive multitasking feature in iOS 9 is split screen applications. The reason I’m discussing this at the end is both because it’s by far the most significant and useful feature, and because the only users who get it are those with the iPad Air 2 and all later iPads. Split screen is essentially an extension of slide over, and you access it by going through the motions of opening slide over and then going a step further by tapping the tiny rounded rectangle next to the multitasking menu. The above video shows you the steps to access split screen view, and some of the specifics of how it works.

Something you’ll notice is that if you have two apps in split screen and you switch to another app the secondary application pinned on the right side will then create a new split view with the new application assuming it supports split screen multitasking. You’ll also notice that unlike the new split view in OS X El Capitan which has a similar interface, you can’t just set any arbitrary split between the two applications. In landscape mode you either get a 50/50 view, or a split with one app taking up 640 horizontal pixels and the other taking up the remaining space. In portrait orientation you can only add a second app with a 640 pixel width. In both cases you also have 22 lines of pixels taken up by the scrubber between the two applications.

As for performance, my experience with the applications that can be put into split screen has been very good. I've recorded a video showing that there's quite a lot you can do at once with the system still maintaining 60fps motion in all apps. It's worth noting that in this case the PiP window was dropping some frames, but in use cases that don't involve scrolling three different sections and flinging a video around all at the same time the PiP window also maintains its frame rate. On the next page I go into more detail on what resources multitasking requires with Apple's apps, and the potential CPU and memory use that will occur with more intense third party applications.

I often remember a situation a couple years ago where I was trying to watch the Google I/O keynote on an iPad while also keeping an eye on Twitter. It felt completely ridiculous to have to use a phone to view Twitter when there was a 9.7" 2048x1536 display sitting in front of me, but that was just how things worked on the iPad at that time. In my view, the addition of multitasking just puts the iPad experience even farther ahead of other tablets. Obviously Windows has a similar implementation, but the unfortunate truth is that the Windows tablet market is almost non-existent at this point outside of the Surface lineup.

As for Android, part of me is surprised that Google actually allowed Apple to beat them to it when Android applications would be able to handle it without any developer modifications at all. It's unfortunate to say this but the other part of me isn't surprised at all, as it feels like improving Android as a tablet OS just isn't a priority at Google. New features like multitasking coming to the iPad just makes it even more difficult to recommend higher end Android tablets with there already being issues like the app gap and lacking performance. Based on the multitasking code present in the early previews of Android Marshmallow I suspect that this is on Google's radar, and for the sake of having some degree of competition in the tablet market I hope this isn't something unique to the iPad for long.

To wrap things up, I really feel that split screen multitasking is the best feature to ever come to the iPad. The boost it provides to productivity is difficult to put into words. If you’re working with productivity apps you can now easily transfer text and images between the two without having to continually switch between two full screen apps. You can also pin the messages app to the side if you’re carrying on a conversation while also trying to write a note or edit a photo. It’s just really great, and the interface is implemented in a very smooth, natural, and intuitive manner.

Siri, Search, and iCloud Drive The Performance Implications of Multitasking
Comments Locked

227 Comments

View All Comments

  • Speedfriend - Thursday, September 17, 2015 - link

    @melgross I have recently seen numerous tablets being used by businesses (restaurants, delivery companies) that were clearly no-name Android tablets designed for that specific tasks. Why would a corporate that needs a tablet for a single task buy a $500 iPad when they can get a $200 Android?

    iPad is now caught in the middle between cheap single task Androids and multi-task windowns 2-in-1s. Our CEO is obsessed with Apple products but we have gone Windows tablets and it looks like we are going to go full surface range soon (3 and Pros). Why, because an iPad is too limited even as something you just take to meetings with you.
  • FunBunny2 - Wednesday, September 16, 2015 - link

    -- a respected history of hardware-design and innovation..

    really, really now? Apple has always bought their silicon, 99.44% is off-the-shelf. Yeah, I know, the fanbois brag that the Ax chips are somehow blessed by Apple. Fact is: Apple only tweaked around the edges, using industry standard silicon design tools, a bit of cache added here and there. Just look at the BoM from any of the usual teardown sites. You'll see the fact: it's always other people's parts.
  • osxandwindows - Wednesday, September 16, 2015 - link

    So why is apple not using 8core chips ha?
  • Intervenator - Wednesday, September 16, 2015 - link

    I hope that post was sarcastic or it would really be funny.
  • damianrobertjones - Thursday, September 17, 2015 - link

    ...Because that would be too far a jump. Apple wants to MILK its customers for everything then can hence the small updates. Someone like Nokia committed a mortal sin as they released a 41Mp (36+5mp) camera phone while others are still messing with 20Mp.

    All about the cash.

    P.s. Android NEEDS more cores as it runs like a bag of crap.
  • calden - Monday, September 28, 2015 - link

    Actually Android runs just as smooth as iOS. The problem is skinned, custom versions of Android, i.e. TouchWiz. When I replaced TouchWiz with CM 12.1 on my Note 4, the system took up only 580MB, where as TouchWiz took up more than 1.5GB before a single app was even installed. I also installed the launcher SmartLauncher 3, the whole experience is lightning fast. Even when running multiple apps in the background, something iOS still can't do. I think it is ridiculous that a modern OS in 2015 cannot do something as simple as stream a movie to your TV and still allow you to use the device, iOS simply pauses, even disconnects the stream in some cases if you want to do something as simple as look up an actors name in IMDB. With my Android tablet I can not only stream a film to my TV but play a game like Modern Combat 5 at the same time. As a programmer I need to run a terminal app to stay connected to my firms server during trading hours as I have monitoring tools. IOS has terminal apps as well but I can't run them them in the background the entire day without iOS terminating it's connections. Again, I find this to be absolutely ridiculous as who wants to stare at a terminal the entire day, especially when I need access to my tablet or phone to do other tasks. Apple adding Pro behind the iPad doesn't automatically make it a pro device. IOS still has one of the worst document, file management systems on the market today. My Nokia 9500 from 2004 is light years better than what iOS provides, apps should never be allowed to manage their own files. Default apps, I still can't change the default apps in iOS, why? I have no use for Apple's included apps, if I had the choice I would immediately delete them from the system, as such I need the ability to select my own browser, email client, messenger, media player, etc. as the default applications. I find this tactic of not being able to select my own default apps in iOS highly anti-competitive. The EU went after Microsoft for including Internet Explorer in XP, even though the user had the option of choosing another browser as their default. Why hasn't Apple be scrutinized about this?
  • calden - Monday, September 28, 2015 - link

    I'm aware of those few audio and GPS apps that can run in the background in IOS, but this is a far cry than allowing any app that the user needs in the background. No, this has nothing to do with battery life, if it is than Apple really needs to rewrite iOS. My BlackBerry Passport, running three apps in the background, easily lasts the entire day on a single charge, actually it lasts a day and a half with moderate to heavy use. Android has the ability to select how many apps are allowed to run in the background, you can even set it to 1. So if people feel like their apps are eating up their battery they can control the amount of running apps. Apple could easily implement such a feature, they don't though, which means they have all the control, they dictate how the user uses their own devices. iOS is a wolf in sheep's clothing, looks pretty, inviting but once you start to do real work you encounter a brick wall a 20 stories high. How many times have you iOS users logged into iCloud on your device, I had to do it over 25 times to cover every app. Why, why do I need to log in even twice, once should be enough, in Android upon setting up my Google user that was it, from that point on every app that could communicate with Google Drive would automatically be setup. This is because the apps talk to the system at the lowest level, iOS requires spaghetti API's, a spiderweb of tunnels trying to pass info to each other. The Share TO function in iOS works only if the app dveloper has created a share profile. Why can't the system just dynamically create these Share To lists like Android 5.1.2, SailFish 2.0, Windows Mobile 10, BlackBerry OS 10.3.2 by looking for every compatible app that is installed and than listing. No, instead iOS uses this half ass API system. What about mult-user support, will never happen in iOS because of the way it handles files. To support multi-users in iOS each user would have to reinstall each app over again to distinguish each users. They could embed the users info in the file's metadata so the app can distinguish each user but that is just hacky at best would and how would these modified files react when used on other systems. IOS is definitely not a pro system and anyone thinking differently is either lying to themselves to protect their beloved Apple brand, aren't professionals themselves so don't reall understand the meaning or are working around these limitations, fighting the system at every point to get their work done which falls in line with point one, their lying to themselves.

    I'm not saying that iOS devices don't have their uses, they do. They make great consumer devices for media consumption, social media, gaming, drawing and other artistic apps, music and music creation, etc. However as a productivity tool these devices are highly limited and can't compete with the likes of a Surface Pro 3 or even Surface 3. Even an Android tablet would be a better option. With my Nexus 9 I can log into the LDAP and gain access to all my allowed users NAS storage, mount it as a local asset. Set file extensions to open up certain apps, etc. Trying to do this in iOS is like trying to put a round peg into a square one. You can do it with a bit of force but your going against it's designed purpose. Apple needs to completely rewrite iOS, combine many functions found in OSX before I would ever consider using another mobile device from Apple.
  • mikhapop - Monday, September 28, 2015 - link

    you really nailed it, i am a web developer and i often fail to tell my friends how the ios is very limiting for even the basic stuff (my basic stuff). android is far better as far as the os go. Now i am using a surface pro 3 and never looked back, very good in meetings, and it is now my main machine for 98% of my work.
  • blackcrayon - Wednesday, September 16, 2015 - link

    Sounds like you know close to nothing about the Ax chips. They are custom Apple designs, and they also optimize their OS for them. I bet you thought Intrinsity and PA Semi were just marketing facades that didn't actually do anything before Apple acquired them years ago, right?
  • KoolAidMan1 - Wednesday, September 16, 2015 - link

    Apple spent billions acquiring semiconductor companies and is one of the few companies along with Qualcomm that has a license to make ARM chips. Anand himself highlighted this while showing that Apple's custom designs matched or exceeded Intel's Bay Trail.

    You really think their custom designs are something to be dismissed just because of the name on the package? The fanboy is strong in your posts

Log in

Don't have an account? Sign up now