Extending iMessage

The Message app is the most used application on iOS. This isn't really a surprise when one thinks about how people use their phones, but it does identify an area that the developer community hasn't been able to tap into despite users spending a great deal of their time there. For someone like me, it was difficult to imagine that there really was anything that developers could do with iMessage, as my use case is just sending images, videos, and text in the same way that you could with SMS and MMS. Of course, I make use of some other convenient features like group chats, read receipts, etc, but none of these areas seemed to present a way for third party developers to add value. Of course, that's when I think about how I use messaging, but there's a whole world of messaging beyond the most basic functionality that SMS and iMessage provide. Apple is tapping into those ideas for iMessage in iOS 10, and they're bringing developers along for the ride.

Apple has taken a two pronged approach to upgrading iMessage in iOS 10. The first are the features that come by default, the features that are part of iMessage itself. I actually covered some of these in my macOS Sierra preview, although in a limited manner as macOS Sierra is not capable of using most of the new features itself and is just able to receive messages that use them. The two main features added to iMessage by default in iOS 10 are message effects and Digital Touch messages.

Message effects work as you'd expect, with animations that can be applied to the actual message bubble itself or as an effect that plays in the background behind the scrolling list of messages. For bubble effects Apple provides an invisible ink effect that requires you to swipe across the message to reveal it, a gentle effect with tiny text, a loud effect which enlarges the bubble for a moment when it's viewed, and a slam effect which crashes the message into the screen, complete with dust effects as it touches down. As for screen effects, you have balloons, confetti, lasers, fireworks, and a shooting star. There's not a whole lot else to say about message effects, as other messaging apps have implemented these features before. If you're a fan of them then you'll be happy to see them brought to iMessage, and if you're not you'll just have to hope all your contacts feel the same way.

Anyone who has used an Apple Watch will be familiar with Digital Touch. In this case it has been modified since you're using it from an iPhone instead of a watch, and the list of things you can send have been expanded as well. To bring up Digital Touch you simply tap the icon with two fingers on a heart which sits next to the text entry field. Once you do so you'll be presented with a condensed version of the Digital Touch UI in the space where the keyboard would normally be. This UI works in a similar manner for iMessage apps, although I'll touch on that more in a bit. 

In the condensed UI there's a small drawing canvas where you can perform Digital Touch actions. On the left side you have a button that allows you to change the color of the pen used when drawing, and below that is a camera button which expands the UI and allows you to draw on top of a photo taken with the camera.

The expanded UI will first show a preview of all the actions you can perform. These all work in the condensed UI as well, but you may not know about all of them until you bring up the expanded version as the condensed view only shows three actions on the right side and switches between two sets every few sections to show all six. To be honest, the Digital Touch interface is kind of confusing, and I wouldn't be surprised if it receives some tweaks in future minor updates to iOS 10. I'm don't really much value in Digital Touch on the iPhone either, especially since actions like tapping don't translate well from the Apple Watch where it would actually trigger the Taptic Engine to simulate your wrist being tapped.

The second side of the iMessage improvements is the creation of a developer ecosystem centered around iMessage. This API will allow developers to create their own mini-applications that run inside of iMessage. This really covers three types of applications, the first of which being sticker packs, the second being interactive messages, and the third being other types of apps that work with media. You can see an example above of the new Super Mario Run sticker pack which is available in the iMessage app store. Interactive messages cover applications that send messages with content which can then be opened by the receiving user in the corresponding application. Apple's example was sending a message with the menu for a party being planned, which can then be modified and commented on by the receivers. Finally, the other category of app is for working with media, and an obvious example is implementing a GIF application for sourcing reaction images in the iMessage app itself.

I'm not really someone who makes heavy use of emoji or effects in message apps, and so I don't have a whole lot else to say about the changes Apple has made to iMessage in iOS 10. However, the popularity of these features in other messaging apps makes it clear that many users value these capabilities, and so it makes perfect sense for Apple to bring them to iMessage. Most interesting for me is the idea of the iMessage App Store, and whether or not it's going to be possible to monetize applications like sticker packs. Line has already shown that people will pay money for such things, but that relies on developers not rapidly creating a race to the bottom for prices, which is what has happened in the iOS App Store to an extent. Like many of the new technologies that Apple introduces in new versions of iOS, only time will tell how things play out.

Expanding Widgets and 3D Touch Swift Playgrounds: Looking to the Future
Comments Locked

113 Comments

View All Comments

  • yhselp - Wednesday, September 14, 2016 - link

    Most definitely; I agree, but I was not talking about notifications, I was talking about notification banners. Banners are a type of notification that pops up at the top of the screen when you're using the device, as opposed to when it's in your pocket. Like when you receive a message while browsing in Safari, for example. Those used to be slick, took little space, and were very easy to respond to or dismiss without opening Messages. Now they're large bubbles, it takes more swiping to interact with them, and when engaged open in full-screen on the 4-inch devices. Since I frequently send quick replies while doing other stuff, life is definitely harder for me now. How about you? Do you find banners better or worse in iOS 10 on your 5s and why?
  • Donkey2008 - Wednesday, September 14, 2016 - link

    The notifications are definitely bigger but not a showstopper IMO.
  • lilmoe - Thursday, September 15, 2016 - link

    Glad things worked out just like you wanted, or at least close.
    You mention that the battery life is holding up. Would you say it's the same as before? Little less or little more?
    My friends are asking me constantly whether they should update. I told them to hold out for a bit, and I'm glad I did after the bricking thing (which should be fixed now).
  • yhselp - Thursday, September 15, 2016 - link

    Hey. The battery life has kept holding up on the 5s. By this point, I highly suspect it's not going to be something to worry about. I'm pretty sure I'm imagining it, but I have a feeling I've been getting just a bit more battery life, or perhaps slower drain under some circumstances, which, in turn, might be offset by others; besides, you never know how the OS is reporting battery charge. Short and to the point: I would say it's the same as before. My SO hasn't had any trouble with the 6s either.

    I just can't get over the fact that these cards or bubbles, as the reviewer calls them, have been used throughout the whole OS. They work great for widgets, and similarly so in Notification Center, however, I can't overstate how much worse banners can be on any device. I think it's worth warning your friends about this. If they're used to sending quick replies by engaging banners, they might end up very irritated by iOS 10. The way it used to work is you got a banner at the top of the screen with the contents of a message you've just received while doing something else like browsing the web; if you wanted to send out a quick reply without exiting Safari and opening the Messages app, all you had to do is pull down the banner - it would extend just a little bit to reveal a text box, the keyboard would appear - type a reply and hit send upon which the whole thing would immediately disappear, leaving you to do whatever it is that you were doing. There's no need to explain why this used to be an extremely efficient way of sending out replies. The way things work now is the following: firstly, the banner is unnecessarily bigger and it's actually hard to understand where you need to pull; secondly, pulling itself takes more effort, almost as if Apple are trying to prevent accidental pulls by making it so you have to pull down farther; thridly, upon pulling down the banner you're sent into a full-screen view; finally, and most disappointingly, when you hit send the whole thing does not disappear, it just stays there, and you have to dismiss it manually. So, essentially, there're no quick replies on iOS 10. It's virtually the same to just tap on the banner, go Messages, reply, and then go back to Safari or whatever you were using. It's absolutely baffling why this was overlooked, or even worse - why Apple decided to do away with it. It's definitely a pain for me, I hope Apple come to their senses and reintroduce this properly.

    "Cards" are not so great for displaying missed calls/messages on the lock screen. I've failed to return a call from the lock screen more than once now, and have instead swiped left to widgets. On a 4-inch iPhone, cards take up took much space on the lock screen when displaying missed calls/messages, as well as when they appear as banners at the top of the screen.

    Hope I've been helpful.
  • lilmoe - Thursday, September 15, 2016 - link

    -- "I think it's worth warning your friends about this [banners]"
    It probably is, and I'll be sure to point it out. As long as performance is improved and battery life isn't compromised, I'm sure it's better to update, for the security enhancements at least.

    -- "Hope I've been helpful."
    You sure are :) Thanks for the detailed reply. I appreciate actual user feedback much more than redundant "all hail" PR.
  • Teknobug - Wednesday, September 14, 2016 - link

    Apple: With iOS 10 we're bricking your old iPhone and we have the iPhone 7 available for upgrade.
  • Donkey2008 - Wednesday, September 14, 2016 - link

    Google: Want the newest Android version for your phone? Buy a new Android phone. Although your carrier *might* release the update in a year or two.

    The difference; Your Apple conspiracy is just a joke whereas the Google conspiracy is real.
  • fanofanand - Wednesday, September 14, 2016 - link

    Nice job again Donkey! I hope Apple pays you by the word!
  • yhselp - Wednesday, September 14, 2016 - link

    Yeah, except it's usually vendors, like Samsung, that decide against releasing new versions of Android for their older devices, and not Google.
  • Teknobug - Wednesday, September 14, 2016 - link

    Samsung update the 2 year old S5, HTC and LG updates some older phones too. At least most Androids don't cost $800-1000 when you need to get a new one.

Log in

Don't have an account? Sign up now