Extending iMessage

The Message app is the most used application on iOS. This isn't really a surprise when one thinks about how people use their phones, but it does identify an area that the developer community hasn't been able to tap into despite users spending a great deal of their time there. For someone like me, it was difficult to imagine that there really was anything that developers could do with iMessage, as my use case is just sending images, videos, and text in the same way that you could with SMS and MMS. Of course, I make use of some other convenient features like group chats, read receipts, etc, but none of these areas seemed to present a way for third party developers to add value. Of course, that's when I think about how I use messaging, but there's a whole world of messaging beyond the most basic functionality that SMS and iMessage provide. Apple is tapping into those ideas for iMessage in iOS 10, and they're bringing developers along for the ride.

Apple has taken a two pronged approach to upgrading iMessage in iOS 10. The first are the features that come by default, the features that are part of iMessage itself. I actually covered some of these in my macOS Sierra preview, although in a limited manner as macOS Sierra is not capable of using most of the new features itself and is just able to receive messages that use them. The two main features added to iMessage by default in iOS 10 are message effects and Digital Touch messages.

Message effects work as you'd expect, with animations that can be applied to the actual message bubble itself or as an effect that plays in the background behind the scrolling list of messages. For bubble effects Apple provides an invisible ink effect that requires you to swipe across the message to reveal it, a gentle effect with tiny text, a loud effect which enlarges the bubble for a moment when it's viewed, and a slam effect which crashes the message into the screen, complete with dust effects as it touches down. As for screen effects, you have balloons, confetti, lasers, fireworks, and a shooting star. There's not a whole lot else to say about message effects, as other messaging apps have implemented these features before. If you're a fan of them then you'll be happy to see them brought to iMessage, and if you're not you'll just have to hope all your contacts feel the same way.

Anyone who has used an Apple Watch will be familiar with Digital Touch. In this case it has been modified since you're using it from an iPhone instead of a watch, and the list of things you can send have been expanded as well. To bring up Digital Touch you simply tap the icon with two fingers on a heart which sits next to the text entry field. Once you do so you'll be presented with a condensed version of the Digital Touch UI in the space where the keyboard would normally be. This UI works in a similar manner for iMessage apps, although I'll touch on that more in a bit. 

In the condensed UI there's a small drawing canvas where you can perform Digital Touch actions. On the left side you have a button that allows you to change the color of the pen used when drawing, and below that is a camera button which expands the UI and allows you to draw on top of a photo taken with the camera.

The expanded UI will first show a preview of all the actions you can perform. These all work in the condensed UI as well, but you may not know about all of them until you bring up the expanded version as the condensed view only shows three actions on the right side and switches between two sets every few sections to show all six. To be honest, the Digital Touch interface is kind of confusing, and I wouldn't be surprised if it receives some tweaks in future minor updates to iOS 10. I'm don't really much value in Digital Touch on the iPhone either, especially since actions like tapping don't translate well from the Apple Watch where it would actually trigger the Taptic Engine to simulate your wrist being tapped.

The second side of the iMessage improvements is the creation of a developer ecosystem centered around iMessage. This API will allow developers to create their own mini-applications that run inside of iMessage. This really covers three types of applications, the first of which being sticker packs, the second being interactive messages, and the third being other types of apps that work with media. You can see an example above of the new Super Mario Run sticker pack which is available in the iMessage app store. Interactive messages cover applications that send messages with content which can then be opened by the receiving user in the corresponding application. Apple's example was sending a message with the menu for a party being planned, which can then be modified and commented on by the receivers. Finally, the other category of app is for working with media, and an obvious example is implementing a GIF application for sourcing reaction images in the iMessage app itself.

I'm not really someone who makes heavy use of emoji or effects in message apps, and so I don't have a whole lot else to say about the changes Apple has made to iMessage in iOS 10. However, the popularity of these features in other messaging apps makes it clear that many users value these capabilities, and so it makes perfect sense for Apple to bring them to iMessage. Most interesting for me is the idea of the iMessage App Store, and whether or not it's going to be possible to monetize applications like sticker packs. Line has already shown that people will pay money for such things, but that relies on developers not rapidly creating a race to the bottom for prices, which is what has happened in the iOS App Store to an extent. Like many of the new technologies that Apple introduces in new versions of iOS, only time will tell how things play out.

Expanding Widgets and 3D Touch Swift Playgrounds: Looking to the Future
Comments Locked

113 Comments

View All Comments

  • robinthakur - Friday, September 23, 2016 - link

    Exactly, I have an S7 edge currently until my iPhone 7 arrives, and what have I customized? Widgets on the home screen and layouts, nothing else. What equivalent does Google have for Swift Playgrounds which is as polished and useful, pray tell? The polish is what gets users using the features rather than being hidden in Android somewhere. e.g. Apple Pay vs Android Pay, there is no comparison.
  • jdickey - Wednesday, September 21, 2016 - link

    If you have a phone older than an iPhone 6 (maybe even 6s), beware.

    On my 5c, notifications are continually getting messed up. Many apps' notifications don't show up in Notification Centre, and you won't know they're there until you unlock the phone. (Great for people sending you dozens of IMs asking "why aren't you replying?!?") Once you do unlock the phone, notifications often get "stuck"; I once had a Facebook IM "(Your friend) has sent you a message" notification that didn't go away for DAYS after I'd already replied to the message.

    Typing is slower than in iOS 9, and the keyboard often "freezes" with a key highlighted as it normally is when you touch it. Three or four seconds later, any keys you've typed since getting "stuck" play back as though nothing had happened and you intended to type 'a' 35 times.

    I'm seeing these and other problems that I never saw before with iOS 9 betas, let alone official releases. For a company that BUILT ITS BRAND on quality and on the primacy of customer experience, iOS 10 is an appalling reminder of how things can Go Horribly Wrong.

    Here's hoping that a 10.1 update comes out SOON and fixes more existing issues than it creates new ones. The Apple from five years ago would never have released a system in this state. I'm not holding my breath waiting for improvement. The main reason I continue to be an iPhone customer is that most of the direct competition I see (e.g., Samsung) have even steeper downsides.
  • korben44 - Thursday, September 22, 2016 - link

    I had an iPhone 6 for about a week.... Sold it and went back to my Lumia 950 XL. Windows 10 Mobile is just better, in my opinion. Again, that's just my opinion. I had ios 10 from beta to release and still feel the same way. Meh.
  • SomeDude2552 - Saturday, October 1, 2016 - link

    FaggotryTech with another article about FagOS. Amazing.
  • Bolang - Thursday, December 1, 2016 - link

    iOS 10 is best.

    http://freeiphone7plusgiveaway.win/
  • jasonwilliams016 - Tuesday, January 31, 2017 - link

    Thanks for the review. Please let me know the
    <a href="http://www.ios11guide.com/">iOS 11</a> release date and review it soon.
  • oranos - Saturday, February 11, 2017 - link

    It's too late. Android has now surpassed in all relevant categories. Experience, features, smoothness. There is no more catching up for apple. The spread will only get worse now.
  • arvinzx20 - Monday, March 13, 2017 - link

    Base in my experience IOS 10 is good latest update of apple and i think ios 11 will also release this year..

    www.hackcollection.xyz/2016/09/free-iphone-7-plus-giveaway-2017.html
  • arvinzx20 - Monday, March 13, 2017 - link

    When ios 7 is release before they have many bugs in this version unlike right now ios 10 still the best.

    http://www.hackcollection.xyz/2016/09/free-iphone-...
  • Punit - Saturday, July 1, 2017 - link

    hi

Log in

Don't have an account? Sign up now