Extending iMessage

The Message app is the most used application on iOS. This isn't really a surprise when one thinks about how people use their phones, but it does identify an area that the developer community hasn't been able to tap into despite users spending a great deal of their time there. For someone like me, it was difficult to imagine that there really was anything that developers could do with iMessage, as my use case is just sending images, videos, and text in the same way that you could with SMS and MMS. Of course, I make use of some other convenient features like group chats, read receipts, etc, but none of these areas seemed to present a way for third party developers to add value. Of course, that's when I think about how I use messaging, but there's a whole world of messaging beyond the most basic functionality that SMS and iMessage provide. Apple is tapping into those ideas for iMessage in iOS 10, and they're bringing developers along for the ride.

Apple has taken a two pronged approach to upgrading iMessage in iOS 10. The first are the features that come by default, the features that are part of iMessage itself. I actually covered some of these in my macOS Sierra preview, although in a limited manner as macOS Sierra is not capable of using most of the new features itself and is just able to receive messages that use them. The two main features added to iMessage by default in iOS 10 are message effects and Digital Touch messages.

Message effects work as you'd expect, with animations that can be applied to the actual message bubble itself or as an effect that plays in the background behind the scrolling list of messages. For bubble effects Apple provides an invisible ink effect that requires you to swipe across the message to reveal it, a gentle effect with tiny text, a loud effect which enlarges the bubble for a moment when it's viewed, and a slam effect which crashes the message into the screen, complete with dust effects as it touches down. As for screen effects, you have balloons, confetti, lasers, fireworks, and a shooting star. There's not a whole lot else to say about message effects, as other messaging apps have implemented these features before. If you're a fan of them then you'll be happy to see them brought to iMessage, and if you're not you'll just have to hope all your contacts feel the same way.

Anyone who has used an Apple Watch will be familiar with Digital Touch. In this case it has been modified since you're using it from an iPhone instead of a watch, and the list of things you can send have been expanded as well. To bring up Digital Touch you simply tap the icon with two fingers on a heart which sits next to the text entry field. Once you do so you'll be presented with a condensed version of the Digital Touch UI in the space where the keyboard would normally be. This UI works in a similar manner for iMessage apps, although I'll touch on that more in a bit. 

In the condensed UI there's a small drawing canvas where you can perform Digital Touch actions. On the left side you have a button that allows you to change the color of the pen used when drawing, and below that is a camera button which expands the UI and allows you to draw on top of a photo taken with the camera.

The expanded UI will first show a preview of all the actions you can perform. These all work in the condensed UI as well, but you may not know about all of them until you bring up the expanded version as the condensed view only shows three actions on the right side and switches between two sets every few sections to show all six. To be honest, the Digital Touch interface is kind of confusing, and I wouldn't be surprised if it receives some tweaks in future minor updates to iOS 10. I'm don't really much value in Digital Touch on the iPhone either, especially since actions like tapping don't translate well from the Apple Watch where it would actually trigger the Taptic Engine to simulate your wrist being tapped.

The second side of the iMessage improvements is the creation of a developer ecosystem centered around iMessage. This API will allow developers to create their own mini-applications that run inside of iMessage. This really covers three types of applications, the first of which being sticker packs, the second being interactive messages, and the third being other types of apps that work with media. You can see an example above of the new Super Mario Run sticker pack which is available in the iMessage app store. Interactive messages cover applications that send messages with content which can then be opened by the receiving user in the corresponding application. Apple's example was sending a message with the menu for a party being planned, which can then be modified and commented on by the receivers. Finally, the other category of app is for working with media, and an obvious example is implementing a GIF application for sourcing reaction images in the iMessage app itself.

I'm not really someone who makes heavy use of emoji or effects in message apps, and so I don't have a whole lot else to say about the changes Apple has made to iMessage in iOS 10. However, the popularity of these features in other messaging apps makes it clear that many users value these capabilities, and so it makes perfect sense for Apple to bring them to iMessage. Most interesting for me is the idea of the iMessage App Store, and whether or not it's going to be possible to monetize applications like sticker packs. Line has already shown that people will pay money for such things, but that relies on developers not rapidly creating a race to the bottom for prices, which is what has happened in the iOS App Store to an extent. Like many of the new technologies that Apple introduces in new versions of iOS, only time will tell how things play out.

Expanding Widgets and 3D Touch Swift Playgrounds: Looking to the Future
Comments Locked

113 Comments

View All Comments

  • Caliko - Wednesday, September 14, 2016 - link

    are these old farts still whining about mobile keyboards and floppy drives?
  • amosbatto - Friday, September 23, 2016 - link

    The problem is that every other phone maker is going to copy Apple as the trendsetter for the industry, so in two years it will be impossible to find a phone with an analog phone jack. Thee only way to stop it is to raise bloody hell now tolet the phone industry know that getting rid of it isn't acceptable.
  • fanofanand - Wednesday, September 14, 2016 - link

    I feel like I just read the final thoughts of Josh's Apple articles. Thanks for saving me the time.
  • SaolDan - Wednesday, September 14, 2016 - link

    Neat!
  • Caliko - Wednesday, September 14, 2016 - link

    What a moron. The human eye can't see a difference in resolution higher than 1080p in a screen that small. You can bet the only reason Apple even rounded up to 720p/1080p is to fit standards and compatibility.
  • Notmyusualid - Thursday, September 15, 2016 - link

    @Caliko: I actually agree with you. Hence my new phone has a 1080p screen. No regrets whatsoever.
  • akdj - Thursday, September 22, 2016 - link

    Still has Lighting connection and the DAC's in the dongle (for headphones or external ⅛" audio link) -- not the Lightning port. There are DACs in board but for the speakers, not headphone listening through dongle.
    Sounds from DisplayMate, the 'only 1080p LCD' they tested was in fact the best display ever tested on any smartphone or tab.
    Go figure, as dpReview's initial reviews are calling it the best smartphone camera on the market
    Hmmm.
    Maybe they're all paid? Or maybe, like a billion purchases say, they're actually the BEST? Nahhh. Couldn't be
  • Ranger1065 - Wednesday, September 14, 2016 - link

    Lol.
  • fanta666 - Wednesday, September 14, 2016 - link

    Josh and what of htc 10. Been waiting since April
  • floppy-wallaby - Wednesday, September 14, 2016 - link

    Be patient. It'll be out just before christmas.

Log in

Don't have an account? Sign up now