Apple Pencil

At this point it probably goes without saying that Apple Pencil has been one of the major points of focus for this tablet. With the iPad Air 2, I noted that a proper stylus and keyboard would go a long way towards making the iPad more productivity focused. It turns out that Apple’s solution to the stylus part of the equation is a custom design that they call the Apple Pencil.

As best as I can tell, this stylus is at least somewhat capacitive-based. If Apple’s marketing material is accurate, it mentions a change from the 120 Hz sampling rate of the capacitive touch screen in normal use to 240 Hz when the stylus is detected. In addition to simple touch, the stylus measures pressure, azimuth, and altitude. When discussing azimuth, we’re basically looking at the angle that the stylus makes with the plane of the display, while altitude is the angle that the stylus makes relative to the normal of the display.

Charging the stylus is pretty simple. Included in the box is a female to female Lightning connector, so you can use a Lightning to USB cable to charge the stylus with either an AC adapter or a powered USB port. Of course, there’s also the case where you’re trying to charge the device on the go, in which case the stylus can be charged directly from either the iPad Pro or an iPhone. A lot of people have pointed out that this is a rather inelegant method of dealing with charging on the go, but given that the primary method of charging is through a Lightning connector I don’t really see any other solution to this problem, especially without compromising the ergonomics that come with the current design. Charging the stylus happens quickly enough that I never felt that it was a limiting factor in usage.

Apple Pencil itself is a comfortable instrument to write with. Unlike most styluses on the market designed to fit in a tablet or smartphone the body has a sufficiently large diameter that gripping it isn’t difficult for extended periods of time. The pencil also has an uneven weight distribution, which means that it won’t roll off of tables, though not so uneven that it's noticeable in the hand. The one problem worth noting here is that Apple Pencil is glossy plastic. After extended use I noticed that finger oil and lint had a tendency to produce an uncomfortable sensation. A matte soft touch texture may make more sense here, but that would introduce additional issues with the finish wearing off with extended use.

Credits to Nina Ling and Cory Ye respectively

Of course, the important part here is writing with the stylus. Although I’ve already discussed the application of note taking in class before, in the time since my initial remarks on the iPad Pro I decided to do an entire project report on Apple Pencil in order to get a better feel for the stylus and its usability. This was done for a digital logic project in which we were required to draw out finite state machine diagrams, truth tables, block diagrams, and other portions of the design. I would estimate that over the course of this project, I spent at least 4 hours a day using the iPad Pro for 2-3 days.

One of the most immediate observations I had was that in some ways, the iPad Pro with Apple Pencil is far and away superior to pencil and paper. Even using the rather spartan Notes app this became clear. There were multiple cases throughout this project where a change that would have been difficult to make with pencil and paper was relatively simple to do so with Apple Pencil and the iPad Pro. For example, in cases where extra precision was needed it was possible to zoom in to erase a portion of text precisely. When an erasure was done poorly or on accident, reverting it was trivial as well. The project report, which eventually spanned 16 pages in length was synced to iCloud and was accessible from laptops and smartphones, which meant that it would be difficult, if not impossible to lose accidentally. It’s also noticeably more convenient to carry around an iPad Pro rather than a folder filled with paper. Along the same train of thought, drawing long truth tables with the straightedge function of the Notes app is much easier than carrying around a ruler everywhere. It was also great to have the project requirements and the notes application open side by side, which meant that there wasn’t a need to print out the project spec.

One notable problem that I did encounter with the Notes app is when the work I was doing spanned more than one page/sketch. An example of this would be cases where I would have to construct a state table based upon a state diagram that was sketched based upon the project requirements. If the state diagram was on a separate page, then I would simply have to switch back and forth between the two sketches or save the relevant sketch as an image to view in the gallery application, which felt a bit clunky.

The other issue, as it turns out, was getting the sketches off of the iPad Pro onto my laptop once I was ready to turn my work in. On the plus side, because all of my sketches were already digitized there was no need to locate a scanner and generate images or PDFs. However, the Notes app felt noticeably constrained in terms of export options. For example, there was no way of turning the 16 sketches I had drawn into a PDF on the device. I also discovered that as of iOS 9.2 attempting to save all sketches as images was broken as only 5 of the 16 sketches were saved to the gallery. Exporting the sketches by attaching them to an email was also unacceptable as the email export resolution was nowhere near native resolution. In the end, in order to get all of the sketches I had made off of the iPad in full resolution I had to manually select each sketch and save it to the gallery, before uploading all of the images to Dropbox. From my laptop, I could then put all of the images together into a PDF or some other acceptable format for submission.

However, despite these issues I found that the iPad Pro was remarkable for doing what very few tablets have really succeeded at. The iPad Pro actually feels comparable to pencil and paper to the extent that I never once felt like I wanted to go back to pencil and paper while doing the final project. Both the display and the stylus have sufficient resolution to the extent that precise work is easily achieved. The feel of the stylus feels like a good pen or pencil, without odd weight distribution problems.

Latency is also exceptionally low compared to most consumer solutions. Out of curiosity, I borrowed a Wacom Cintiq connected to a Macbook Air with an Intel i5 4250U CPU (Haswell 1.3/2.6 GHz) to do a basic latency comparison. Using Adobe Photoshop on the Wacom Cintiq and Adobe Photoshop Sketch on the iPad Pro and a high speed camera, I attempted to characterize latency by using a simple pen tool (3 px, full flow) by measuring the delta in time from when the pen was at a specific point and when inking reached the same point.

Stylus Latency - iPad Pro vs. Wacom Cintiq
  iPad Pro
(Photoshop Sketch)
Wacom Cintiq
(Photoshop)
Latency 49ms +/- 4ms
(3 frames)
116ms +/- 4ms
(7 frames)

After a few trials I measured an approximate latency for the iPad Pro of roughly 49ms or 3 frames of delay, while the Wacom Cintiq in this configuration had roughly 116ms or ~7 frames of delay. It’s worth mentioning here that the camera I used was recording at 240 FPS, so these figures could be off by around 4ms even before accounting for human error. Although the Cintiq 22 HD does have higher latency, I wouldn’t put too much into this as it’s likely that a more powerful computer driving the display would narrow, if not eliminate the gap entirely.

For reference, I estimated the Surface Pro 3 to have about 87 ms or 5-6 frames of delay, and the Surface Book to have about 69 ms or around 4 frames of delay. However, in the case of the Surface devices I was using Fresh Paint, which is a drawing application that isn't exactly comparable to Photoshop but is sufficient for comparison purposes. To give an idea for how much the application has an effect on latency, the Apple Notes app has roughly 38 ms or around 2 frames of latency from when the stylus tip passes over one point to when the inking reaches the same point.

While not strictly hardware, the software equation is really a critical part here as there are actual applications for the Apple Pencil which make it possible to use right now. An example of this would be OneNote, uMake, and Adobe Comp CC/Photoshop Sketch. Some of these applications work shockingly well like Photoshop Sketch, while something like OneNote feels relatively sparse by comparison as pretty much the only thing you can do with the stylus is draw simple lines with pressure sensitive thickness, with some automatic conversion of drawings to basic geometric shapes. With the right software, I can easily see the iPad Pro completely displacing traditional note-taking in light of obvious advantages that would come with OCR and digitizing notes for easy search.

Display Smart Keyboard
Comments Locked

408 Comments

View All Comments

  • ddriver - Friday, January 22, 2016 - link

    Should have named in iPad XL or something, this device will barely suit the need of any professional. Performance is good, but without supporting professional software, the hardware is useless.
  • Coztomba - Friday, January 22, 2016 - link

    And why would anyone bother to make professional software if the hardware wasn't capable? They needed a starting off point to say "Hey we can produce the hardware to run pro apps on a iPad. It's only going to get better. Start developing!"
  • ddriver - Friday, January 22, 2016 - link

    If anyone could stimulate software companies to do that, I guess that would be apple with its mountains of money and strong sales. They do have enough resources to do the software themselves.

    Mobile device hardware has been capable of professional workloads for at least 2-3 years. Nobody bothered to do it. Big software companies did not port their applications to ARM, instead they made cheap, crippled lesser versions. This is IMO a stupid move, they probably did this to promote their professional software to common folk, but it would have been more lucrative to bring professional software to mobile platforms.

    There are 2 main issues with mobile platforms - memory and CPU performance. Modern software is very bloated memory consumption wise, especially software relying on managed languages, the latter are also significantly slower in terms of performance than languages like C or C++.

    There is one big issue with legacy professional software - it originates back from the days developers were locked in platform specific application development APIs, so it represents a significant effort to port them to mobile platforms - essentially, most of the stuff needs to be rewritten.

    But a rewrite in faster and more efficient language, taking advantage of contemporary technology such as OpenCL can easily bring professional software to mobile platforms at an experience as good as that of desktop workstations. Naturally, more efficiently written software will also run that much better on powerful desktop machines as well.
  • mr_tawan - Friday, January 22, 2016 - link

    Not all pro are in the multimedia industry, you know :-).

    For most office workers, for instance, the only things they might need are notetaking (onenote), email (outlook), wordprocessor (word), and calendar (onenote). Most all tablet are capable to all of that, but it is a bit awkard to work with (due to the missing stylus, and not-so-comfy keyboard).

    With iPad Pro which, well, address this issue in the same way as the Surface Pro by adding keyboard and stylus to the tablet. It's much easier to use the table extensively (rather than just browsing web and watching video, which is hardly described as a profession job). So I personally think that adding these two options could takes the iPad into the 'professional' realm.

    I think that Apple would love to have iPad to complement MacBook (and Mac Pro), rather than to compete. If you need more power than just by Mac Pro :-).
  • ddriver - Friday, January 22, 2016 - link

    Yeah, why use one device when you can buy and lug around two devices instead.
  • melgross - Friday, January 22, 2016 - link

    There's actually quite a lot of professional software available on iOS, and has been for some time. I suppose if you do t use iOS, and so do t know what's a bailable, you can say that little is available, but it's simply not true. Microsoft itself had about two dozen professional apps on iOS. You really need to look through the App Store.
  • ddriver - Friday, January 22, 2016 - link

    What would those 24 ("two dozen") professional microsoft apps be?
  • Dave Bothell - Saturday, January 23, 2016 - link

    Word, Excel, PowerPoint, Outlook, OWA for iPad, Sunrise Calendar, OneDrive, OneDrive for Business, OneNote, SmartGlass, Skype, Bing for iPad, Remote Desktop, Lync, Office 365 Admin, Intune, Azure Authenticator, Sway, SharePoint Newsfeed, Dynamics CRM, Dynamics Business Analyzer, Dynamics Time Management, PowerApps, Global Startup Directory. There's more, but you asked for 24.
  • xerandin - Saturday, January 23, 2016 - link

    Smartglass isn't a professional app--it controls Xbox 360s or Xbox Ones, depending on which version of the app you install.
  • dsraa - Sunday, January 24, 2016 - link

    you forgot bing.....bing isnt a professional app either.

Log in

Don't have an account? Sign up now