Apple Pencil

At this point it probably goes without saying that Apple Pencil has been one of the major points of focus for this tablet. With the iPad Air 2, I noted that a proper stylus and keyboard would go a long way towards making the iPad more productivity focused. It turns out that Apple’s solution to the stylus part of the equation is a custom design that they call the Apple Pencil.

As best as I can tell, this stylus is at least somewhat capacitive-based. If Apple’s marketing material is accurate, it mentions a change from the 120 Hz sampling rate of the capacitive touch screen in normal use to 240 Hz when the stylus is detected. In addition to simple touch, the stylus measures pressure, azimuth, and altitude. When discussing azimuth, we’re basically looking at the angle that the stylus makes with the plane of the display, while altitude is the angle that the stylus makes relative to the normal of the display.

Charging the stylus is pretty simple. Included in the box is a female to female Lightning connector, so you can use a Lightning to USB cable to charge the stylus with either an AC adapter or a powered USB port. Of course, there’s also the case where you’re trying to charge the device on the go, in which case the stylus can be charged directly from either the iPad Pro or an iPhone. A lot of people have pointed out that this is a rather inelegant method of dealing with charging on the go, but given that the primary method of charging is through a Lightning connector I don’t really see any other solution to this problem, especially without compromising the ergonomics that come with the current design. Charging the stylus happens quickly enough that I never felt that it was a limiting factor in usage.

Apple Pencil itself is a comfortable instrument to write with. Unlike most styluses on the market designed to fit in a tablet or smartphone the body has a sufficiently large diameter that gripping it isn’t difficult for extended periods of time. The pencil also has an uneven weight distribution, which means that it won’t roll off of tables, though not so uneven that it's noticeable in the hand. The one problem worth noting here is that Apple Pencil is glossy plastic. After extended use I noticed that finger oil and lint had a tendency to produce an uncomfortable sensation. A matte soft touch texture may make more sense here, but that would introduce additional issues with the finish wearing off with extended use.

Credits to Nina Ling and Cory Ye respectively

Of course, the important part here is writing with the stylus. Although I’ve already discussed the application of note taking in class before, in the time since my initial remarks on the iPad Pro I decided to do an entire project report on Apple Pencil in order to get a better feel for the stylus and its usability. This was done for a digital logic project in which we were required to draw out finite state machine diagrams, truth tables, block diagrams, and other portions of the design. I would estimate that over the course of this project, I spent at least 4 hours a day using the iPad Pro for 2-3 days.

One of the most immediate observations I had was that in some ways, the iPad Pro with Apple Pencil is far and away superior to pencil and paper. Even using the rather spartan Notes app this became clear. There were multiple cases throughout this project where a change that would have been difficult to make with pencil and paper was relatively simple to do so with Apple Pencil and the iPad Pro. For example, in cases where extra precision was needed it was possible to zoom in to erase a portion of text precisely. When an erasure was done poorly or on accident, reverting it was trivial as well. The project report, which eventually spanned 16 pages in length was synced to iCloud and was accessible from laptops and smartphones, which meant that it would be difficult, if not impossible to lose accidentally. It’s also noticeably more convenient to carry around an iPad Pro rather than a folder filled with paper. Along the same train of thought, drawing long truth tables with the straightedge function of the Notes app is much easier than carrying around a ruler everywhere. It was also great to have the project requirements and the notes application open side by side, which meant that there wasn’t a need to print out the project spec.

One notable problem that I did encounter with the Notes app is when the work I was doing spanned more than one page/sketch. An example of this would be cases where I would have to construct a state table based upon a state diagram that was sketched based upon the project requirements. If the state diagram was on a separate page, then I would simply have to switch back and forth between the two sketches or save the relevant sketch as an image to view in the gallery application, which felt a bit clunky.

The other issue, as it turns out, was getting the sketches off of the iPad Pro onto my laptop once I was ready to turn my work in. On the plus side, because all of my sketches were already digitized there was no need to locate a scanner and generate images or PDFs. However, the Notes app felt noticeably constrained in terms of export options. For example, there was no way of turning the 16 sketches I had drawn into a PDF on the device. I also discovered that as of iOS 9.2 attempting to save all sketches as images was broken as only 5 of the 16 sketches were saved to the gallery. Exporting the sketches by attaching them to an email was also unacceptable as the email export resolution was nowhere near native resolution. In the end, in order to get all of the sketches I had made off of the iPad in full resolution I had to manually select each sketch and save it to the gallery, before uploading all of the images to Dropbox. From my laptop, I could then put all of the images together into a PDF or some other acceptable format for submission.

However, despite these issues I found that the iPad Pro was remarkable for doing what very few tablets have really succeeded at. The iPad Pro actually feels comparable to pencil and paper to the extent that I never once felt like I wanted to go back to pencil and paper while doing the final project. Both the display and the stylus have sufficient resolution to the extent that precise work is easily achieved. The feel of the stylus feels like a good pen or pencil, without odd weight distribution problems.

Latency is also exceptionally low compared to most consumer solutions. Out of curiosity, I borrowed a Wacom Cintiq connected to a Macbook Air with an Intel i5 4250U CPU (Haswell 1.3/2.6 GHz) to do a basic latency comparison. Using Adobe Photoshop on the Wacom Cintiq and Adobe Photoshop Sketch on the iPad Pro and a high speed camera, I attempted to characterize latency by using a simple pen tool (3 px, full flow) by measuring the delta in time from when the pen was at a specific point and when inking reached the same point.

Stylus Latency - iPad Pro vs. Wacom Cintiq
  iPad Pro
(Photoshop Sketch)
Wacom Cintiq
(Photoshop)
Latency 49ms +/- 4ms
(3 frames)
116ms +/- 4ms
(7 frames)

After a few trials I measured an approximate latency for the iPad Pro of roughly 49ms or 3 frames of delay, while the Wacom Cintiq in this configuration had roughly 116ms or ~7 frames of delay. It’s worth mentioning here that the camera I used was recording at 240 FPS, so these figures could be off by around 4ms even before accounting for human error. Although the Cintiq 22 HD does have higher latency, I wouldn’t put too much into this as it’s likely that a more powerful computer driving the display would narrow, if not eliminate the gap entirely.

For reference, I estimated the Surface Pro 3 to have about 87 ms or 5-6 frames of delay, and the Surface Book to have about 69 ms or around 4 frames of delay. However, in the case of the Surface devices I was using Fresh Paint, which is a drawing application that isn't exactly comparable to Photoshop but is sufficient for comparison purposes. To give an idea for how much the application has an effect on latency, the Apple Notes app has roughly 38 ms or around 2 frames of latency from when the stylus tip passes over one point to when the inking reaches the same point.

While not strictly hardware, the software equation is really a critical part here as there are actual applications for the Apple Pencil which make it possible to use right now. An example of this would be OneNote, uMake, and Adobe Comp CC/Photoshop Sketch. Some of these applications work shockingly well like Photoshop Sketch, while something like OneNote feels relatively sparse by comparison as pretty much the only thing you can do with the stylus is draw simple lines with pressure sensitive thickness, with some automatic conversion of drawings to basic geometric shapes. With the right software, I can easily see the iPad Pro completely displacing traditional note-taking in light of obvious advantages that would come with OCR and digitizing notes for easy search.

Display Smart Keyboard
Comments Locked

408 Comments

View All Comments

  • AirunJae - Wednesday, February 10, 2016 - link

    Notice he said nothing about the iPad being better than the Surface, just that "...stop being a Fanboy" and "Surface Pro 4 wins" is ironic because you're following you plea for the reviewers (I assume) to stop being fanboys with some fanboyism of your own.
  • MaxIT - Saturday, February 13, 2016 - link

    Not running Windows make it better by definition....
  • Delton Esteves - Wednesday, February 17, 2016 - link

    Are you out of your mind? Not running full OS makes it worst
  • darwiniandude - Monday, February 29, 2016 - link

    "Full OS"
    Drivers. Malware. Compatibility issues (install old piece of software, have it break new software). No low latency audio, audio not a priority. Any decent software is designed for mouse and keyboard, not tablet interface. For my purposes Surface is a waste of space. In fact we recently bought used a Surface 2 256GB for $100. Owner thought it was faulty. Wifi didn't work. Touch screen didn't work. Trackpad didn't work. Everything looked fine with the software config except there was malware. Wiped and reset up, works fine. But I can't use it for anything because the software I want to run isn't on Windows. The tablet ecosystem is elsewhere. Windows store is a joke. So it sits gathering dust.
  • Alecgold - Friday, February 12, 2016 - link

    You've written a lot of BS.

    There is lighting to USB, so what is your point?
    Lighting to hdmi adapter is available as well..
    Lighting to memory card (with usb-3 speeds) is available
    Kickstand is build in in the keyboard or smartcover.
    Not everybody needs a pen, so why include it?
    I don't need USB, HDMI, SD-cards or kick stands.
    So why include it if you don't need it?

    Keyboard is expensive indeed, but it's really good...
    Who needs backlit, at night you need to sleep
    I'm really annoyed by the trackpad on the surface, doesn't work when I want to, does work when I don't want to
    Function keys are on the screen if needed or can be swiped up, not as convenient, but I prefer the small depth of the keyboard.
    Why would I need to rest my hand? It rests on the table I'm writing on.
    Setup was really fast an easy, what is complicated?

    The iPad is a tablet so therefore it runs a mobile os, it has great battery life, I can do everything I need to. I just can't OCR PDF's, that is the only thing I still miss.

    I'm a professional a consultant, I can do everything I need to, so there it is, it's used by a professional and therefore an iPad Pro. Just as good reasoning as yours, I guess.

    Is the iPad Pro for anybody? Absolutely not. It's expensive, others need more processing power or bigger/better/more complete software. But if you can get by with it, I t's really a good device and a really good experience!
  • Delton Esteves - Wednesday, February 17, 2016 - link

    Lighting to USB, lighting to hdmi adapter and lighting to memory card will cost you extra.

    The Kickstand which was built in the keyboard is very difficult to set up and has limited positions.

    "Not everybody needs a pen". This is not a reason to charge for extra money.

    Despite you do not need usb, hdmi, it does not mean they cannot include it. Because a device is made having in mind the general needs and not a single person needs.

    You call yourself a Professional and yet you say "Who needs backlit". It seems like everybody has a definition of a Pro device this days.

    So you always write on a table?

    Writting and tapping on the screen is tiresome, function keys make you more productive.
  • Constructor - Saturday, February 20, 2016 - link

    It is an illusion to believe that "included" items were in any way "free". In fact, for most people they would only pay more for stuff that they'd never use.

    On the bottom line everybody would have to pay more and there would be more electronic waste. Only the few people who actually used those add-ons might(!) get away slightly cheaper. That's it.
  • Delton Esteves - Tuesday, February 23, 2016 - link

    But at least, they are not charging extra. If you consider Ipad Pro price you will notice that it is already expensive for what it is and what the majority of its Users will use it for. They are charging a lot for zero extra functionality.
  • Constructor - Tuesday, February 23, 2016 - link

    I have paid a little more for my iPad Pro than for my iPad 3 four years ago, and the iPad Pro is again a much better tablet than the iPad 3 had been (and it was already a very good one!).

    And I have paid extra for the Pencil which I actually wanted to use. Other users left the Penicl out and didn't have to pay for it. It's that simple and the way it should be.

    So what exactly is the problem supposed to be with me paying for what I want to use, and others not paying for what they don't want to use? That's a really weird mindset from my point of view.
  • Delton Esteves - Wednesday, March 9, 2016 - link

    They should lower Ipad pro price because Apple Pen does not come with it

Log in

Don't have an account? Sign up now