Microsoft Research presents paper on Simultaneous Pen + Touch

Mary-Jo Foley at ZDNet reports that the Microsoft Research team behind Manual Deskterity is presenting the white paper on their work on Simultaneous Pen + Touch at the ACM Symposium on User Interface Software and Technology.

As you may recall but likely have forgotten, the team released a video preview of their work back in April. The basic concept is that the current dual digitizer technology allows pen input OR touch input, but not both at the same time. Their project allows both to work in conjunction for effects that can be clumsy for one or the other. Or as they put it in their paper:

Based on our explorations we advocate a division of labor between pen and touch: the pen writes, touch manipulates, and the combination of pen + touch yields new tools.

The paper provides very useful background info to what you see in the video (re-posted below), as well as descriptions of the simultaneous pen + touch tools they show. I am particularly impressed by how they examined the usage of a paper notebook not simply for writing notes but also for scrapbooking and manipulation.

The paper makes passing mention of Courier, which MJF fawns over. What I found more interesting was the reference to Codex, which I did not realize was presented in a paper by Ken Hinckley and his team last year. So while the work was done on a Microsoft Surface, they are definitely looking at mobile implementations. Just hope we can see it in consumer form some time.