Always-Available Mobile Interaction Survey Article
Dan Morris , Desney Tan , and I put together an article on Emerging Input Technologies for Always-Available Mobile Interaction. Our article outlines the idea of Always-Available interaction in mobile settings. We also provide a survey of input and output technologies that are relevant to this domain.
At UIST 2011, we presented our PocketTouch paper . In this work, Chris Harrison, Hrvoje Benko , and I tackled creating a capacitive-touch based input device that can work through fabrics. Our goal is to enable phones and other mobile devices to accept gesture and handwriting input without removing those devices from their pocket, bag, or case.
Anne Eisenberg wrote a kind article on PocketTouch in the New York Times.
Wireless Muscle Computer Interface with Dry Electrodes
We presented our note Making Muscle-Computer Interfaces More Practical in the Brains and Brawn session at CHI 2010 in Atlanta, GA. This note builds on our previous work in muscle-computer interfaces by tackling the challenges of creating sensing hardware suitable for mobile and off-desktop environments, electrodes that can be put on quickly without adhesives or gel, and gesture recognition techniques that require no new training or calibration after re-donning a muscle-sensing armband.
At UIST 2009 in beautiful Victoria, we presented our Tech Note on our new work prototyping new methods for Tongue-Computer Input. Check out the video below. It is an excerpt from our talk on a new tongue-based input technique. It shows my colleague Dan playing tetris with a wired version of our device. We also have demonstrated the ability to control a motorized chair from our tongue input device. Our latest version of the device is a wireless orthodontic-like retainer.
Playing Guitar Hero (and other examples of Muscle-Computer Input)
At UIST 2009 We presented our paper on Muscle-Computer Input . In this work, we are exploring directly using muscles for input in situations (such as carrying objects) where normal physical input devices are inconvient or impossible to use. Kate Greene of the MIT Technology Review wrote up an article about our work on Muscle-Computer Interfaces. She discusses our approach to muscle-sensing for computer input and our paper at UIST 2009.
Following Johhny Lee ‘s post to his Procrastineering Blog about the video figure (shown below) from our paper at UIST 2009, the following websites picked up the story: ACM TechNews, Engadget, Gizmodo, Joystiq, Kotaku, LiveScience, Makezine, Popular Science, Slashdot, and TechRadar. For a longer clip of the Guitar Hero demo, here is a video of me playing Air Guitar Hero. All versions on YouTube: mine, CHI, and TechFlash.
Muscle-Computer Input + Interactive Tabletops = Awesome
We have a paper combining muscle sensing and the Microsoft Surface at the Interactive Tabletops and Surfaces 2009 conference. Check out our video to see our interaction techniques in action!
Check out our CHI 2008 paper with Desney Tan , Dan Morris, & Ravin Balakrishnan on Muscle-Computer Interfaces at CHI. New Scientist and the blogosphere gave this work some great coverage.
Our work on Muscle-Computer Interfaces was mentioned in an article in Forbes Magazine by Lee Gomes. His article describes the importance of the keyboard and mouse in our everyday lives and some of the alternative input approaches researchers have explored.
Dr. Bill Crounse, senior director of worldwide health at Microsoft, stopped by Microsoft Research and interviewed several people, including me, about our current research. He wrote and spoke about our work on Muscle-Computer Input in his Health Blog and on Microsoft’s Channel 10.