Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Publication
Social App Accessibility for Deaf Signers
Project
SurfaceFleet
SurfaceFleet is a system and toolkit that uses resilient and performant distributed programming techniques to explore cross-device user experiences. With appropriate design, these technologies afford mobility of user activity unbounded by device, application, user, and…
Video
Tilt-Responsive Techniques for Digital Drawing Boards
Drawing boards offer a self-stable work surface that is continuously adjustable. On digital displays, such as the Microsoft Surface Studio, these properties open up a class of techniques that sense and respond to tilt adjustments.…
Video
SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and Time
Knowledge work increasingly spans multiple computing surfaces. Yet in status quo user experiences, content as well as tools, behaviors, and workflows are largely bound to the current device—running the current application, for the current user,…
Video
Soundscape Street Preview
Soundscape Street Preview breaks fresh ground for Soundscape by providing an innovative tool for virtually exploring the world! With it, you can select any location in the world to preview the area at street level…
Project
Microsoft TileCode
Microsoft TileCode is an app for designing, coding, and playing video games directly on low-cost MakeCode Arcade gaming handhelds, as well as in the web browser.
Publication
A Federated Approach in Training Acoustic Models
Project
Project Insight
Project Insight aims to develop hardware-agnostic gaze-trackers using the power of Artificial Intelligence and Deep Learning. We are trying to solve the challenges of affordability, reliability, inter-operability and ease-of-use. On one hand, we are advancing…