Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Project
Image Accessibility
Digital imagery pervades modern life. More than a billion images per day are produced and uploaded to social media sites, and we also encounter digital images within websites, apps, digital documents, and eBooks. Engaging with…
Video
InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices
InChorus employs multimodal interactions that function consistently across different visualizations, supporting common operations during visual data analysis. InChorus synergistically combines multiple forms of input (i.e., pen, touch, & speech) to allow people to stay in…
Project
Microsoft Academic
Microsoft Academic is a project exploring how to assist human conducting scientific research by leveraging machine’s cognitive power in memory, computation, sensing, attention, and endurance.
Video
Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds
Video Figure accompanying CHI 2020 paper, demonstrating a novel haptic device that allows a white cane user to interact with a large, complex virtual environment. Full paper is available at https://aka.ms/VRWhiteCane Current Virtual Reality (VR)…
Video
VROOM: Virtual Robot Overlay for Online Meetings – Video Figure
Telepresence robots allow remote users to freely explore a space they are not in, and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local…
Project
Accessible Mixed Reality
This project considers how to design emerging Mixed Reality technologies (including AR and VR) so that they are usable by and useful to people of all abilities. Too often, the accessibility of technology to people…
Group
Ability
The Ability team conducts research at the intersection of HCI and AI, with the aim of developing innovative technologies that extend the capabilities of and enhance quality of life for people with disabilities (long-term, temporary…
Tool
Caption Crawler Extension for Chrome (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Tool
Caption Crawler Extension for Edge (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Video
Caption Crawler Enables Reusable Alternative Text Descriptions using Reverse Image Search
CHI 2018 video figure
