Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Project
Microsoft Academic
Microsoft Academic is a project exploring how to assist human conducting scientific research by leveraging machine’s cognitive power in memory, computation, sensing, attention, and endurance.
Video
Virtual reality without vision: A haptic and auditory white cane to navigate complex virtual worlds
Video Figure accompanying CHI 2020 paper, demonstrating a novel haptic device that allows a white cane user to interact with a large, complex virtual environment. Full paper is available at https://aka.ms/VRWhiteCane Current Virtual Reality (VR)…
Video
VROOM: Virtual Robot Overlay for Online Meetings – Video Figure
Telepresence robots allow remote users to freely explore a space they are not in, and provide a physical embodiment in that space. However, they lack a compelling representation of the remote user in the local…
Project
Accessible Mixed Reality
This project considers how to design emerging Mixed Reality technologies (including AR and VR) so that they are usable by and useful to people of all abilities. Too often, the accessibility of technology to people…
Group
Ability
The Ability team conducts research at the intersection of HCI and AI, with the aim of developing innovative technologies that extend the capabilities of and enhance quality of life for people with disabilities (long-term, temporary…
Tool
Caption Crawler Extension for Chrome (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Tool
Caption Crawler Extension for Edge (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Video
Caption Crawler Enables Reusable Alternative Text Descriptions using Reverse Image Search
CHI 2018 video figure
Video
Rich Representations of Visual Content for Screen Reader Users
Video Figure for CHI 2018 paper on Rich Representations of Visual Content for Screen Reader Users
Video
Eyes-Free Art: Exploring Proxemic Audio Interfaces for Blind and Low Vision Art Engagement
Engagement in the arts is an important component of participation in cultural activities, but remains a largely unaddressed challenge for people with sensory disabilities. Visual arts are generally inaccessible to people with visual impairments due…
