Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Group
Ability
The Ability team conducts research at the intersection of HCI and AI, with the aim of developing innovative technologies that extend the capabilities of and enhance quality of life for people with disabilities (long-term, temporary…
Tool
Caption Crawler Extension for Chrome (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Tool
Caption Crawler Extension for Edge (beta)
Caption Crawler is assistive technology that allows screen reader users to automatically replace bad or missing descriptions of images on their favorite websites with image captions from other pages that have similar images. Learn more…
Video
Caption Crawler Enables Reusable Alternative Text Descriptions using Reverse Image Search
CHI 2018 video figure
Video
Rich Representations of Visual Content for Screen Reader Users
Video Figure for CHI 2018 paper on Rich Representations of Visual Content for Screen Reader Users
Video
Eyes-Free Art: Exploring Proxemic Audio Interfaces for Blind and Low Vision Art Engagement
Engagement in the arts is an important component of participation in cultural activities, but remains a largely unaddressed challenge for people with sensory disabilities. Visual arts are generally inaccessible to people with visual impairments due…
Video
Dueto: Accessible, Gaze-Operated Musical Expression
Gaze-tracking technologies can enable computer access for users who are unable to use standard input devices. However, using gaze as input poses challenges for interactions that require visual planning, like playing a digital instrument. We…
Video
Accessibility – How Microsoft is making technology accessible to more people
Researcher Meredith Ringel Morris discusses three projects highlighted at CHI 2018 which focus on improving technology for people with low-vision or blindness. Topics include featured paper Caption Crawler, Rich representations of visual content for screen…
Project
Accessible Information Retrieval
Web search is an important modern literacy skill, necessary for fully participating in many aspects of society including education, employment, commerce, and entertainment. However, web search is particularly challenging for people with print disabilities, such…
Video
VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search
Video figure for ASSETS 2019 VERSE article.
