Human-computer interaction
Redefining human experiences through innovations in research, design, and technology.
Highlights
Camera-based non-contact health sensing
Read more about Camera-based non-contact health sensing
Inside AR and VR, a technical tour of the reality spectrum with Dr. Eyal Ofek
Read more about Inside AR and VR, a technical tour of the reality spectrum with Dr. Eyal Ofek
HCI, IR and the search for better search with Dr. Susan Dumais
Read more about HCI, IR and the search for better search with Dr. Susan Dumais
This form contains a series of checkboxes that, when selected, will update the search results and the form fields. Currently selected items are under the "current selections" heading.
3,678 results found
Publication
Belonging There: VROOM-ing into the Uncanny Valley of XR Telepresence
The world is entering a new normal of hybrid organisations, in which it will be common that some members are co-located and others are remote. Hybridity is rife with asymmetries that affect our sense of belonging in an organisational space. This paper reports a study of an XR Telepresence technology probe to explore how remote workers might present themselves and be perceived as an equal and unique embodied being in a workplace. VROOM (Virtual Robot…
Publication
Please Turn Your Cameras On: Remote Onboarding of Software Developers during a Pandemic
The COVID-19 pandemic has impacted the way that software development teams onboard new hires. Previously, most software developers worked in physical offices and new hires onboarded to their teams in the physical office, following a standard onboarding process. However, when companies transitioned employees to work from home due to the pandemic, there was little time to no time to develop new onboarding procedures. In this paper, we present a survey of 267 new hires at…
Publication
“Is My Mic On?” Preparing SE Students for Collaborative Remote Work and Hybrid Team Communication
Communication is essential for the success of student and professional software engineering (SE) team development projects. The projects delivered by SE courses provide valuable learning experiences for students because they teach industry-required skills such as teamwork, communication, and scheduling. Professional SE teams have adopted communication software such as Slack, Miro, Microsoft Teams, and GitHub Discussions to share files and convey information between team members. Likewise, they have distributed software development tools such as Visual Studio…
Publication
Leaving My Fingerprints: Motivations and Challenges of Contributing to OSS for Social Good
When inspiring software developers to contribute to open source software, the act is often referenced as an opportunity to build tools to support the developer community. However, that is not the only charge that propels contributions—growing interest in open source has also been attributed to software developers deciding to use their technical skills to benefit a common societal good. To understand how developers identify these projects, their motivations for contributing, and challenges they face, we…
Event
Microsoft Research at CHI 2021
Microsoft is excited to be a Champion sponsor of the 2021 ACM CHI Conference on Human Factors in Computing Systems.
Publication
AffectiveSpotlight: Facilitating the Communication of Affective Responses from Audience Members during Online Presentations
The ability to monitor audience reactions is critical when delivering presentations. However, current videoconferencing platforms offer limited solutions to support this. This work leverages recent advances in affect sensing to capture and facilitate communication of relevant audience signals. Using an exploratory survey (N=175), we assessed the most relevant audience responses such as confusion, engagement, and head-nods. We then implemented AffectiveSpotlight, a Microsoft Teams bot that analyzes facial responses and head gestures of audience members and…
Publication
TweakIt: Supporting End-User Programmers Who Transmogrify Code
End-user programmers opportunistically copy-and-paste code snippets from colleagues or the web to accomplish their tasks. Unfortunately, these snippets often don’t work verbatim, so these people — who are non-specialists in the programming language — make guesses and tweak the code to understand and apply it successfully. To support their desired workflow and facilitate tweaking and understanding, we built a prototype tool, TweakIt, that provides users with a familiar live interaction to help them understand, introspect,…
Publication
Data@Hand: Fostering Visual Exploration of Personal Data on Smartphones Leveraging Speech and Touch Interaction
Most mobile health apps employ data visualization to help people view their health and activity data, but these apps provide limited support for visual data exploration. Furthermore, despite its huge potential benefits, mobile visualization research in the personal data context is sparse. This work aims to empower people to easily navigate and compare their personal health data on smartphones by enabling flexible time manipulation with speech. We designed and developed Data@Hand, a mobile app that…
Publication
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Many researchers motivate explainable AI with studies showing that human-AI team performance on decision-making tasks improves when the AI explains its recommendations. However, prior studies observed improvements from explanations only when the AI, alone, outperformed both the human and the best team. Can explanations help lead to complementary performance, where team accuracy is higher than either the human or the AI working solo? We conduct mixed-method user studies on three datasets, where an AI with…
Publication
Spreadsheet Comprehension: Guesswork, Giving up and Going back to the Author
Spreadsheet users routinely read, and misread, others’ spreadsheets, but literature offers only a high-level understanding of users’ comprehension behaviors. This limits our ability to support millions of users in spreadsheet comprehension activities. Therefore, we conducted a think-aloud study of 15 spreadsheet users who read others’ spreadsheets as part of their work. With qualitative coding of participants’ comprehension needs, strategies and difficulties at 20-second granularity, our study provides the most detailed understanding of spreadsheet comprehension to…