Human-Computer Interaction

Human-Computer Interaction

Established: January 1, 2017

Microsoft Research’s Human-Computer Interaction Group (HCI@MSR) comprises a world-renowned, interdisciplinary team of research scientists, engineers, and designers who take a user-centered approach to developing, designing, and studying computing technology and its use. Areas of specialty within our team include topics such as interaction techniques and devices, social computing and computer-supported cooperative work, interactive machine learning and crowd-powered systems, information visualization, augmented and virtual reality, affective computing, wearables, inclusive/accessible technology design, technologies for emerging markets, and ethnography.










Timeline Storyteller

March 2017

Timeline Storyteller is an expressive browser-based visual storytelling environment for presenting timelines. You can use Timeline Storyteller to present different aspects of your data using a palette of timeline representations, scales, and layouts, as well as controls for filtering, highlighting, and annotation. You can export images of a timeline or assemble and record a story…

    Click the icon to access this download

  • Github



GlassHands: Interaction Around Unmodified Mobile Devices Using Sunglasses

Established: January 1, 2016

We present a novel approach for extending the input space around unmodified mobile devices. Using built-in front facing cameras of unmodified handheld devices, GlassHands estimates hand poses and gestures through reflections in sunglasses, ski goggles or visors. Thereby, GlassHands creates an enlarged input space, rivaling input reach on large touch displays. We introduce the idea along with its technical concept and implementation. We demonstrate the feasibility and potential of our proposed approach in several application…

Logan: Logfile Analysis

Established: October 12, 2015

Understanding Techniques and Tools for More Effective Telemetry and Log Data Analysis. Increasingly, business processes require data-driven real-time feedback based on large quantities of log data and customer telemetry from multiple sources. The Logan Project takes a broad approach to understanding the specific needs of consumers of telemetry and log data, focusing on giving them better support for extracting the data they need, cleaning it, and creating queries against it. To understand…

User Experience with Big Data

Big data analytics requires new workflows: high latency queries, massively-parallel code, and cloud computing infrastructures all make handling a big dataset different (and harder) than working on a local machine. We are exploring user experiences for analysts, and thinking about new ways to deal with big datasets. BigDataUX: building a better user experience for Big Data. Lots of different definitions can be found for "big data," but they all have one aspect…

Data-Driven Storytelling

Established: May 14, 2012

Practitioners increasingly use visualizations “in the wild” to tell compelling stories supported by data, and continually develop novel techniques that help integrate data visualization into narrative stories. The visualization research community has recently begun to pay more attention to the need and use of visualization as a storytelling medium to tell engaging visual data-driven stories.  In addition to understanding the data story creation process and the techniques used in successful data stories, we explore ways…


Established: November 10, 2011

Visually explore, understand, and present data SandDance is a web-based application that enables you to more easily explore, identify, and communicate insights about data. SandDance provides ease of use for data visualizations, pattern identification, trends, and insights. It provides better decision-making capabilities through its dynamic and customizable interface, allowing views of both aggregate and individual data. The app also supports and encourages collaboration, allowing multiple people to work with the same dataset. Furthermore,…


Established: December 8, 2008

This page is an archive of the InkSeine project's web page. The project is no longer active. The prototype is no longer maintained and does not work on Windows 10. If you have a tablet running Windows 7 or Windows Vista, InkSeine should still work on those platforms. It also has dependencies on older versions of Office, such as for interop with Microsoft Outlook. For those of you who were fans of InkSeine, we are…

Visualization for Machine Teaching

Established: June 17, 2008

A large body of human-computer interaction research has focused on developing metaphors and tools that allow people to effectively issue commands and directly manipulate informational objects. However, with the advancement of computational techniques such as machine learning, we now have the unprecedented ability to embed 'smarts' that allow machines to assist and empower people in completing their tasks. We believe that there exists a computational design methodology which allows us to gracefully combine automated services with…