Multimedia, Interaction, and Communication (MIC)

Established: November 7, 2011

The Multimedia, Interaction, and Communication (MIC) group extends the state of the art of multimedia technologies involving audio, visual, haptic, and other natural signals, comprising acquisition, representation, analysis, compression, transmission, synthesis, and rendering. We apply our expertise in computer vision, acoustics, multimedia signal processing, and information coding to improve people’s experience in interacting with each other and with machines. Applications are immersive human-human telecommunications, human-robot interaction, augmented reality, multimedia retrieval, etc.












Link description

Facing Interaction


December 20, 2012


Tomás Laurenzo


Microsoft Research Intern



Established: May 28, 2015

The PinDrop project focuses on building the substrate for supporting high-quality real-time streaming over wired and wireless networks. Context Real-time streaming across the wide-area network (WAN) is key to several existing and anticipated services, including voice and video conferencing (e.g., Skype, Viber), remote console access (e.g., remote desktop, VNC), remote application streaming (e.g., Azure RemoteApp), and cloud-based gaming. A common characteristic of these services is bidirectional interactive communication, between two or more users or between a user…

Eye-Gaze Tracking for Improved Natural User Interaction

Established: April 12, 2014

We develop novel eye-gaze tracking technologies in order to make eye-gaze tracking technology ubiquitously available for improved natural user interaction (NUI).   In particular, we investigate two approaches: Active IR lighting: We investigate the possibility of using multiple IR lights around a display. The key idea is to use many (more than 4) IR lights distributed around a monitor border. RGB + Depth: We leverage both RGB camera and depth sensor already available in Kinect…

ViiBoard: Vision-enhanced Immersive Interaction with Touch Board

Established: April 11, 2014

ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixel) in two areas: human computer interaction and immersive remote collaboration. Simple Setup ViiBoard uses only an RGBD camera (Microsoft Kinect), mounted on the side of a large touch display, to enhance user interaction and enable 3D immersive collaboration in a desirable form factor, practical for home or office use. Part I: Vision-enhanced Interaction ViiBoard augments the touch…

Facing Interaction

Established: February 20, 2013

How can we communicate one's biometric info, in non-verbal ways, to others, ourselves, places and across time? Under the assumptions that one's face is a sound window to somebody’s emotion, we constructed different art pieces and interactive prototypes that comprise different communication channels (aural, visual, haptics), and aim to help reflecting on communication itself, its poetry, and ourselves. This project starts with the internship work from Tomas Laurenzo.

Microsoft Research blog

Office Lens Is a Snap

The moment mobile-phone manufacturers added cameras to their devices, they stopped being just mobile phones. Not only have lightweight phone cameras made casual photography easy and spontaneous, they also have changed the way we record our lives. Now, with help from Microsoft Research, the Office team is out to change how we document our lives in another way—with the Office Lens app for Windows Phone 8. Office Lens, now available in the Windows Phone Store,…

March 2014

Microsoft Research Blog