Microsoft Research Blog

Microsoft Research Blog

The Microsoft Research blog provides in-depth views and perspectives from our researchers, scientists and engineers, plus information about noteworthy events and conferences, scholarships, and fellowships designed for academic and scientific communities.

How research can enable more effective remote work

April 9, 2020 | By Jaime Teevan, Chief Scientist; Brent Hecht, Director of Applied Science

women sits on green couch looking at a tablet on the coffee table in front of her

Due to recent events, millions of office workers have needed to rapidly adjust to working from home—learning new collaboration tools and best practices, re-thinking how to stay connected with colleagues outside the office, and adapting to new social norms around meetings. Working remotely presents both technical and social challenges, and researchers at Microsoft have been working across disciplines to understand and support both aspects of this challenge for decades.

Below is just a small sample of the work researchers at Microsoft and their colleagues have produced to improve the remote work experience. For those seeking to build better remote work products and services—or for anyone who wants to be more productive at home—we hope this research can provide some guidance, insight, and inspiration.

Although these are truly challenging times, we can benefit from a strong foundation of interdisciplinary research that can help us all stay productive and connected—with the hope of emerging from this crisis better-equipped to work together.

  • Paying attention can be harder in remote meetings. Sean Rintel at Microsoft Research Cambridge recently published two papers that can inform the design of features to support remote participants’ attention. One paper models how we ‘see’ attention in meetings. It suggests that machine perception may help us gather, signal, and follow attention when remote. The second paper suggests that low engagement in meetings may not always be a problem. Not every meeting requires our full engagement, but until we develop technological support for more nuanced roles, it is good practice to be up front about your engagement level. Together, these papers suggest that AI supported attention personalization could make future remote meetings more inclusive and effective by helping us overcome constraints and assumptions.
  • One benefit to everyone attending a meeting virtually is that it can be easier to review missed content if you show up to a meeting late or have to step out for a moment. For instance, Kori Inkpen, Sasa Junuzovic, and John Tang from Microsoft Research Redmond have explored using “accelerated instant replay” (AIR) to help people catch up quickly and then jump (back) into the real-time meeting.
  • In a world without business travel, negotiating time zone constraints becomes even more important. John Tang at Microsoft Research Redmond and Kori Inkpen at the Microsoft Research AI Lab have catalogued strategies for mitigating time zone-related obstacles to productivity and provided guidelines to help overcome these obstacles. Tang and Inkpen also worked with Asta Roseway, Mary Czerwinski, and Paul Johns from Microsoft Research Redmond to explore novel uses of asynchronous video to support collaboration across time zones and developed two prototype systems, Time Travel Proxy and Video Threads.
  • Some features in Microsoft Teams were inspired by work led by Kenton O’Hara at Microsoft Research Cambridge on utilizing multiple devices to support better presentation and collaboration over video; researchers’ participation in an internal hackathon led to close collaboration on development of the product. Their previous research into ad hoc adaptability in video calling, wireless smartphone mirroring in video calls, and shared slideware control helped enhance users’ ability to join meetings on multiple devices and use a phone as a companion device. Learn the inside story of the hackathon and product collaboration in this article on companion experiences for Microsoft Teams.
  • Video calling that is “just like being there” isn’t always ideal for people with autism, who have different sensory, cognitive and social needs. Researchers at Microsoft are seeking to better understand the experiences of people with autism when they use current video communication technologies. These researchers found that, when participating in video calls, people with autism often have to use coping strategies such as moderating sensory inputs, creating mental models of conversation partners, and adopting neurotypical behaviors. These coping strategies produce a great deal of stress, increase cognitive load, and leave people with autism feeling less empowered to participate in conversations. Using their results, the research team at Microsoft was able to outline improvements to video conference technologies that can make these technologies more comfortable and empowering for individuals with autism.

Looking forward, there will be an unprecedented opportunity for researchers to learn from the current situation to figure out not only how to manage future disruption, but also to incorporate new ways of working at home or in the office. Microsoft is committed to investing in research internally and externally to make this happen. For example, in more typical times, remote work often involves meetings with both remote and co-located colleagues. Better understanding and supporting productivity in these hybrid meetings is the subject of one of the academic projects Microsoft funds through the Microsoft Productivity Research program in collaboration with Dr. Mirjam Augstein and Dr. Thomas Neumayr at the University of Applied Sciences Upper Austria.

If you’d like to do a deeper dive into the literature on remote work, below is a selection of additional papers from Microsoft researchers on the subject.

Remote Meetings

Researchers at Microsoft have been working across disciplines to address the unique and complex challenges of meeting remotely, such as improving the quality, fidelity, and utility of meetings; addressing design issues; merging physical and virtual collaboration; and exploring the use of avatars:

“Hybrid meetings” (meetings with remote and co-located participants)

Spatialized audio and video for video calling

“Accelerated instant replay” during a video call

Avatars in remote meetings

Remotely collaborating when completing tasks in the physical world

Remote Teambuilding

Early research on remote work

Long before remote work became a way of life, researchers at Microsoft exploring the social and technical aspects of collaborating remotely. Below is a selection of work on the subject dating back nearly thirty years:

Work in related areas

Microsoft researchers have also made substantial contributions to researcher areas adjacent to remote work that are increasingly relevant in today’s context—in how remote work technologies can support family life and play. For instance:

Connecting family across distance

Remote Play

Video Communication for First Responders

Thanks to Kori Inkpen, Sean Rintel, Abi Sellen, and John Tang, who also contributed to this post.

Up Next

Artificial intelligence, Computer vision, Human-computer interaction, Security, privacy, and cryptography

Microsoft Research 2019 reflection—a year of progress on technology’s toughest challenges

Research is about achieving long-term goals, often through incremental progress. As the year comes to an end, it’s a good time to step back and reflect on the work that researchers at Microsoft and their collaborators have done to advance the state of the art in computing, particularly by increasing the capabilities and reach of […]

Microsoft blog editor

Human-computer interaction

Making ‘micromoments’ work for you

Imagine you’ve been asked to write a crucial document for your company, perhaps a detailed outline of its long-term strategy. You’re excited, but don’t know when you’ll find the time to write it. As you sit in a meeting later that day, waiting for the person who arranged it, you envision the outline and the […]

Shamsi Iqbal

Principal Researcher

Artificial intelligence, Human-computer interaction

Enable(ing) people to do more with Dr. Rico Malvar

Episode 61, January 30, 2019 - Dr. Rico Malvar recalls his early years at a fledgling Microsoft Research, talks about the exciting work he oversees now, explains why designing with the user is as important as designing for the user, and tells us how a challenge from an ex-football player with ALS led to a prize winning hackathon project and produced the core technology that allows you to type on a keyboard without your hands and drive a wheelchair with your eyes.

Microsoft blog editor