Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment

  • Andy Wilson, Microsoft; Hrvoje Benko, Microsoft; Eyal Ofek, Microsoft

Room2Room is a life-size telepresence system that leverages projected augmented reality to enable co-present interaction between two remote participants. Our solution recreates the experience of a face-to-face conversation by performing 3D capture of the local user with color + depth cameras and projecting their virtual copy into the remote space at life-size scale. This creates an illusion of the remote person’s physical presence in the local space, as well as a shared understanding of verbal and non-verbal cues (e.g., gaze, pointing) as if they were there.

Watch Next