Graphics and multimedia
Agent AI
Agent-based multimodal AI systems are becoming a ubiquitous presence in our everyday lives. A promising direction for making these systems more interactive is to embody them as agents within specific environments. The grounding of large…
Collaborators: Gaming AI with Haiyan Zhang
For over a decade, Xbox has been leveraging AI to elevate gaming. Haiyan Zhang, GM of Gaming AI, explores the collaborations behind the work and the potential for generative AI to support better experiences for…
Collaborators: Holoportation™ communication technology with Spencer Fowers and Kwame Darko
A global team of medical providers is leveraging Holoportation, a Microsoft 3D capture and communication technology, to widen access to specialized care. Computer engineer Spencer Fowers and plastic surgeon Kwame Darko discuss the collaboration.
Holoportation system utilizing Azure Kinects + RGB capture
This video was captured using the new Holoportation system that utilizes Azure Kinects for depth + RGB capture. We have found that the Azure Kinects provide some of the highest quality depth data of any…
3D Telemedicine
Bringing specialized healthcare to rural and underserved communities with live 3D communication Our paper, “Participatory Development of a 3D Telemedicine system during Covid: the future of remote consultations” received the Top Paper award at BAPRAS…