Audio and acoustics
Publication
Online Speaker Diarization with Relation Network
Video
Directional Sources and Listeners in Interactive Sound Propagation using Reciprocal Wave Field Coding
We present the first wave-based interactive system for practical rendering of global sound propagation effects including diffraction, in complex game and VR scenes with moving directional sources and listeners. Learn about Project Triton > Note:…
Video
Planeverb: Interactive sound propagation for dynamic scenes using 2D wave simulation
We present a technique to model wave-based sound propagation to complement visual animation in fully dynamic scenes. We employ 2D wave simulation that captures geometry-based diffraction effects such as obstruction, reverberation, and directivity of perceptually-salient…
Video
Audio-based Toxic Language Detection
Online gaming has been growing increasingly popular recently. This highly competitive online social platform can sometimes lead to undesired behavior and create an unfriendly community for many players. The detecting of profanity and bullying have…
Video
Interactive sound simulation: Rendering immersive soundscapes in games and virtual reality
The audio-visual immersion of game engines and virtual reality/mixed reality has a vast range of applications, from entertainment to productivity. Physical simulation is required in these applications to produce nuanced, believable renderings that respond fluidly…
Webinar
Interactive sound simulation: Rendering immersive soundscapes in games and virtual reality
In this webinar led by Microsoft Principal Researcher Dr. Nikunj Raghuvanshi, learn the ins and outs of creating practical, high-quality sound simulations. You will get an overview of the three components of sound simulation: synthesis,…
Microsoft Research Blog
Research Collection: The Unseen History of Audio and Acoustics Research at Microsoft
Getting the sound right is a crucial ingredient in natural user interfaces, immersive gaming, realistic virtual and mixed reality, and ubiquitous computing.
Video
Forest Sound Scene Simulation and Bird Localization with Distributed Microphone Arrays
Audio-based wildlife monitoring is an important method for studying animal habitations and for the conservation of animal species and ecosystems. In this work, we have developed a highly efficient and scalable forest acoustics simulation algorithm,…
