Audio and acoustics

Event

Research Summit 2022

October 18, 2022 – October 20, 2022 | Virtual

Microsoft Research Summit 2022, held October 18-20, 2022, explores what’s next for technology and humanity.

Microsoft Research Summit 2022 background tile pattern

Publication

Spatial audio signal processing for binaural reproduction of recorded acoustic scenes – review and challenges

Boaz Rafaely, Vladimir Tourbabin, Emanuel Habets, Zamir Ben-Hur, Hyunkook Lee, Hannes Gamper, Lior Arbel, Lachlan Birnie, Thushara Abhayapala, Prasanga Samarasinghe

Acta Acustica | October 2022, Vol 6

Project

Publication

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training

Ziqiang Zhang, Long Zhou, Junyi Ao, Shujie Liu, Lirong Dai, Jinyu Li, Furu Wei

EMNLP 2022 | October 2022

Publication

Interactive and Immersive Auralization

Nikunj Raghuvanshi, Hannes Gamper

Sonic Interactions in Virtual Environments | Published by Springer | 2022

Publication

Large-scale simulation of bird localization systems in forests with distributed microphone arrays

Shoken Kaneko, Hannes Gamper

JASA | October 2022, Vol 2(10)

Publication

Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Interspeech 2022 | September 2022

Publication

Streaming Multi-Talker ASR with Token-Level Serialized Output Training

Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka

Interspeech 2022 | September 2022

Publication

Multi-Modal Multi-Correlation Learning for Audio-Visual Speech Separation

Xiaoyu Wang, Xiangyu Kong, Xiulian Peng, Yan Lu

INTERSPEECH 2022 | September 2022

Publication

Separating Long-Form Speech with Group-Wise Permutation Invariant Training

Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei

Interspeech 2022 | September 2022

Publication

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong

Interspeech 2022 | September 2022