MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering
Mahmoud Khademi, Ziyi Yang, Felipe Vieira Frujeri, Chenguang Zhu
2023 Empirical Methods in Natural Language Processing | December 2023
Azure Cognitive Services Research
Publications
Publications
-
2014
Artificial Neural Network Features for Speaker Diarization
The relation of eye gaze and face pose: Potential impact on speech recognition
An Introduction to Computational Networks and the Computational Network Toolkit
Neural Network Models for Lexical Addressee Detection
Speech Emotion Recognition Using Deep Neural Network and Extreme Learning Machine
Highly Accurate Phonetic Segmentation Using Boundary Correction Models and System Fusion
2010
Statistical Modeling of the Speech Signal
Dual stage probabilistic voice activity detector
2009
Commute UX: Voice Enabled In-car Infotainment System
Unified Framework for Single Channel Speech Enhancement
2008
Sound Capture System and Spatial Filter for Small Devices
Data Driven Beamformer Design for Binaural Headset
Robust Design of Wideband Loudspeaker Arrays
An EM-based Probabilistic Approach for Acoustic Echo Suppression
2007
Commute UX: Telephone Dialog System for Location-based Services
Robust Location Understanding in Spoken Dialog Systems Using Intersections
2006
Microphone Array Post-Processor Using Instantaneous Direction of Arrival
Suppression Rule for Speech Recognition Friendly Noise Suppressors
2005
A Compact Multi-Sensor Headset for Hands-Free Communication
Microphone Array for Headset with Spatial Noise Suppressor
Publications by Year
-
Global Selection of Contrastive Batches via Optimization on Sample Permutations
Vin Sachidananda, Ziyi Yang, Chenguang Zhu
ICML 2023 | July 2023
Unifying Vision, Text, and Layout for Universal Document Processing
Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization
Dongmei Wang, Xiong Xiao, Naoyuki Kanda, Takuya Yoshioka, Jian Wu
ICASSP 2023 | June 2023
In-Context Demonstration Selection with Cross Entropy Difference
Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu
May 2023
Arxiv
PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
May 2023
Small Models are Valuable Plug-ins for Large Language Models
Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley
May 2023
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
Generate rather than Retrieve: Large Language Models are Strong Context Generators
Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
ICLR 2023 | May 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT
Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng
May 2023
LMGQS: A Large-scale Dataset for Query-focused Summarization
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
Chaojun Wang, Yang Liu, Wai Lam
ACL 2023 Findings | May 2023
Prompting GPT-3 To Be Reliable
Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
International Conference on Learning Representations (ICLR 23) | May 2023
G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu
arXiv 2303.16634 | March 2023
MACSum: Controllable Summarization with Mixed Attributes
Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
Transactions of the Association for Computational Linguistics | March 2023
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
AAAI 2023 | February 2023
-
Narrate Dialogues for Better Summarization
Ruochen Xu, Chenguang Zhu, Michael Zeng
2022 Empirical Methods in Natural Language Processing | December 2022
A Unified Encoder-Decoder Framework with Entity Memory
Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Automatic Rule Induction for Efficient Semi-Supervised Learning
Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
2022 Empirical Methods in Natural Language Processing | December 2022
Best Paper Award at SoCal NLP Symposium 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
December 2022
Leveraging Locality in Abstractive Text Summarization
Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
EMNLP 2022 | December 2022
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix
Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
EMNLP 2022 | December 2022
Towards A Unified Multi-Dimensional Evaluator For Text Generation
Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han
Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
Unsupervised Summarization with Customized Granularities
Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
arXiv:2211.05564 | November 2022
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Real-Time Target Sound Extraction
Bandhav Veluri, Justin Chan, Malek Itani, Tuochao Chen, Takuya Yoshioka, Shyamnath Gollakota
arXiv:2211.02250 | November 2022
Breaking the trade-off in personalized speech enhancement with cross-task knowledge distillation
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka
November 2022
Submitted to ICASSP 2023
Breaking trade-offs in speech separation with sparsely-gated mixture of experts
Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
arXiv:2211.06493 | November 2022
Real-Time Joint Personalized Speech Enhancement and Acoustic Echo Cancellation with E3Net
Sefik Emre Eskimez, Takuya Yoshioka, Alex Ju, Min tang, Tanel Parnamaa, Huaming Wang
November 2022
Submitted to ICASSP 2023
Simulating realistic speech overlaps improves multi-talker ASR
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2210.15715 | October 2022
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2209.04974 | September 2022
Fast Real-time Personalized Speech Enhancement: End-to-End Enhancement Network (E3Net) and Knowledge Distillation
Manthan Thakker, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang
Interspeech 2022 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
CLIP-Event: Connecting Text and Images with Event Structures
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang
ACL 2022 | May 2022
End-to-End Segmentation-based News Summarization
Yang Liu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
Continuous Speech Separation with Recurrent Selective Attention Network
Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
ICASSP 2021 | May 2022
DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
ACL 2022 | May 2022
DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization
Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
ACL 2022 | May 2022
Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
ICASSP 2022 | May 2022
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
ACL 2022 | May 2022
Leveraging Knowledge in Multilingual Commonsense Reasoning
Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
ACL 2022 | May 2022
PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
ICASSP 2022 | May 2022
Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents
Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
ACL 2022 | May 2022
Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ICASSP 2022 | May 2022
VarArray: Array-Geometry-Agnostic Continuous Speech Separation
Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
ICASSP 2022 | May 2022
DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
AAAI 2022 | February 2022
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng
AAAI 2022 | February 2022
-
A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ASRU 2021 | December 2021
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
December 2021
The Elastic Lottery Ticket Hypothesis
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
A Review of Speaker Diarization: Recent Advances with Deep Learning
Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan
Computer Speech & Language | November 2021, Vol 72
An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next
Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev
Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
Injecting Entity Types into Entity-Guided Text Generation
Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
Accelerating Real-Time Question Answering via Question Generation
Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu
arXiv: Computation and Language | September 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Does Knowledge Help General NLU? An Empirical Study
Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng
arXiv: Computation and Language | September 2021
End-to-End Speaker-Attributed ASR with Transformer
Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
Investigation of Practical Aspects of Single Channel Speech Separation for ASR
Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
Interspeech 2021 | August 2021
Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
Universal Sentence Representations Learning with Conditional Masked Language Model
Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
EMNLP 2021 | August 2021
Continuous Speech Separation with Ad Hoc Microphone Arrays
Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
EUSIPCO | August 2021
DialSumm: A Real-Life Scenario Dialogue Summarization Dataset
Yulong Chen, Yang Liu, Liang Chen, Yue Zhang
The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
Fusing Context Into Knowledge Graph for Commonsense Reasoning
Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang
The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
One-Shot Voice Conversion with Speaker-Agnostic StarGAN
Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr
INTERSPEECH 2022 | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
Retrieval Enhanced Model for Commonsense Generation
Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng
ACL-IJCNLP 2021 | August 2021
Want To Reduce Labeling Cost? GPT-3 Can Help
Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
Conference on Empirical Methods in Natural Language Processing | August 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
Enhancing Factual Consistency of Abstractive Summarization
Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
Yu-An Chung, Chenguang Zhu, Michael Zeng
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
ICASSP 2021 | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
ICASSP 2021 | June 2021
Speech-language Pre-training for End-to-end Spoken Language Understanding
Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng
ICASSP 2021 | June 2021
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
Noisy Self-Knowledge Distillation for Text Summarization
Yang Liu, Sheng Shen, Mirella Lapata
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
Filtered Inner Product Projection for Crosslingual Embedding Alignment
Vin Sachidananda, Ziyi Yang, Chenguang Zhu
International Conference on Learning Representations (ICLR) | May 2021
Sentence-Permuted Paragraph Generation
Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization
Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng
NAACL | March 2021
MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval
Mark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T. Freeman
NeurIPS 2020 Competition and Demonstration Track | February 2021
Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
SLT 2021 | January 2021
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
SLT 2021 | January 2021
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
SLT 2021 | January 2021
Dual-Path RNN For Long Recording Speech Separation
Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Boeddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
Spoken Language Technology Workshop | January 2021
-
Large-Scale Intelligent Microservices
Mark Hamilton, Nick Gonsalves, Christina Lee, Anand Raman, Brendan Walsh, Siddhartha Prasad, Dalitso Banda, Lucy Zhang, Lei Zhang, William T. Freeman
IEEE Big Data | December 2020
A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining
Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
Interspeech 2020 | October 2020
Serialized Output Training for End-to-End Overlapped Speech Recognition
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
Interspeech 2020 | October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
A Survey of Knowledge-Enhanced Text Generation
Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang
arXiv 2010.04389 | October 2020
An End-to-end Architecture of Online Multi-channel Speech Separation
Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
Interspeech | October 2020
Neural Speech Separation Using Spatially Distributed Microphones
Dongmei Wang, Zhuo Chen, Takuya Yoshioka
Interspeech | October 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization
Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang
The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
Meta Dialogue Policy Learning
Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng
arxiv 2006.02588 | June 2020
Combining Acoustics, Content and Interaction Features to Find Hot Spots in Meetings
Dave Makhervaks, William Hinthorn, Dimitrios Dimitriadis, Andreas Stolcke
2020 International Conference on Acoustics, Speech, and Signal Processing | May 2020
Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
Chenguang Zhu
SIGDial 2020 | May 2020
CHiME-6 Challenge: Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Shinji Watanabe, Michael Mandel, Jon Barker, Emmanuel Vincent, Ashish Arora, Xuankai Chang, Sanjeev Khudanpur, Vimal Manohar, Daniel Povey, Desh Raj, David Snyder, Aswin Shanmugam Subramanian, Jan Trmal, Bar Ben Yair, Christoph Boeddeker, Zhaoheng Ni, Yusuke Fujita, Shota Horiguchi, Naoyuki Kanda, Takuya Yoshioka, Neville Ryant
arXiv:2004.09249 | April 2020
Continuous speech separation: dataset and analysis
Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
ICASSP | April 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.
Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
2020 Empirical Methods in Natural Language Processing | March 2020
A Memory Augmented Architecture for Continuous Speaker Identification in Meetings
Nikolaos Flemotomos, Dimitrios Dimitriadis
ICASSP 2020 | January 2020
-
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
DOVER: A Method for Combining Diarization Outputs
Andreas Stolcke, Takuya Yoshioka
ASRU 2019 | December 2019
Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization
Beliz Gunel, Chenguang Zhu, Michael Zeng, Xuedong Huang
NeurIPS 2019, Knowledge Representation & Reasoning Meets Machine Learning(KR2ML) Workshop | December 2019
Make Lead Bias in Your Favor: A Simple and Effective Method for News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
arXiv 1912.11602 | December 2019
Speech Separation Using Speaker Inventory
Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
Automatic Speech Recognition and Understanding Workshop | November 2019
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
Chenguang Zhu, Michael Zeng, Xuedong Huang
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
Parameter-free Sentence Embedding via Orthogonal Basis
Ziyi Yang, Chenguang Zhu, Weizhu Chen
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation
Yi Luo, Zhuo Chen, Nima Mesgarani, Takuya Yoshioka
October 2019
Dual-Path RNN: Efficient Long Sequence Modeling for Time-Domain Single-Channel Speech Separation
Yi Luo, Zhuo Chen, Takuya Yoshioka
October 2019
Meeting Transcription Using Asynchronous Distant Microphones
Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang
Interspeech | September 2019
Enhancements for Audio-only Diarization Systems
Dimitrios Dimitriadis
September 2019
SIM: A Slot-Independent Neural Model for Dialogue State Tracking
Chenguang Zhu, Michael Zeng, Xuedong Huang
The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
Embedding Imputation with Grounded Language Information
Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
Meeting Transcription Using Virtual Microphone Arrays
Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng
MSR-TR-2019-11 | July 2019
Published by Microsoft
Revised version
Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
Acoustic and Lexical Sentiment Analysis for Customer Service Calls
Bryan Li, Dimitrios Dimitriadis, Andreas Stolcke
ICASSP | May 2019
Single-Channel Speech Extraction Using Speaker Inventory and Attention Network
Xiong Xiao, Zhuo Chen, Takuya Yoshioka, Hakan Erdogan, Changliang Liu, Dimitrios Dimitriadis, Jasha Droppo, Yifan Gong
ICASSP 2019 | April 2019
Low-Latency Speaker-Independent Continuous Speech Separation
Takuya Yoshioka, Zhuo Chen, Changliang Liu, Xiong Xiao, Hakan Erdogan, Dimitrios Dimitriadis
ICASSP 2019 | April 2019
-
Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
SLT 2018 | December 2018
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
Session-level Language Modeling for Conversational Speech
Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke
Proceedings EMNLP | November 2018
Investigations on Data Augmentation and Loss Functions for Deep Learning Based Speech-Background Separation
Hakan Erdogan, Takuya Yoshioka
Interspeech 2018 | September 2018
Recognizing Overlapped Speech in Meetings: A Multichannel Separation Approach Using Neural Networks
Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, Xiong Xiao, Fil Alleva
Interspeech 2018 | September 2018
Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
ICASSP 2018 | April 2018
Exploring Practical Aspects of Neural Mask-Based Beamforming for Far-Field Speech Recognition
Christoph Boeddeker, Hakan Erdogan, Takuya Yoshioka, Reinhold Haeb-Umbach
ICASSP 2018 | April 2018
Multi-Microphone Neural Speech Separation for Far-Field Multi-Talker Speech Recognition
Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, Fil Alleva
ICASSP 2018 | April 2018
The Microsoft 2017 Conversational Speech Recognition System
Wayne Xiong, Lingfeng Wu, Jasha Droppo, Xuedong Huang, Andreas Stolcke
Proc. IEEE ICASSP | April 2018
Mispronunciation Detection in Children’s Reading of Sentences
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2018, Vol 26: pp. 1203-1215
-
Cracking the cocktail party problem by multi-beam deep attractor network
Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
ASRU 2018 | December 2017
Automatic Evaluation of Reading Aloud Performance in Children
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
Speech Communication | November 2017, Vol 94: pp. 1-14
Toward Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2017, Vol 25: pp. 2410-2423
Automatic Evaluation of Children Reading Aloud on Sentences and Pseudowords
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
Proc. Interspeech | August 2017
Comparing Human and Machine Errors in Conversational Speech Transcription
Andreas Stolcke, Jasha Droppo
Proc. Interspeech | August 2017
Multichannel Speech Enhancement Approaches to DNN-Based Far-Field Speech Recognition
Marc Delcroix, Takuya Yoshioka, Nobutaka Ito, Atsunori Ogawa, Keisuke Kinoshita, Masakiyo Fujimoto, Takuya Higuchi, Shoko Araki, Tomohiro Nakatani
New Era for Robust Speech Recognition | Published by Springer | 2017
The REVERB Challenge: A Benchmark Task for Reverberation-Robust ASR Techniques
Keisuke Kinoshita, Marc Delcroix, Sharon Gannot, Emanuël A. P. Habets, Reinhold Haeb-Umbach, Walter Kellermann, Volker Leutnant, Roland Maas, Tomohiro Nakatani, Bhiksha Raj, Armin Sehr, Takuya Yoshioka
New Era for Robust Speech Recognition | Published by Springer | 2017
Advances in All-Neural Speech Recognition
Geoffrey Zweig, Chengzhu Yu, Jasha Droppo, Andreas Stolcke
Proc. IEEE ICASSP | March 2017
The Microsoft 2016 Conversational Speech Recognition System
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
Proc. IEEE ICASSP | March 2017
Online Meeting Recognition in Noisy Environments with Time-Frequency Mask Based MVDR Beamforming
Shoko Araki, Nobutaka Ito, Marc Delcroix, Atsunori Ogawa, Keisuke Kinoshita, Takuya Higuchi, Takuya Yoshioka, Dong Tran, Shigeki Karita, Tomohiro Nakatani
HSCMA 2017 | March 2017
Online MVDR Beamformer Based on Complex Gaussian Mixture Model With Spatial Prior for Noise Robust ASR
Takuya Higuchi, Nobutaka Ito, Shoko Araki, Takuya Yoshioka, Marc Delcroix, Tomohiro Nakatani
IEEE/ACM Transactions on Audio, Speech, and Language Processing | February 2017, Vol 25: pp. 780-793
-
Achieving Human Parity in Conversational Speech Recognition
Geoff Zweig, Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu
December 2016
IEEE Spoken Language Technology Workshop
Invited talk, IEEE SLT Workshop
A Comparative Study of Recurrent Neural Network Models for Lexical Domain Classification
Suman Ravuri, Andreas Stolcke
Proc. IEEE ICASSP | March 2016
Proc. IEEE ICASSP
Robust and Efficient Multiple Alignment of Unsynchronized Meeting Recordings
T. J. Tsai, Andreas Stolcke
IEEE Transactions on Speech, Audio and Language Processing | February 2016, Vol 24: pp. 833-845
-
A Comparative Study of Neural Network Models for Lexical Intent Classification
Suman Ravuri, Andreas Stolcke
Proc. IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Deep Bi-directional Recurrent Networks Over Spectral Windows
Abdelrahman Mohamed, Frank Seide, Dong Yu, Jasha Droppo, Andreas Stolcke, Geoffrey Zweig, Gerald Penn
Proc. IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
A Comparison of Neural Network Feature Transforms for Speaker Diarization
Sree Harsha Yella, Andreas Stolcke
Proc. Interspeech | September 2015
Personalization of Word-Phrase-Entity Language Models
Michael Levit, Andreas Stolcke, R. Subba, Sarangarajan Parthasarathy, Shawn Chang, S. Xie, T. Anastasakos, B. Dumoulin
Proc. Interspeech | September 2015
Recurrent Neural Network and LSTM Models for Lexical Utterance Classification
Suman Ravuri, Andreas Stolcke
Proc. Interspeech | September 2015
A Study of Multimodal Addressee Detection in Human-Human-Computer Interaction
T. J. Tsai, Andreas Stolcke, Malcolm Slaney
IEEE Transactions on Multimedia | July 2015, Vol 17: pp. 1550-1561
Multimodal Addressee Detection in Multiparty Dialogue Systems
T. J. Tsai, Andreas Stolcke, Malcolm Slaney
Proc. IEEE ICASSP | April 2015
Proc. IEEE ICASSP
Publications by Research Area
-
MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering
Mahmoud Khademi, Ziyi Yang, Felipe Vieira Frujeri, Chenguang Zhu
2023 Empirical Methods in Natural Language Processing | December 2023
Unifying Vision, Text, and Layout for Universal Document Processing
Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization
Dongmei Wang, Xiong Xiao, Naoyuki Kanda, Takuya Yoshioka, Jian Wu
ICASSP 2023 | June 2023
In-Context Demonstration Selection with Cross Entropy Difference
Dan Iter, Reid Pryzant, Ruochen Xu, Shuohang Wang, Yang Liu, Chenguang Zhu
May 2023
Arxiv
PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
May 2023
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
LMGQS: A Large-scale Dataset for Query-focused Summarization
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
May 2023
InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT
Yichong Xu, Ruochen Xu, Dan Iter, Yang Liu, Shuohang Wang, Chenguang Zhu, Michael Zeng
May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
Chaojun Wang, Yang Liu, Wai Lam
ACL 2023 Findings | May 2023
Prompting GPT-3 To Be Reliable
Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
International Conference on Learning Representations (ICLR 23) | May 2023
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
AAAI 2023 | February 2023
Narrate Dialogues for Better Summarization
Ruochen Xu, Chenguang Zhu, Michael Zeng
2022 Empirical Methods in Natural Language Processing | December 2022
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
2022 Empirical Methods in Natural Language Processing | December 2022
Best Paper Award at SoCal NLP Symposium 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
December 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix
Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
EMNLP 2022 | December 2022
Automatic Rule Induction for Efficient Semi-Supervised Learning
Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Unsupervised Summarization with Customized Granularities
Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
arXiv:2211.05564 | November 2022
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Real-Time Target Sound Extraction
Bandhav Veluri, Justin Chan, Malek Itani, Tuochao Chen, Takuya Yoshioka, Shyamnath Gollakota
arXiv:2211.02250 | November 2022
Breaking trade-offs in speech separation with sparsely-gated mixture of experts
Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
arXiv:2211.06493 | November 2022
Simulating realistic speech overlaps improves multi-talker ASR
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2210.15715 | October 2022
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2209.04974 | September 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
CLIP-Event: Connecting Text and Images with Event Structures
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
One Model to Enhance Them All: Array Geometry Agnostic Multi-Channel Personalized Speech Enhancement
Hassan Taherian, Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
Personalized Speech Enhancement: New Models and Comprehensive Evaluation
Sefik Emre Eskimez, Takuya Yoshioka, Huaming Wang, Xiaofei Wang, Zhuo Chen, Xuedong Huang
ICASSP 2022 | May 2022
End-to-End Segmentation-based News Summarization
Yang Liu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
ACL 2022 | May 2022
Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ICASSP 2022 | May 2022
A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ASRU 2021 | December 2021
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
December 2021
The Elastic Lottery Ticket Hypothesis
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
A Review of Speaker Diarization: Recent Advances with Deep Learning
Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan
Computer Speech & Language | November 2021, Vol 72
Human Listening and Live Captioning: Multi-Task Training for Speech Enhancement
Sefik Emre Eskimez, Xiaofei Wang, Min Tang, Hemin Yang, Zirun Zhu, Zhuo Chen, Huaming Wang, Takuya Yoshioka
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
End-to-End Speaker-Attributed ASR with Transformer
Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Universal Sentence Representations Learning with Conditional Masked Language Model
Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
EMNLP 2021 | August 2021
Want To Reduce Labeling Cost? GPT-3 Can Help
Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
Conference on Empirical Methods in Natural Language Processing | August 2021
One-Shot Voice Conversion with Speaker-Agnostic StarGAN
Sefik Emre Eskimez, Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr
INTERSPEECH 2022 | August 2021
Continuous Speech Separation with Ad Hoc Microphone Arrays
Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
EUSIPCO | August 2021
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
ACL-IJCNLP 2021 | August 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
Speech-language Pre-training for End-to-end Spoken Language Understanding
Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng
ICASSP 2021 | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
ICASSP 2021 | June 2021
Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval
Mark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T. Freeman
NeurIPS 2020 Competition and Demonstration Track | February 2021
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
SLT 2021 | January 2021
Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
SLT 2021 | January 2021
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
SLT 2021 | January 2021
Large-Scale Intelligent Microservices
Mark Hamilton, Nick Gonsalves, Christina Lee, Anand Raman, Brendan Walsh, Siddhartha Prasad, Dalitso Banda, Lucy Zhang, Lei Zhang, William T. Freeman
IEEE Big Data | December 2020
Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
Interspeech 2020 | October 2020
Serialized Output Training for End-to-End Overlapped Speech Recognition
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
Interspeech 2020 | October 2020
Sequence-level self-learning with multi-task learning framework
Kenichi Kumatani, Dimitrios Dimitriadis, Yashesh Gaur, Robert Gmyr, Sefik Emre Eskimez, Jinyu Li, Michael Zeng
October 2020
GAN-based Data Generation for Speech Emotion Recognition
Sefik Emre Eskimez, Dimitrios Dimitriadis, Robert Gmyr, Kenichi Kumatani
INTERSPEECH 2020 | October 2020
Neural Speech Separation Using Spatially Distributed Microphones
Dongmei Wang, Zhuo Chen, Takuya Yoshioka
Interspeech | October 2020
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Federated Transfer Learning with Dynamic Gradient Aggregation
Dimitrios Dimitriadis, Kenichi Kumatani, Robert Gmyr, Yashesh Gaur, Sefik Emre Eskimez
August 2020
Combining Acoustics, Content and Interaction Features to Find Hot Spots in Meetings
Dave Makhervaks, William Hinthorn, Dimitrios Dimitriadis, Andreas Stolcke
2020 International Conference on Acoustics, Speech, and Signal Processing | May 2020
CHiME-6 Challenge: Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Shinji Watanabe, Michael Mandel, Jon Barker, Emmanuel Vincent, Ashish Arora, Xuankai Chang, Sanjeev Khudanpur, Vimal Manohar, Daniel Povey, Desh Raj, David Snyder, Aswin Shanmugam Subramanian, Jan Trmal, Bar Ben Yair, Christoph Boeddeker, Zhaoheng Ni, Yusuke Fujita, Shota Horiguchi, Naoyuki Kanda, Takuya Yoshioka, Neville Ryant
arXiv:2004.09249 | April 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.
Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
2020 Empirical Methods in Natural Language Processing | March 2020
A Memory Augmented Architecture for Continuous Speaker Identification in Meetings
Nikolaos Flemotomos, Dimitrios Dimitriadis
ICASSP 2020 | January 2020
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
DOVER: A Method for Combining Diarization Outputs
Andreas Stolcke, Takuya Yoshioka
ASRU 2019 | December 2019
Speech Separation Using Speaker Inventory
Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
Automatic Speech Recognition and Understanding Workshop | November 2019
Parameter-free Sentence Embedding via Orthogonal Basis
Ziyi Yang, Chenguang Zhu, Weizhu Chen
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
Chenguang Zhu, Michael Zeng, Xuedong Huang
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation
Yi Luo, Zhuo Chen, Nima Mesgarani, Takuya Yoshioka
October 2019
Dual-Path RNN: Efficient Long Sequence Modeling for Time-Domain Single-Channel Speech Separation
Yi Luo, Zhuo Chen, Takuya Yoshioka
October 2019
Enhancements for Audio-only Diarization Systems
Dimitrios Dimitriadis
September 2019
SIM: A Slot-Independent Neural Model for Dialogue State Tracking
Chenguang Zhu, Michael Zeng, Xuedong Huang
The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
Embedding Imputation with Grounded Language Information
Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
Meeting Transcription Using Virtual Microphone Arrays
Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng
MSR-TR-2019-11 | July 2019
Published by Microsoft
Revised version
Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
Single-Channel Speech Extraction Using Speaker Inventory and Attention Network
Xiong Xiao, Zhuo Chen, Takuya Yoshioka, Hakan Erdogan, Changliang Liu, Dimitrios Dimitriadis, Jasha Droppo, Yifan Gong
ICASSP 2019 | April 2019
Low-Latency Speaker-Independent Continuous Speech Separation
Takuya Yoshioka, Zhuo Chen, Changliang Liu, Xiong Xiao, Hakan Erdogan, Dimitrios Dimitriadis
ICASSP 2019 | April 2019
Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
SLT 2018 | December 2018
-
MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering
Mahmoud Khademi, Ziyi Yang, Felipe Vieira Frujeri, Chenguang Zhu
2023 Empirical Methods in Natural Language Processing | December 2023
Unifying Vision, Text, and Layout for Universal Document Processing
Zineng Tang, Ziyi Yang, Guoxin Wang, Yuwei Fang, Yang Liu, Chenguang Zhu, Michael Zeng, Cha Zhang, Mohit Bansal
The IEEE / CVF Computer Vision and Pattern Recognition Conference | June 2023
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
AAAI 2023 | February 2023
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
CLIP-Event: Connecting Text and Images with Event Structures
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
December 2021
The Elastic Lottery Ticket Hypothesis
Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Jingjing Liu, Zhangyang Wang
35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
MosAIc: Finding Artistic Connections across Culture with Conditional Image Retrieval
Mark Hamilton, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, Chris Hoder, William T. Freeman
NeurIPS 2020 Competition and Demonstration Track | February 2021
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
ECCV | August 2020
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
-
MM-Reasoner: A Multi-Modal Knowledge-Aware Framework for Knowledge-Based Visual Question Answering
Mahmoud Khademi, Ziyi Yang, Felipe Vieira Frujeri, Chenguang Zhu
2023 Empirical Methods in Natural Language Processing | December 2023
Global Selection of Contrastive Batches via Optimization on Sample Permutations
Vin Sachidananda, Ziyi Yang, Chenguang Zhu
ICML 2023 | July 2023
Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles
Shuquan Ye, Yujia Xie, Dongdong Chen, Yichong Xu, Lu Yuan, Chenguang Zhu, Jing Liao
The IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) 2023 | June 2023
Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization
Dongmei Wang, Xiong Xiao, Naoyuki Kanda, Takuya Yoshioka, Jian Wu
ICASSP 2023 | June 2023
PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents
Simeng Sun, Yang Liu, Shuohang Wang, Chenguang Zhu, Mohit Iyyer
May 2023
Small Models are Valuable Plug-ins for Large Language Models
Canwen Xu, Yichong Xu, Shuohang Wang, Yang Liu, Chenguang Zhu, Julian McAuley
May 2023
LMGQS: A Large-scale Dataset for Query-focused Summarization
Ruochen Xu, Song Wang, Yang Liu, Shuohang Wang, Yichong Xu, Dan Iter, Chenguang Zhu, Michael Zeng
May 2023
Progressive Translation: Improving Domain Robustness of Neural Machine Translation with Intermediate Sequences
Chaojun Wang, Yang Liu, Wai Lam
ACL 2023 Findings | May 2023
Prompting GPT-3 To Be Reliable
Silei Cheng, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan Boyd-Graber, Lijuan Wang
International Conference on Learning Representations (ICLR 23) | May 2023
Generate rather than Retrieve: Large Language Models are Strong Context Generators
Wenhao Yu, Dan Iter, Shuohang Wang, Yichong Xu, Mingxuan Ju, Soumya Sanyal, Chenguang Zhu, Michael Zeng, Meng Jiang
ICLR 2023 | May 2023
G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, Chenguang Zhu
arXiv 2303.16634 | March 2023
MACSum: Controllable Summarization with Mixed Attributes
Yusen Zhang, Yang Liu, Ziyi Yang, Yuwei Fang, Yulong Chen, Dragomir Radev, Chenguang Zhu, Michael Zeng, Rui Zhang
Transactions of the Association for Computational Linguistics | March 2023
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
AAAI 2023 | February 2023
ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation
Shuohang Wang, Ruochen Xu, Yang Liu, Chenguang Zhu, Michael Zeng
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing | December 2022
Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering
Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
2022 Empirical Methods in Natural Language Processing | December 2022
Best Paper Award at SoCal NLP Symposium 2022
Retrieval Augmentation for Commonsense Reasoning: A Unified Approach
Wenhao Yu, Chenguang Zhu, Zhihan Zhang, Shuohang Wang, Zhuosheng Zhang, Yuwei Fang, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training
Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu
December 2022
Task Compass: Scaling Multi-task Pre-training with Task Prefix
Zhuosheng Zhang, Shuohang Wang, Yichong Xu, Yuwei Fang, Wenhao Yu, Yang Liu, Hai Zhao, Chenguang Zhu, Michael Zeng
EMNLP 2022 | December 2022
Towards A Unified Multi-Dimensional Evaluator For Text Generation
Ming Zhong, Yang Liu, Da Yin, Yuning Mao, Yizhu Jiao, Pengfei Liu, Chenguang Zhu, Heng Ji, Jiawei Han
Empirical Methods in Natural Language Processing (EMNLP) 2022 | December 2022
A Unified Encoder-Decoder Framework with Entity Memory
Zhihan Zhang, Wenhao Yu, Chenguang Zhu, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Leveraging Locality in Abstractive Text Summarization
Yixin Liu, Ansong Ni, Linyong Nan, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
EMNLP 2022 | December 2022
Automatic Rule Induction for Efficient Semi-Supervised Learning
Reid Pryzant, Ziyi Yang, Yichong Xu, Chenguang Zhu, Michael Zeng
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022 | December 2022
Unsupervised Summarization with Customized Granularities
Ming Zhong, Yang Liu, Yuning Mao, Yichong Xu, Suyu Ge, Yizhu Jiao, Xingxing Zhang, Chenguang Zhu, Michael Zeng, Jiawei Han
Findings of Empirical Methods in Natural Language Processing (EMNLP), Abu Dhabi, the United Arab Emirates, 2022. | December 2022
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
Conference on Neural Information Processing Systems (NeurIPS) 2022 | November 2022
Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
arXiv:2211.05564 | November 2022
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Breaking trade-offs in speech separation with sparsely-gated mixture of experts
Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
arXiv:2211.06493 | November 2022
Simulating realistic speech overlaps improves multi-talker ASR
Muqiao Yang, Naoyuki Kanda, Xiaofei Wang, Jian Wu, Sunit Sivasankaran, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2210.15715 | October 2022
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Wangyou Zhang, Zhuo Chen, Naoyuki Kanda, Shujie Liu, Jinyu Li, Sefik Emre Eskimez, Takuya Yoshioka, Xiong Xiao, Zhong Meng, Yanmin Qian, Furu Wei
Interspeech 2022 | September 2022
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao, Zhong Meng, Xiaofei Wang, Yashesh Gaur, Zhuo Chen, Jinyu Li, Takuya Yoshioka
Interspeech 2022 | September 2022
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li, Xie Chen, Yu Wu, Yifan Gong
Interspeech 2022 | September 2022
VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
Naoyuki Kanda, Jian Wu, Xiaofei Wang, Zhuo Chen, Jinyu Li, Takuya Yoshioka
arXiv:2209.04974 | September 2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Xiaofei Wang, Dongmei Wang, Naoyuki Kanda, Sefik Emre Eskimez, Takuya Yoshioka
INTERSPEECH 2022 | September 2022
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Chengyi Wang, Zhengyang Chen, Yu Wu, Shujie Liu, Zhuo Chen, Jinyu Li, Naoyuki Kanda, Takuya Yoshioka, Xiong Xiao, Jian Wu, Long Zhou, Shuo Ren, Yanmin Qian, Yao Qian, Jian Wu, Michael Zeng, Xiangzhan Yu, Furu Wei
IEEE Journal of Selected Topics in Signal Processing | July 2022, Vol 16(6): pp. 1505-1518
Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
IJCAI 2022 | July 2022
human parity result on CommonsenseQA
CLIP-Event: Connecting Text and Images with Event Structures
Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang
Conference on Computer Vision and Pattern Recognition (CVPR), 2022. | June 2022
An Empirical Study of Training End-to-End Vision-and-Language Transformers
Zi-Yi Dou, Yichong Xu, Zhe Gan, Jianfeng Wang, Shuohang Wang (shuowa), Lijuan Wang (lijuanw), Chenguang Zhu, Nanyun (Violet) Peng, Zicheng Liu, Michael Zeng
CVPR | June 2022
Diversifying Content Generation for Commonsense Reasoning with Mixture of Knowledge Graph Experts
Wenhao Yu, Chenguang Zhu, Lianhui Qin, Zhihan Zhang, Tong Zhao, Meng Jiang
ACL 2022 | May 2022
End-to-End Segmentation-based News Summarization
Yang Liu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer
Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren
ACL 2022 | May 2022
Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data
Shuohang Wang, Yichong Xu, Yuwei Fang, Yang Liu, Siqi Sun, Ruochen Xu, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang, Chengyi Wang, Shujie Liu, Takuya Yoshioka, Jinyu Li, DeLiang Wang
ICASSP 2022 | May 2022
Continuous Speech Separation with Recurrent Selective Attention Network
Yixuan Zhang, Zhuo Chen, Jian Wu, Takuya Yoshioka, Peidong Wang, Zhong Meng, Jinyu Li
ICASSP 2021 | May 2022
PickNet: Real-Time Channel Selection for Ad Hoc Microphone Arrays
Takuya Yoshioka, Xiaofei Wang, Dongmei Wang
ICASSP 2022 | May 2022
Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents
Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed Awadallah, Dragomir Radev, Rui Zhang
ACL 2022 | May 2022
DYLE: Dynamic Latent Extraction for Abstractive Long-Input Summarization
Ziming Mao, Chen Henry Wu, Ansong Ni, Yushen Zhang, Rui Zhang, Tao Yu, Budhaditya Deb, Chenguang Zhu, Ahmed Awadallah, Dragomir Radev
ACL 2022 | May 2022
Leveraging Knowledge in Multilingual Commonsense Reasoning
Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng
ACL 2022 | May 2022
VarArray: Array-Geometry-Agnostic Continuous Speech Separation
Takuya Yoshioka, Xiaofei Wang, Dongmei Wang, Min Tang, Zirun Zhu, Zhuo Chen, Naoyuki Kanda
ICASSP 2022 | May 2022
All-Neural Beamformer for Continuous Speech Separation
Zhuohuang Zhang, Takuya Yoshioka, Naoyuki Kanda, Zhuo Chen, Xiaofei Wang, Dongmei Wang, Sefik Emre Eskimez
ICASSP 2022 | May 2022
DICT-BERT: Enhancing Language Model Pre-Training with Dictionary
Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang
ACL 2022 | May 2022
KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering
Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang, Michael Zeng
ACL 2022 | May 2022
Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Xiong Xiao, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ICASSP 2022 | May 2022
DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization
Ming Zhong, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
AAAI 2022 | February 2022
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding
Donghan Yu, Chenguang Zhu, Yiming Yang, Michael Zeng
AAAI 2022 | February 2022
A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
Naoyuki Kanda, Xiong Xiao, Jian Wu, Tianyan Zhou, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
ASRU 2021 | December 2021
MLP Architectures for Vision-and-Language Modeling: An Empirical Study
Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang
December 2021
A Review of Speaker Diarization: Recent Advances with Deep Learning
Tae Jin Park, Naoyuki Kanda, Dimitrios Dimitriadis, Kyu J. Han, Shinji Watanabe, Shrikanth Narayanan
Computer Speech & Language | November 2021, Vol 72
An Exploratory Study on Long Dialogue Summarization: What Works and What’s Next
Yusen Zhang, Ansong Ni, Tao Yu, Rui Zhang, Chenguang Zhu, Budhaditya Deb, Asli Celikyilmaz, Ahmed Awadallah, Dragomir Radev
Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
Injecting Entity Types into Entity-Guided Text Generation
Xiangyu Dong, Wenhao Yu, Chenguang Zhu, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2021 | November 2021
Does Knowledge Help General NLU? An Empirical Study
Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng
arXiv: Computation and Language | September 2021
Accelerating Real-Time Question Answering via Question Generation
Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu, Chenguang Zhu
arXiv: Computation and Language | September 2021
Data Augmentation for Spoken Language Understanding via Pretrained Models
Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
INTERSPEECH | September 2021
Investigation of Practical Aspects of Single Channel Speech Separation for ASR
Jian Wu, Zhuo Chen, Sanyuan Chen, Yu Wu, Takuya Yoshioka, Naoyuki Kanda, Shujie Liu, Jinyu Li
Interspeech 2021 | August 2021
Ultra Fast Speech Separation Model with Teacher Student Learning
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
Interspeech 2021 | August 2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
End-to-End Speaker-Attributed ASR with Transformer
Naoyuki Kanda, Guoli Ye, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
Naoyuki Kanda, Guoli Ye, Yu Wu, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
Interspeech 2021 | August 2021
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Liang Lu, Zhong Meng, Naoyuki Kanda, Jinyu Li, Yifan Gong
Interspeech 2021 | August 2021
Universal Sentence Representations Learning with Conditional Masked Language Model
Ziyi Yang, Yinfei Yang, Daniel Cer, Jax Law, Eric Darve
EMNLP 2021 | August 2021
Want To Reduce Labeling Cost? GPT-3 Can Help
Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng
Conference on Empirical Methods in Natural Language Processing | August 2021
Continuous Speech Separation with Ad Hoc Microphone Arrays
Dongmei Wang, Takuya Yoshioka, Zhuo Chen, Xiaofei Wang, Tianyan Zhou, Zhong Meng
EUSIPCO | August 2021
DialSumm: A Real-Life Scenario Dialogue Summarization Dataset
Yulong Chen, Yang Liu, Liang Chen, Yue Zhang
The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
Retrieval Enhanced Model for Commonsense Generation
Han Wang, Yang Liu, Chenguang Zhu, Linjun Shou (寿林钧), Ming Gong (YIMING), Yichong Xu, Michael Zeng
ACL-IJCNLP 2021 | August 2021
Fusing Context Into Knowledge Graph for Commonsense Reasoning
Yichong Xu, Chenguang Zhu, Ruochen Xu, Yang Liu, Michael Zeng, Xuedong Huang
The 59th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
2021 International ACM SIGIR Conference on Research and Development in Information Retrieval | July 2021
Leveraging Lead Bias for Zero-shot Abstractive News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021. | July 2021
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
Yu-An Chung, Chenguang Zhu, Michael Zeng
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
Enhancing Factual Consistency of Abstractive Summarization
Chenguang Zhu, William Hinthorn, Ruochen Xu, Qingkai Zeng, Michael Zeng, Xuedong Huang, Meng Jiang
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
Speech-language Pre-training for End-to-end Spoken Language Understanding
Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng
ICASSP 2021 | June 2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
Xuankai Chang, Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
ICASSP 2021 | June 2021
Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
Naoyuki Kanda, Zhong Meng, Liang Lu, Yashesh Gaur, Xiaofei Wang, Zhuo Chen, Takuya Yoshioka
ICASSP 2021 | June 2021
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka, Sanyuan Chen, Yong Zhao, Gang Liu, Yu Wu, Jian Wu, Shujie Liu, Jinyu Li, Yifan Gong
ICASSP 2021 | June 2021
Continuous speech separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu, Jinyu Li, Takuya Yoshioka, Chengyi Wang, Shujie Liu, Ming Zhou
ICASSP | June 2021
Don’t shoot butterfly with rifles: multi-channel continuous speech separation with early exit transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li, Xiangzhan Yu
ICASSP | June 2021
Noisy Self-Knowledge Distillation for Text Summarization
Yang Liu, Sheng Shen, Mirella Lapata
North American Chapter of the Association for Computational Linguistics (NAACL) 2021 | June 2021
Filtered Inner Product Projection for Crosslingual Embedding Alignment
Vin Sachidananda, Ziyi Yang, Chenguang Zhu
International Conference on Learning Representations (ICLR) | May 2021
Sentence-Permuted Paragraph Generation
Wenhao Yu, Chenguang Zhu, Tong Zhao, Zhichun Guo, Meng Jiang
Empirical Methods in Natural Language Processing (EMNLP) 2021 | April 2021
Streaming end-to-end multi-talker speech recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
IEEE Signal Processing Letter | April 2021, Vol 28
MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization
Chenguang Zhu, Yang Liu, Jie Mei, Michael Zeng
NAACL | March 2021
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan, Zili Huang, Maokui He, Shinji Watanabe, Jun Du, Takuya Yoshioka, Yi Luo, Naoyuki Kanda, Jinyu Li, Scott Wisdom, John R. Hershey
SLT 2021 | January 2021
Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
Xiaofei Wang, Naoyuki Kanda, Yashesh Gaur, Zhuo Chen, Zhong Meng, Takuya Yoshioka
SLT 2021 | January 2021
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, Sarangarajan Parthasarathy, Eric Sun, Yashesh Gaur, Naoyuki Kanda, Liang Lu, Xie Chen, Rui Zhao, Jinyu Li, Yifan Gong
SLT 2021 | January 2021
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
Naoyuki Kanda, Xuankai Chang, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Takuya Yoshioka
SLT 2021 | January 2021
Dual-Path RNN For Long Recording Speech Separation
Chenda Li, Yi Luo, Cong Han, Jinyu Li, Takuya Yoshioka, Tianyan Zhou, Marc Delcroix, Keisuke Kinoshita, Christoph Boeddeker, Yanmin Qian, Shinji Watanabe, Zhuo Chen
Spoken Language Technology Workshop | January 2021
A Hierarchical Network for Abstractive Meeting Summarization with Cross-Domain Pretraining
Chenguang Zhu, Ruochen Xu, Michael Zeng, Xuedong Huang
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Few-shot Natural Language Generation for Task-Oriented Dialog
Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
Empirical Methods in Natural Language Processing (EMNLP) | November 2020
Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Zhuo Chen, Tianyan Zhou, Takuya Yoshioka
Interspeech 2020 | October 2020
Serialized Output Training for End-to-End Overlapped Speech Recognition
Naoyuki Kanda, Yashesh Gaur, Xiaofei Wang, Zhong Meng, Takuya Yoshioka
Interspeech 2020 | October 2020
Neural Speech Separation Using Spatially Distributed Microphones
Dongmei Wang, Zhuo Chen, Takuya Yoshioka
Interspeech | October 2020
An End-to-end Architecture of Online Multi-channel Speech Separation
Jian Wu, Zhuo Chen, Jinyu Li, Takuya Yoshioka, Zhili Tan, Ed Lin, Yi Luo , Lei Xie
Interspeech | October 2020
A Survey of Knowledge-Enhanced Text Generation
Wenhao Yu, Chenguang Zhu, Zaitang Li, Zhiting Hu, Qingyun Wang, Heng Ji, Meng Jiang
arXiv 2010.04389 | October 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization
Ruochen Xu, Chenguang Zhu, Yu Shi, Michael Zeng, Xuedong Huang
The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL 2020) | September 2020
Meta Dialogue Policy Learning
Yumo Xu, Chenguang Zhu, Baolin Peng, Michael Zeng
arxiv 2006.02588 | June 2020
Combining Acoustics, Content and Interaction Features to Find Hot Spots in Meetings
Dave Makhervaks, William Hinthorn, Dimitrios Dimitriadis, Andreas Stolcke
2020 International Conference on Acoustics, Speech, and Signal Processing | May 2020
Boosting Naturalness of Language in Task-oriented Dialogues via Adversarial Training
Chenguang Zhu
SIGDial 2020 | May 2020
CHiME-6 Challenge: Tackling Multispeaker Speech Recognition for Unsegmented Recordings
Shinji Watanabe, Michael Mandel, Jon Barker, Emmanuel Vincent, Ashish Arora, Xuankai Chang, Sanjeev Khudanpur, Vimal Manohar, Daniel Povey, Desh Raj, David Snyder, Aswin Shanmugam Subramanian, Jan Trmal, Bar Ben Yair, Christoph Boeddeker, Zhaoheng Ni, Yusuke Fujita, Shota Horiguchi, Naoyuki Kanda, Takuya Yoshioka, Neville Ryant
arXiv:2004.09249 | April 2020
Continuous speech separation: dataset and analysis
Zhuo Chen, Takuya Yoshioka, Liang Lu, Tianyan Zhou, Zhong Meng, Yi Luo, Jian Wu, Xiong Xiao, Jinyu Li
ICASSP | April 2020
TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising.
Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve
2020 Empirical Methods in Natural Language Processing | March 2020
Advances in Online Audio-Visual Meeting Transcription
Takuya Yoshioka, Igor Abramovski, Cem Aksoylar, Zhuo Chen, Moshe David, Dimitrios Dimitriadis, Yifan Gong, Ilya Gurvich, Xuedong Huang, Yan Huang, Aviv Hurvitz, Li Jiang, Sharon Koubi, Eyal Krupka, Ido Leichter, Changliang Liu, Sarangarajan Parthasarathy, Alon Vinnikov, Lingfeng Wu, Xiong Xiao, Wayne Xiong, Huaming Wang, Zhenghao (Hao) Wang, Jun Zhang, Yong Zhao, Tianyan Zhou
ASRU 2019 | December 2019
DOVER: A Method for Combining Diarization Outputs
Andreas Stolcke, Takuya Yoshioka
ASRU 2019 | December 2019
Mind The Facts: Knowledge-Boosted Coherent Abstractive Text Summarization
Beliz Gunel, Chenguang Zhu, Michael Zeng, Xuedong Huang
NeurIPS 2019, Knowledge Representation & Reasoning Meets Machine Learning(KR2ML) Workshop | December 2019
Make Lead Bias in Your Favor: A Simple and Effective Method for News Summarization
Chenguang Zhu, Ziyi Yang, Robert Gmyr, Michael Zeng, Xuedong Huang
arXiv 1912.11602 | December 2019
Speech Separation Using Speaker Inventory
Peidong Wang, Zhuo Chen, Xiong Xiao, Zhong Meng, Takuya Yoshioka, Tianyan Zhou, Liang Lu, Jinyu Li
Automatic Speech Recognition and Understanding Workshop | November 2019
Parameter-free Sentence Embedding via Orthogonal Basis
Ziyi Yang, Chenguang Zhu, Weizhu Chen
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
Multi-task Learning for Natural Language Generation in Task-Oriented Dialogue
Chenguang Zhu, Michael Zeng, Xuedong Huang
Empirical Methods in Natural Language Processing (EMNLP) | November 2019
End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separation
Yi Luo, Zhuo Chen, Nima Mesgarani, Takuya Yoshioka
October 2019
Dual-Path RNN: Efficient Long Sequence Modeling for Time-Domain Single-Channel Speech Separation
Yi Luo, Zhuo Chen, Takuya Yoshioka
October 2019
Meeting Transcription Using Asynchronous Distant Microphones
Takuya Yoshioka, Dimitrios Dimitriadis, Andreas Stolcke, William Hinthorn, Zhuo Chen, Michael Zeng, Xuedong Huang
Interspeech | September 2019
SIM: A Slot-Independent Neural Model for Dialogue State Tracking
Chenguang Zhu, Michael Zeng, Xuedong Huang
The 20th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2019) | September 2019
Embedding Imputation with Grounded Language Information
Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve
The 57th Annual Meeting of the Association for Computational Linguistics (ACL) | July 2019
Meeting Transcription Using Virtual Microphone Arrays
Takuya Yoshioka, Zhuo Chen, Dimitrios Dimitriadis, William Hinthorn, Xuedong Huang, Andreas Stolcke, Michael Zeng
MSR-TR-2019-11 | July 2019
Published by Microsoft
Revised version
Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
Jianmo Ni, Chenguang Zhu, Weizhu Chen, Julian McAuley
North American Chapter of the Association for Computational Linguistics (NAACL) 2019 | May 2019
Acoustic and Lexical Sentiment Analysis for Customer Service Calls
Bryan Li, Dimitrios Dimitriadis, Andreas Stolcke
ICASSP | May 2019
Single-Channel Speech Extraction Using Speaker Inventory and Attention Network
Xiong Xiao, Zhuo Chen, Takuya Yoshioka, Hakan Erdogan, Changliang Liu, Dimitrios Dimitriadis, Jasha Droppo, Yifan Gong
ICASSP 2019 | April 2019
Low-Latency Speaker-Independent Continuous Speech Separation
Takuya Yoshioka, Zhuo Chen, Changliang Liu, Xiong Xiao, Hakan Erdogan, Dimitrios Dimitriadis
ICASSP 2019 | April 2019
Multi-Channel Overlapped Speech Recognition with Location Guided Speech Extraction Network
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
SLT 2018 | December 2018
MULTI-CHANNEL OVERLAPPED SPEECH RECOGNITION WITH LOCATION GUIDED SPEECH EXTRACTION NETWORK
Zhuo Chen, Xiong Xiao, Takuya Yoshioka, Hakan Erdogan, Jinyu Li, Yifan Gong
Spoken Language Technology | December 2018
Session-level Language Modeling for Conversational Speech
Wayne Xiong, Lingfeng Wu, Jun Zhang, Andreas Stolcke
Proceedings EMNLP | November 2018
Investigations on Data Augmentation and Loss Functions for Deep Learning Based Speech-Background Separation
Hakan Erdogan, Takuya Yoshioka
Interspeech 2018 | September 2018
Recognizing Overlapped Speech in Meetings: A Multichannel Separation Approach Using Neural Networks
Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, Xiong Xiao, Fil Alleva
Interspeech 2018 | September 2018
Efficient Integration of Fixed Beamformers and Speech Separation Networks for Multi-Channel Far-Field Speech Separation
Zhuo Chen, Takuya Yoshioka, Xiong Xiao, Jinyu Li, Michael L. Seltzer, Yifan Gong
ICASSP 2018 | April 2018
Exploring Practical Aspects of Neural Mask-Based Beamforming for Far-Field Speech Recognition
Christoph Boeddeker, Hakan Erdogan, Takuya Yoshioka, Reinhold Haeb-Umbach
ICASSP 2018 | April 2018
Multi-Microphone Neural Speech Separation for Far-Field Multi-Talker Speech Recognition
Takuya Yoshioka, Hakan Erdogan, Zhuo Chen, Fil Alleva
ICASSP 2018 | April 2018
The Microsoft 2017 Conversational Speech Recognition System
Wayne Xiong, Lingfeng Wu, Jasha Droppo, Xuedong Huang, Andreas Stolcke
Proc. IEEE ICASSP | April 2018
Mispronunciation Detection in Children’s Reading of Sentences
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2018, Vol 26: pp. 1203-1215
Cracking the cocktail party problem by multi-beam deep attractor network
Zhuo Chen, Jinyu Li, Xiong Xiao, Takuya Yoshioka, Huaming Wang, Zhenghao Wang, Yifan Gong
ASRU 2018 | December 2017
Automatic Evaluation of Reading Aloud Performance in Children
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
Speech Communication | November 2017, Vol 94: pp. 1-14
Toward Human Parity in Conversational Speech Recognition
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
IEEE/ACM Transactions on Audio, Speech, and Language Processing | September 2017, Vol 25: pp. 2410-2423
Automatic Evaluation of Children Reading Aloud on Sentences and Pseudowords
Jorge Proença, Carla Lopes, Michael Tjalve, Andreas Stolcke, Sara Candeias, Fernando Perdigão
Proc. Interspeech | August 2017
Comparing Human and Machine Errors in Conversational Speech Transcription
Andreas Stolcke, Jasha Droppo
Proc. Interspeech | August 2017
Multichannel Speech Enhancement Approaches to DNN-Based Far-Field Speech Recognition
Marc Delcroix, Takuya Yoshioka, Nobutaka Ito, Atsunori Ogawa, Keisuke Kinoshita, Masakiyo Fujimoto, Takuya Higuchi, Shoko Araki, Tomohiro Nakatani
New Era for Robust Speech Recognition | Published by Springer | 2017
The REVERB Challenge: A Benchmark Task for Reverberation-Robust ASR Techniques
Keisuke Kinoshita, Marc Delcroix, Sharon Gannot, Emanuël A. P. Habets, Reinhold Haeb-Umbach, Walter Kellermann, Volker Leutnant, Roland Maas, Tomohiro Nakatani, Bhiksha Raj, Armin Sehr, Takuya Yoshioka
New Era for Robust Speech Recognition | Published by Springer | 2017
The Microsoft 2016 Conversational Speech Recognition System
Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu, Geoffrey Zweig
Proc. IEEE ICASSP | March 2017
Advances in All-Neural Speech Recognition
Geoffrey Zweig, Chengzhu Yu, Jasha Droppo, Andreas Stolcke
Proc. IEEE ICASSP | March 2017
Online Meeting Recognition in Noisy Environments with Time-Frequency Mask Based MVDR Beamforming
Shoko Araki, Nobutaka Ito, Marc Delcroix, Atsunori Ogawa, Keisuke Kinoshita, Takuya Higuchi, Takuya Yoshioka, Dong Tran, Shigeki Karita, Tomohiro Nakatani
HSCMA 2017 | March 2017
Online MVDR Beamformer Based on Complex Gaussian Mixture Model With Spatial Prior for Noise Robust ASR
Takuya Higuchi, Nobutaka Ito, Shoko Araki, Takuya Yoshioka, Marc Delcroix, Tomohiro Nakatani
IEEE/ACM Transactions on Audio, Speech, and Language Processing | February 2017, Vol 25: pp. 780-793
Achieving Human Parity in Conversational Speech Recognition
Geoff Zweig, Wayne Xiong, Jasha Droppo, Xuedong Huang, Frank Seide, Mike Seltzer, Andreas Stolcke, Dong Yu
December 2016
IEEE Spoken Language Technology Workshop
Invited talk, IEEE SLT Workshop
A Comparative Study of Recurrent Neural Network Models for Lexical Domain Classification
Suman Ravuri, Andreas Stolcke
Proc. IEEE ICASSP | March 2016
Proc. IEEE ICASSP
Robust and Efficient Multiple Alignment of Unsynchronized Meeting Recordings
T. J. Tsai, Andreas Stolcke
IEEE Transactions on Speech, Audio and Language Processing | February 2016, Vol 24: pp. 833-845
A Comparative Study of Neural Network Models for Lexical Intent Classification
Suman Ravuri, Andreas Stolcke
Proc. IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Deep Bi-directional Recurrent Networks Over Spectral Windows
Abdelrahman Mohamed, Frank Seide, Dong Yu, Jasha Droppo, Andreas Stolcke, Geoffrey Zweig, Gerald Penn
Proc. IEEE Automatic Speech Recognition and Understanding Workshop | December 2015
Recurrent Neural Network and LSTM Models for Lexical Utterance Classification
Suman Ravuri, Andreas Stolcke
Proc. Interspeech | September 2015
Personalization of Word-Phrase-Entity Language Models
Michael Levit, Andreas Stolcke, R. Subba, Sarangarajan Parthasarathy, Shawn Chang, S. Xie, T. Anastasakos, B. Dumoulin
Proc. Interspeech | September 2015
A Comparison of Neural Network Feature Transforms for Speaker Diarization
Sree Harsha Yella, Andreas Stolcke
Proc. Interspeech | September 2015
Multimodal Addressee Detection in Multiparty Dialogue Systems
T. J. Tsai, Andreas Stolcke, Malcolm Slaney
Proc. IEEE ICASSP | April 2015
Proc. IEEE ICASSP
-
Real-Time Audio-Visual End-To-End Speech Enhancement
Zirun Zhu, Hemin Yang, Min Tang, Ziyi Yang, Sefik Emre Eskimez, Huaming Wang
2023 IEEE International Conference on Acoustics, Speech and Signal Processing | June 2023
Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization
Dongmei Wang, Xiong Xiao, Naoyuki Kanda, Takuya Yoshioka, Jian Wu
ICASSP 2023 | June 2023
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, Yu Shi, Yichong Xu, Yao Qian, Mei Gao, Yi-Ling Chen, Liyang Lu, Yujia Xie, Robert Gmyr, Noel Codella, Naoyuki Kanda, Bin Xiao, Lu Yuan, Takuya Yoshioka, Michael Zeng, Xuedong Huang
AAAI 2023 | February 2023
Self-supervised learning with bi-label masked speech prediction for streaming multi-talker speech recognition
Zili Huang, Zhuo Chen, Naoyuki Kanda, Jian Wu, Yiming Wang, Jinyu Li, Takuya Yoshioka, Xiaofei Wang, Peidong Wang
arXiv:2211.05564 | November 2022
Speech separation with large-scale self-supervised learning
Zhuo Chen, Naoyuki Kanda, Jian Wu, Yu Wu, Xiaofei Wang, Takuya Yoshioka, Jinyu Li, Sunit Sivasankaran, Sefik Emre Eskimez
arXiv:2211.05172 | November 2022
Real-Time Target Sound Extraction
Bandhav Veluri, Justin Chan, Malek Itani, Tuochao Chen, Takuya Yoshioka, Shyamnath Gollakota
arXiv:2211.02250 | November 2022
Breaking trade-offs in speech separation with sparsely-gated mixture of experts
Xiaofei Wang, Zhuo Chen, Yu Shi, Jian Wu, Naoyuki Kanda, Takuya Yoshioka
arXiv:2211.06493 | November 2022