Deep Learning Group

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

An Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

MindAgent: Emergent Gaming Interaction

Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao

Processings of NAACL 2024 | January 2024

Publication Project Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Implicit Chain of Thought Reasoning via Knowledge Distillation

Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber

ArXiv | November 2023, Vol abs/2311.01460

DOI Preprint

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

Chandan Singh, Jianfeng Gao

EMNLP | November 2023

Publication

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao

ACL 2023 | July 2023

Publication

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

NLP Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | May 2023

Publication Project Project

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao

NeurIPS 2023 | April 2023

Publication Github

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

Neural Approaches to Conversational Information Retrieval

Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell

Published by Springer | March 2023, Vol 44

ISBN: 978-3-031-23079-0

The Information Retrieval Series.

Preprint

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication Project

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2022 | December 2022

Publication Publication Project Project

Fault-Aware Neural Code Rankers

Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao

NeurIPS 2022 | November 2022

Publication Publication Project

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Chandan Singh, Jyoti Aneja, Jianfeng Gao

October 2022

Publication Github Project

Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models

Chandan Singh, Jianfeng Gao

September 2022

Publication Github

Interactive Code Generation via Test-Driven User-Intent Formalization

Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao

August 2022

Publication Project

Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages

Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky

ArXiv | August 2022, Vol abs/2208.06061

DOI Publication

INK: Intensive Neural Knowledge

James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao

MSR-TR-2022-38 | July 2022

Published by Microsoft MSR-TR-2022-38

Publication Project

RegionCLIP: Region-based Language-Image Pretraining

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 | June 2022

Publication

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

LAFITE: Towards Language-Free Training for Text-to-Image Generation

Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

CVPR 2022 | June 2022

Publication

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang

June 2022

Publication Project

Unified Contrastive Learning in Image-Text-Label Space

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

CVPR 2022 | June 2022

Publication

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

May 2022

Publication Github Project

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

Neurocompositional computing in human and machine intelligence: A tutorial

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao

MSR-TR-2022-5 | May 2022

Published by Microsoft

52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).

Project

Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao

AI Mag. | May 2022, Vol 43: pp. 308-322

Publication Project

K-LITE: Learning Transferable Visual Models with External Knowledge

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

NeurIPS 2022 | April 2022

Oral Presentation (1%)

Publication Project

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao

NeurIPS (Datasets and Benchmarks Track) | April 2022

Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/

Publication

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github Project Project

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

April 2022

arXiv:2204.06644

Publication

FocalNet: Focal Modulation Networks

Jianwei Yang, Chunyuan Li, Jianfeng Gao

2022 Neural Information Processing Systems | March 2022

Publication

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

KRIT: Knowledge-Reasoning Intelligence in vision-language Transformer

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Yonatan Bisk, Jianfeng Gao

MSR-TR-2021-34 | September 2021

Published by Microsoft

Publication Project Project

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project

Go-Figure: A Meta Evaluation of Factuality in Summarization

Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Preprint Publication

KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Chia-Hsuan Lee, Alex Polozov, Matthew Richardson

ACL-IJCNLP 2021 | August 2021

PDF Download Project

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

KB-VLP: Knowledge Based Vision and Language Pretraining

Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao

Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021

Publication Project

VinVL: Revisiting Visual Representations in Vision-Language Models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CVPR 2021 | June 2021

Publication Project

Compositional Processing Emerges in Neural Networks Solving Math Problems

Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao

CogSci … Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773

Publication Publication Project

Contrastive Multi-document Question Generation

Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

European Chapter of the Association for Computational Linguistics (EACL) | April 2021

PDF Publication Project

SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching

Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao

Transactions of the Association for Computational Linguistics | April 2021

PDF Video Github

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao

AAAI 2021 | April 2021

Publication

Multi-domain Task-oriented Dialog Challenge II at DSTC9

Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao

AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021

Publication

Learning Inference Rules with Neural TP-Reasoner

Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, workshop | December 2020

Publication Project Project

Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang

ArXiv | November 2020, Vol abs/2011.09530

Publication

CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search

Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett

MSR-TR-2020-49 | November 2020

Published by Microsoft

The participation report of our top non-manual entry in TREC COVID Round 2.

PDF Publication

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

Improved Image Wasserstein Attacks and Defenses

Edward J. Hu, Adith Swaminathan, Hadi Salman, Greg Yang

2020 International Conference on Learning Representations | July 2020

Best paper award at ICLR Trustworthy ML Workshop 2020

Publication

Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

ICML 2020 | July 2020

Publication Project Project

Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”

Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, Kazuhito Koishida

Thirty-seventh International Conference on Machine Learning (ICML) | July 2020

PDF

Recent Advances in Conversational Information Retrieval

Jianfeng Gao, Chenyan Xiong, Paul Bennett

SIGIR 2020 | July 2020

Tutorial Slides

Publication

RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson

ACL 2020 | June 2020

Publication Project

Few-Shot Generative Conversational Query Rewriting

Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu

SIGIR 2020 | June 2020

Best Short Paper Award

PDF

Novel Human-Object Interaction Detection via Adversarial Domain Generalization

Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang

May 2020

Publication

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering

Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Github

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou

NeurIPS 2020 | February 2020

Publication Project

Vision-Language Navigation Policy Learning and Adaptation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020

Publication Publication Project Project

Complementary Auxiliary Classifiers for Label-Conditional Text Generation

Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao

AAAI 2020 | February 2020

Publication

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

Program Synthesis and Semantic Parsing with Learned Code Idioms

Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov

NeurIPS 2019 | December 2019

PDF

TP-N2F: Tensor Product Representation for Natural To Formal Language Generation

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019

Best Paper Award at KR2ML Workshop in NeurIPS 2019.

Publication PDF Project Project

TIGEr: Text-to-Image Grounding for Image Caption Evaluation

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning

Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach

Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon

Interspeech | September 2019

Publication

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

Budgeted Policy Learning for Task-Oriented Dialogue Systems

Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen

ACL 2019 | July 2019

Publication Project

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin

ACL 2019 | July 2019

Publication

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa

CVPR 2019 | June 2019

Oral

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Efficient Adaptation of Pretrained Transformers for Abstractive Summarization

Andrew Hoang, Antoine Bosselut, Asli Celikyilmaz, Yejin Choi

June 2019

Publication

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

ACL 2019 | June 2019

Publication Project

Attentive Tensor Product Learning

Qiuyuan Huang, Li Deng, Oliver Wu, Chang Liu, Xiaodong He

AAAI 2019 | February 2019

Publication Project

Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing

Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin

NAACL 2019 | February 2019

PDF

Neural Approaches to Conversational AI

Jianfeng Gao, Michel Galley, Lihong Li

Foundations and Trends in Information Retrieval | February 2019

Publication Project Project Project Project Project

NAIL: A General Interactive Fiction Agent

Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason Williams

arXiv: Machine Learning | February 2019

Publication PDF Github Project

Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning

Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun

AAAI 2019 | January 2019

Publication Project

Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning

Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang

AAAI 2019 | January 2019

Publication Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He

AAAI 2019 | January 2019

Publication Project Project Project

The Design and Implementation of XiaoIce, an Empathetic Social Chatbot

Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou

MSR-TR-2018-42 | December 2018

Published by Microsoft

Publication Project Project

Turbo Learning for CaptionBot and DrawingBot

Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang

NeurIPS 2018 | December 2018

PDF Publication Project Project

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan

NeurIPS 2018 | December 2018

Publication Project Project Project

Nudging Neural Conversational Model with Domain Knowledge

Sungjin Lee

November 2018

Publication

Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning

Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen

EMNLP 2018 | October 2018

Publication Publication Project Project

Subgoal Discovery for Hierarchical Dialogue Policy Learning

Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara

EMNLP 2018 | October 2018

Publication Project Project Project

Deep Communicating Agents for Abstractive Summarization

Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication Project

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao

SLT 2018 | July 2018

Publication Project

Discourse-Aware Neural Rewards for Coherent Text Generation

Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication

Natural Language to Structured Query Generation via Meta-Learning

Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, Xiaodong He

NAACL HLT 2018 | June 2018

Publication Publication

Tensor Product Generation Networks for Deep NLP Modeling

Qiuyuan Huang, Paul Smolensky, Xiaodong He, Oliver Wu, Li Deng

NAACL 2018 | June 2018

long paper

Publication Publication Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He

May 2018

arxiv

Publication

Link Prediction using Embedded Knowledge Graphs

Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao

arXiv | April 2018

Publication Publication Project

Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong

ICASSP 2018 | April 2018

Publication Project

Towards Neural Phrase-based Machine Translation

Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng

ICLR 2018 Conference | April 2018

Publication Publication

Learning and analyzing vector encoding of symbolic representations

Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky

ICLR 2018 | March 2018

Publication

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

February 2018

arXiv preprint

Publication

BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems

Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng

AAAI 2018 | February 2018

Publication Publication Project

Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su

ACL 2018 | January 2018

Publication Publication Project

Adversarial Ranking for Language Generation

Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun

NIPS 2017 | December 2017

Publication

Deep Learning for Spoken and Text Dialog Systems

Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur

Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

Deep Learning in Conversational Language Understanding

Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng

Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

End-to-End Task-Completion Neural Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

the 8th International Joint Conference on Natural Language Processing | November 2017

Publication Project

Deep Learning for Dialogue Systems

Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tur

Proceedings of ACL 2017 | November 2017

Publication

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017

Publication Publication Project

Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension

David Golub, Po-Sen Huang, Xiaodong He, Li Deng

EMNLP 2017 | September 2017

Publication Publication

Learning Generic Sentence Representations Using Convolutional Neural Networks

Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin

EMNLP 2017 | September 2017

Publication

ReasoNet: Learning to Stop Reading in Machine Comprehension

Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen

23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017

Publication Publication Project

Provably Optimal Algorithms for Generalized Linear Contextual Bandits

Lihong Li, Yu Lu, Denny Zhou

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Project

Sequence Modeling via Segmentations

Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Denny Zhou, Li Deng

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Publication

Stochastic Variance Reduction Methods for Policy Evaluation

Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Project

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017

Publication Publication Project

Deep Learning with Low Precision by Half-wave Gaussian Quantization

Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

Semantic Compositional Networks for Visual Captioning

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

StyleNet: Generating Attractive Visual Captions with Styles

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017

Publication

A Nested Attention Neural Hybrid Model for Grammatical Error Correction

Jianfeng Gao

ACL 2017 | July 2017

Publication

Neural Phrase-Based Machine Translation

Po-Sen Huang, Chong Wang, Denny Zhou, Li Deng

June 2017

arXiv preprint

Publication Publication

Neuro-Symbolic Program Synthesis

Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli

The 5th International Conference on Learning Representations (ICLR) | April 2017

Publication

Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

March 2017

Publication Project

End-To-End Joint Learning of Natural Language Understanding and Dialog Manager

Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng

The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017

Publication Project

Scaffolding Networks for Teaching and Learning to Comprehend

Asli Celikyilmaz, Li Deng, Lihong Li, Chong Wang

February 2017

Publication

Character-level Deep Conflation for Business Data Analytics

Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng

ICASSP 2017 | February 2017

Publication Publication Project

A User Simulator for Task-Completion Dialogues

Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen

December 2016, pp. 14

Publication Project

Frustratingly Easy Neural Domain Adaptation

Young-Bum Kim, Karl Stratos, Ruhi Sarikaya

COLING | December 2016

Publication

MS MARCO: A Human Generated MAchine Reading COmprehension Dataset

Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng

November 2016

Publication Publication Download Project Project Project

TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency

Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley

November 2016

Publication Publication

Bi-directional Attention with Agreement for Dependency Parsing

Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng

EMNLP | November 2016

Publication Publication

Character-Level Question Answering with Attention

David Golub, Xiaodong He

EMNLP 2016 | November 2016

Publication Publication

Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads

Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng

EMNLP 2016 | November 2016

Publication Publication

Intent Detection using Semantically Enriched Word Embeddings

Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang

IEEE SLT 2016 | September 2016

Publication

Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks

Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

MSR-TR-2016-61 | September 2016

arXiv:1609.03286

Publication

End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

MSR-TR-2016-63 | September 2016

Publication Project

Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking

Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng

MSR-TR-2016-62 | August 2016

arXiv:1608.05081

Publication Project

Generating Natural Questions About an Image

Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016

Publication Publication Download Project

Deep Reinforcement Learning with a Natural Language Action Space

Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016

Publication

MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition

Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao

ECCV 2016 | August 2016

Publication Publication

Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

IJCAI 2016 | July 2016

Publication

Click-based Hot Fixes for Underperforming Torso Queries

Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke

Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016

Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)

Publication Project

Multi-Rate Deep Learning for Temporal Recommendation

Yang Song, Ali Elkahky, Xiaodong He

SIGIR 2016 | July 2016

Publication

Rich Image Captioning in the Wild

Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz

DeepVision workshop, Proceedings of CVPR 2016 | June 2016

Publication Project

Stacked Attention Networks for Image Question Answering

Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola

CVPR 2016 | June 2016

Publication Publication Project

End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding

Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication

Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM

Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication Project

Online Evaluation for Information Retrieval

Katja Hofmann, Lihong Li, Filip Radlinski

Foundations and Trends® in Information Retrieval | June 2016, Vol 10: pp. 1-117

Publication Publication Project

A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories

Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Publication Publication

Hierarchical Attention Networks for Document Classification

Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy

NAACL 2016 | June 2016

Publication

Visual Storytelling

Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Website: www.sind.ai

Publication Publication

An Efficient Algorithm for Contextual Bandits with Knapsacks, and an Extension to Concave Objectives

Shipra Agrawal, Nikhil Devanur, Lihong Li

Proceedings of the 29th Conference on Learning Theory (COLT) – JMLR: Workshop and Conference Proceedings | June 2016

Publication Project

Doubly Robust Off-policy Evaluation for Reinforcement Learning

Nan Jiang, Lihong Li

JMLR: Workshop and Conference Proceedings; Proceedings of the 33rd International Conference on Machine Learning (ICML) | June 2016

Publication Project

Reasoning in Vector Space: An Exploratory Study of Question Answering

Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky

Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016

Publication

Table Cell Search for Question Answering

Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan

Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016

Publication

Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)

Xiaodong He

MSR-TR-2016-16 | April 2016

Publication

Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

IEEE ICASSP | March 2016

Publication Project

Exploring Multiple Feature Spaces for Novel Entity Discovery

Zhaohui Wu, Yang Song, C. Lee Giles

AAAI 2016 | February 2016

AAAI 2016

Publication

Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]

Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward

IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694

Publication Publication Project

Basic Reasoning with Tensor Product Representations

Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng

January 2016

Publication

Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015

Publication

End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation

Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng

NIPS | December 2015

Publication

Learning Bidirectional Intent Embeddings by Convolutional Deep Structured Semantic Models for Spoken Language Understanding

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

NIPS workshop | December 2015

Publication Project

Evaluation of Deep Learning Frameworks

Kenneth Tran

November 2015

Publication

Recurrent Reinforcement Learning: A Hybrid Approach

Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He

MSR-TR-2015-98 | September 2015

Proceedings of COLING-94, Kyoto, Japan

Publication

Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base

Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao

Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015

Outstanding Paper Award

Publication Publication Project Project

Language Models for Image Captioning: The Quirks and What Works

Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell

July 2015

Publication

Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)

Xiaodong He

June 2015

Publication

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig

CVPR 2015 | June 2015

Tied for 1st Prize

Publication Project Project

Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

May 2015

Publication

A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems

Ali Mamdouh Elkahky, Yang Song, Xiaodong He

WWW 2015 | May 2015

Publication

Embedding Entities and Relations for Learning and Inference in Knowledge Bases

Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng

Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015

Publication Publication Project

Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval

Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang

May 2015

Publication

Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding

Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig

IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015

Publication

Deep Learning for Web Search and Natural Language Processing

Jianfeng Gao, Xiaodong He, Li Deng

MSR-TR-2015-7 | January 2015

Publication

Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data

Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik

December 2014

Publication

Deep Learning and Continuous Representations for Language Processing (Tutorial for SLT-2014)

Xiaodong He, Scott Wen-tau Yih

December 2014

Publication

A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

CIKM | November 2014

Publication Project

Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)

Xiaodong He, Jianfeng Gao, Li Deng

CIKM | November 2014

Publication

Modeling Interestingness with Deep Neural Networks

Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng

MSR-TR-2014-56 | October 2014

Publication Project

Learning Continuous Phrase Representations for Translation Modeling

Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng

Proceedings of ACL | June 2014

Publication

Semantic Parsing for Single-Relation Question Answering

Scott Wen-tau Yih, Xiaodong He, Chris Meek

Proceedings of ACL | June 2014

Publication Publication Publication Project

Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)

Xiaodong He, Jianfeng Gao, Li Deng

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014

Publication

A Convolutional Latent Semantic Model for Web Search

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

MSR-TR-2014-55 | April 2014

Publication Publication

Learning Semantic Representations Using Convolutional Neural Networks for Web Search

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

April 2014

Publication Project

Adapting Deep RankNet for Personalized Search

Yang Song, Hongning Wang, Xiaodong He

WSDM 2014 | February 2014

Publication

Learning Deep Structured Semantic Models for Web Search using Clickthrough Data

Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck

October 2013

Publication Publication Project

Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding

Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio

Interspeech 2013 | August 2013

Publication

Deep Stacking Networks for Information Retrieval

Li Deng, Xiaodong He, Jianfeng Gao

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013

Publication

Recent Advances in Deep Learning for Speech Research at Microsoft

Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero

May 2013

Publication Project

Use of Kernel Deep Convex Networks and End-To-End Learning for Spoken Language Understanding

Li Deng, Gokhan Tur, Xiaodong He, Dilek Hakkani-Tür

December 2012

Publication Project

Towards Deeper Understanding Deep Convex Networks for Semantic Utterance Classification

Gokhan Tur, Li Deng, Dilek Hakkani-Tür, Xiaodong He

March 2012

Publication Project

Symbolic Functions From Neural Computation

Paul Smolensky

Philosophical Transactions of the Royal Society A | January 2012, Vol 370: pp. 3543-3569

Publication

Optimality: From Neural Networks to Universal Grammar

Alan Prince, Paul Smolensky

Science | March 1997, Vol 275: pp. 1604-1610

Publication

Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems

Paul Smolensky

Artificial Intelligence | January 1990, Vol 46: pp. 159-216

Publication

Optimality: From Neural Networks to Universal Grammar

Alan Prince, Paul Smolensky

Science | March 1997, Vol 275: pp. 1604-1610

Publication

Tensor Product Variable Binding and the Representation of Symbolic Structures in Connectionist Systems

Paul Smolensky

Artificial Intelligence | January 1990, Vol 46: pp. 159-216

Publication

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

An Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

MindAgent: Emergent Gaming Interaction

Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao

Processings of NAACL 2024 | January 2024

Publication Project Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Implicit Chain of Thought Reasoning via Knowledge Distillation

Yuntian Deng, Kiran Prasad, Roland Fernandez, Paul Smolensky, Vishrav Chaudhary, Stuart Shieber

ArXiv | November 2023, Vol abs/2311.01460

DOI Preprint

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

Chandan Singh, Jianfeng Gao

EMNLP | November 2023

Publication

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao

ACL 2023 | July 2023

Publication

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

NLP Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | May 2023

Publication Project Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao

NeurIPS 2023 | April 2023

Publication Github

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication Project

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2022 | December 2022

Publication Publication Project Project

Fault-Aware Neural Code Rankers

Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao

NeurIPS 2022 | November 2022

Publication Publication Project

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Chandan Singh, Jyoti Aneja, Jianfeng Gao

October 2022

Publication Github Project

Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models

Chandan Singh, Jianfeng Gao

September 2022

Publication Github

Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages

Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky

ArXiv | August 2022, Vol abs/2208.06061

DOI Publication

INK: Intensive Neural Knowledge

James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao

MSR-TR-2022-38 | July 2022

Published by Microsoft MSR-TR-2022-38

Publication Project

RegionCLIP: Region-based Language-Image Pretraining

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 | June 2022

Publication

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang

June 2022

Publication Project

LAFITE: Towards Language-Free Training for Text-to-Image Generation

Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

CVPR 2022 | June 2022

Publication

Unified Contrastive Learning in Image-Text-Label Space

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

CVPR 2022 | June 2022

Publication

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

May 2022

Publication Github Project

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

Neurocompositional computing in human and machine intelligence: A tutorial

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao

MSR-TR-2022-5 | May 2022

Published by Microsoft

52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).

Project

Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao

AI Mag. | May 2022, Vol 43: pp. 308-322

Publication Project

K-LITE: Learning Transferable Visual Models with External Knowledge

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

NeurIPS 2022 | April 2022

Oral Presentation (1%)

Publication Project

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao

NeurIPS (Datasets and Benchmarks Track) | April 2022

Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/

Publication

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

April 2022

arXiv:2204.06644

Publication

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github Project Project

FocalNet: Focal Modulation Networks

Jianwei Yang, Chunyuan Li, Jianfeng Gao

2022 Neural Information Processing Systems | March 2022

Publication

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

KRIT: Knowledge-Reasoning Intelligence in vision-language Transformer

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Yonatan Bisk, Jianfeng Gao

MSR-TR-2021-34 | September 2021

Published by Microsoft

Publication Project Project

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project

KaggleDBQA: Realistic Evaluation of Text-to-SQL Parsers

Chia-Hsuan Lee, Alex Polozov, Matthew Richardson

ACL-IJCNLP 2021 | August 2021

PDF Download Project

Go-Figure: A Meta Evaluation of Factuality in Summarization

Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Preprint Publication

RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems

Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Publication

KB-VLP: Knowledge Based Vision and Language Pretraining

Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao

Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021

Publication Project

VinVL: Revisiting Visual Representations in Vision-Language Models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CVPR 2021 | June 2021

Publication Project

Compositional Processing Emerges in Neural Networks Solving Math Problems

Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao

CogSci … Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773

Publication Publication Project

Contrastive Multi-document Question Generation

Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

European Chapter of the Association for Computational Linguistics (EACL) | April 2021

PDF Publication Project

SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching

Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao

Transactions of the Association for Computational Linguistics | April 2021

PDF Video Github

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao

AAAI 2021 | April 2021

Publication

Multi-domain Task-oriented Dialog Challenge II at DSTC9

Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao

AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021

Publication

Learning Inference Rules with Neural TP-Reasoner

Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, workshop | December 2020

Publication Project Project

Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang

ArXiv | November 2020, Vol abs/2011.09530

Publication

CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search

Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett

MSR-TR-2020-49 | November 2020

Published by Microsoft

The participation report of our top non-manual entry in TREC COVID Round 2.

PDF Publication

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

Neuro-Symbolic Visual Reasoning: Disentangling “Visual” from “Reasoning”

Saeed Amizadeh, Hamid Palangi, Alex Polozov, Yichen Huang, Kazuhito Koishida

Thirty-seventh International Conference on Machine Learning (ICML) | July 2020

PDF

Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

ICML 2020 | July 2020

Publication Project Project

Improved Image Wasserstein Attacks and Defenses

Edward J. Hu, Adith Swaminathan, Hadi Salman, Greg Yang

2020 International Conference on Learning Representations | July 2020

Best paper award at ICLR Trustworthy ML Workshop 2020

Publication

RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson

ACL 2020 | June 2020

Publication Project

Few-Shot Generative Conversational Query Rewriting

Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu

SIGIR 2020 | June 2020

Best Short Paper Award

PDF

Novel Human-Object Interaction Detection via Adversarial Domain Generalization

Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang

May 2020

Publication

RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering

Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Github

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou

NeurIPS 2020 | February 2020

Publication Project

Vision-Language Navigation Policy Learning and Adaptation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020

Publication Publication Project Project

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

Complementary Auxiliary Classifiers for Label-Conditional Text Generation

Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao

AAAI 2020 | February 2020

Publication

Program Synthesis and Semantic Parsing with Learned Code Idioms

Richard Shin, Miltos Allamanis, Marc Brockschmidt, Alex Polozov

NeurIPS 2019 | December 2019

PDF

TP-N2F: Tensor Product Representation for Natural To Formal Language Generation

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019

Best Paper Award at KR2ML Workshop in NeurIPS 2019.

Publication PDF Project Project

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach

Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon

Interspeech | September 2019

Publication

Budgeted Policy Learning for Task-Oriented Dialogue Systems

Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen

ACL 2019 | July 2019

Publication Project

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin

ACL 2019 | July 2019

Publication

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa

CVPR 2019 | June 2019

Oral

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Efficient Adaptation of Pretrained Transformers for Abstractive Summarization

Andrew Hoang, Antoine Bosselut, Asli Celikyilmaz, Yejin Choi

June 2019

Publication

Multi-Task Deep Neural Networks for Natural Language Understanding

Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

ACL 2019 | June 2019

Publication Project

Attentive Tensor Product Learning

Qiuyuan Huang, Li Deng, Oliver Wu, Chang Liu, Xiaodong He

AAAI 2019 | February 2019

Publication Project

Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing

Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin

NAACL 2019 | February 2019

PDF

Neural Approaches to Conversational AI

Jianfeng Gao, Michel Galley, Lihong Li

Foundations and Trends in Information Retrieval | February 2019

Publication Project Project Project Project Project

NAIL: A General Interactive Fiction Agent

Matthew Hausknecht, Ricky Loynd, Greg Yang, Adith Swaminathan, Jason Williams

arXiv: Machine Learning | February 2019

Publication PDF Github Project

Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning

Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang

AAAI 2019 | January 2019

Publication Project

Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning

Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun

AAAI 2019 | January 2019

Publication Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He

AAAI 2019 | January 2019

Publication Project Project Project

The Design and Implementation of XiaoIce, an Empathetic Social Chatbot

Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou

MSR-TR-2018-42 | December 2018

Published by Microsoft

Publication Project Project

Turbo Learning for CaptionBot and DrawingBot

Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang

NeurIPS 2018 | December 2018

PDF Publication Project Project

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan

NeurIPS 2018 | December 2018

Publication Project Project Project

Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning

Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen

EMNLP 2018 | October 2018

Publication Publication Project Project

Subgoal Discovery for Hierarchical Dialogue Policy Learning

Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara

EMNLP 2018 | October 2018

Publication Project Project Project

Deep Communicating Agents for Abstractive Summarization

Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication Project

Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems

Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao

SLT 2018 | July 2018

Publication Project

Discourse-Aware Neural Rewards for Coherent Text Generation

Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication

Tensor Product Generation Networks for Deep NLP Modeling

Qiuyuan Huang, Paul Smolensky, Xiaodong He, Oliver Wu, Li Deng

NAACL 2018 | June 2018

long paper

Publication Publication Project

Natural Language to Structured Query Generation via Meta-Learning

Po-Sen Huang, Chenglong Wang, Rishabh Singh, Wen-tau Yih, Xiaodong He

NAACL HLT 2018 | June 2018

Publication Publication

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He

May 2018

arxiv

Publication

Link Prediction using Embedded Knowledge Graphs

Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao

arXiv | April 2018

Publication Publication Project

Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong

ICASSP 2018 | April 2018

Publication Project

Towards Neural Phrase-based Machine Translation

Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng

ICLR 2018 Conference | April 2018

Publication Publication

Learning and analyzing vector encoding of symbolic representations

Roland Fernandez, Asli Celikyilmaz, Rishabh Singh, Paul Smolensky

ICLR 2018 | March 2018

Publication

M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search

Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao

February 2018

arXiv preprint

Publication

BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems

Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng

AAAI 2018 | February 2018

Publication Publication Project

Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning

Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su

ACL 2018 | January 2018

Publication Publication Project

Adversarial Ranking for Language Generation

Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun

NIPS 2017 | December 2017

Publication

Deep Learning in Conversational Language Understanding

Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng

Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

Deep Learning for Spoken and Text Dialog Systems

Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur

Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

End-to-End Task-Completion Neural Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

the 8th International Joint Conference on Natural Language Processing | November 2017

Publication Project

Deep Learning for Dialogue Systems

Yun-Nung Chen, Asli Celikyilmaz, Dilek Hakkani-Tur

Proceedings of ACL 2017 | November 2017

Publication

Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension

David Golub, Po-Sen Huang, Xiaodong He, Li Deng

EMNLP 2017 | September 2017

Publication Publication

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017

Publication Publication Project

ReasoNet: Learning to Stop Reading in Machine Comprehension

Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen

23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017

Publication Publication Project

Provably Optimal Algorithms for Generalized Linear Contextual Bandits

Lihong Li, Yu Lu, Denny Zhou

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Project

Stochastic Variance Reduction Methods for Policy Evaluation

Simon Du, Jianshu Chen, Lihong Li, Lin Xiao, Denny Zhou

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Project

Sequence Modeling via Segmentations

Chong Wang, Yining Wang, Po-Sen Huang, Abdelrahman Mohamed, Denny Zhou, Li Deng

Proceedings of the 34th International Conference on Machine Learning (ICML) | August 2017

Publication Publication

Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017

Publication Publication Project

Deep Learning with Low Precision by Half-wave Gaussian Quantization

Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

StyleNet: Generating Attractive Visual Captions with Styles

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017

Publication

Semantic Compositional Networks for Visual Captioning

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

A Nested Attention Neural Hybrid Model for Grammatical Error Correction

Jianfeng Gao

ACL 2017 | July 2017

Publication

Neural Phrase-Based Machine Translation

Po-Sen Huang, Chong Wang, Denny Zhou, Li Deng

June 2017

arXiv preprint

Publication Publication

Neuro-Symbolic Program Synthesis

Emilio Parisotto, Abdelrahman Mohamed, Rishabh Singh, Lihong Li, Denny Zhou, Pushmeet Kohli

The 5th International Conference on Learning Representations (ICLR) | April 2017

Publication

Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

March 2017

Publication Project

End-To-End Joint Learning of Natural Language Understanding and Dialog Manager

Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng

The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017

Publication Project

Scaffolding Networks for Teaching and Learning to Comprehend

Asli Celikyilmaz, Li Deng, Lihong Li, Chong Wang

February 2017

Publication

Character-level Deep Conflation for Business Data Analytics

Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng

ICASSP 2017 | February 2017

Publication Publication Project

A User Simulator for Task-Completion Dialogues

Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen

December 2016, pp. 14

Publication Project

Frustratingly Easy Neural Domain Adaptation

Young-Bum Kim, Karl Stratos, Ruhi Sarikaya

COLING | December 2016

Publication

MS MARCO: A Human Generated MAchine Reading COmprehension Dataset

Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng

November 2016

Publication Publication Download Project Project Project

TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency

Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley

November 2016

Publication Publication

Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads

Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng

EMNLP 2016 | November 2016

Publication Publication

Character-Level Question Answering with Attention

David Golub, Xiaodong He

EMNLP 2016 | November 2016

Publication Publication

Bi-directional Attention with Agreement for Dependency Parsing

Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng

EMNLP | November 2016

Publication Publication

Intent Detection using Semantically Enriched Word Embeddings

Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang

IEEE SLT 2016 | September 2016

Publication

Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks

Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng

MSR-TR-2016-61 | September 2016

arXiv:1609.03286

Publication

End-to-End Reinforcement Learning of Dialogue Agents for Information Access

Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng

MSR-TR-2016-63 | September 2016

Publication Project

Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking

Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng

MSR-TR-2016-62 | August 2016

arXiv:1608.05081

Publication Project

Generating Natural Questions About an Image

Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016

Publication Publication Download Project

Deep Reinforcement Learning with a Natural Language Action Space

Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016

Publication

MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition

Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao

ECCV 2016 | August 2016

Publication Publication

Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

IJCAI 2016 | July 2016

Publication

Click-based Hot Fixes for Underperforming Torso Queries

Masrour Zoghi, Tomáš Tunys, Lihong Li, Damien Jose, Junyan Chen, Chun Ming Chin, Maarten de Rijke

Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) | July 2016

Proceedings of the 39th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)

Publication Project

Multi-Rate Deep Learning for Temporal Recommendation

Yang Song, Ali Elkahky, Xiaodong He

SIGIR 2016 | July 2016

Publication

Stacked Attention Networks for Image Question Answering

Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola

CVPR 2016 | June 2016

Publication Publication Project

Rich Image Captioning in the Wild

Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz

DeepVision workshop, Proceedings of CVPR 2016 | June 2016

Publication Project

Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM

Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication Project

End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding

Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication

Hierarchical Attention Networks for Document Classification

Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy

NAACL 2016 | June 2016

Publication

A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories

Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Publication Publication

Visual Storytelling

Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Website: www.sind.ai

Publication Publication

Doubly Robust Off-policy Evaluation for Reinforcement Learning

Nan Jiang, Lihong Li

JMLR: Workshop and Conference Proceedings; Proceedings of the 33rd International Conference on Machine Learning (ICML) | June 2016

Publication Project

An Efficient Algorithm for Contextual Bandits with Knapsacks, and an Extension to Concave Objectives

Shipra Agrawal, Nikhil Devanur, Lihong Li

Proceedings of the 29th Conference on Learning Theory (COLT) – JMLR: Workshop and Conference Proceedings | June 2016

Publication Project

Reasoning in Vector Space: An Exploratory Study of Question Answering

Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky

Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016

Publication

Table Cell Search for Question Answering

Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan

Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016

Publication

Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)

Xiaodong He

MSR-TR-2016-16 | April 2016

Publication

Exploring Multiple Feature Spaces for Novel Entity Discovery

Zhaohui Wu, Yang Song, C. Lee Giles

AAAI 2016 | February 2016

AAAI 2016

Publication

Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]

Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward

IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694

Publication Publication Project

Basic Reasoning with Tensor Product Representations

Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng

January 2016

Publication

End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation

Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng

NIPS | December 2015

Publication

Learning Bidirectional Intent Embeddings by Convolutional Deep Structured Semantic Models for Spoken Language Understanding

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

NIPS workshop | December 2015

Publication Project

Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015

Publication

Evaluation of Deep Learning Frameworks

Kenneth Tran

November 2015

Publication

Recurrent Reinforcement Learning: A Hybrid Approach

Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He

MSR-TR-2015-98 | September 2015

Proceedings of COLING-94, Kyoto, Japan

Publication

Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base

Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao

Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015

Outstanding Paper Award

Publication Publication Project Project

Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)

Xiaodong He

June 2015

Publication

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig

CVPR 2015 | June 2015

Tied for 1st Prize

Publication Project Project

Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

May 2015

Publication

A Multi-View Deep Learning Approach for Cross Domain User Modeling in Recommendation Systems

Ali Mamdouh Elkahky, Yang Song, Xiaodong He

WWW 2015 | May 2015

Publication

Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval

Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang

May 2015

Publication

Embedding Entities and Relations for Learning and Inference in Knowledge Bases

Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng

Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015

Publication Publication Project

Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding

Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig

IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015

Publication

Deep Learning for Web Search and Natural Language Processing

Jianfeng Gao, Xiaodong He, Li Deng

MSR-TR-2015-7 | January 2015

Publication

Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data

Xiujun Li, Chenlei Guo, Wei Chu, Ye-Yi Wang, Jude Shavlik

December 2014

Publication

Deep Learning and Continuous Representations for Language Processing (Tutorial for SLT-2014)

Xiaodong He, Scott Wen-tau Yih

December 2014

Publication

A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

CIKM | November 2014

Publication Project

Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)

Xiaodong He, Jianfeng Gao, Li Deng

CIKM | November 2014

Publication

Modeling Interestingness with Deep Neural Networks

Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng

MSR-TR-2014-56 | October 2014

Publication Project

Learning Continuous Phrase Representations for Translation Modeling

Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng

Proceedings of ACL | June 2014

Publication

Semantic Parsing for Single-Relation Question Answering

Scott Wen-tau Yih, Xiaodong He, Chris Meek

Proceedings of ACL | June 2014

Publication Publication Publication Project

Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)

Xiaodong He, Jianfeng Gao, Li Deng

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014

Publication

Adapting Deep RankNet for Personalized Search

Yang Song, Hongning Wang, Xiaodong He

WSDM 2014 | February 2014

Publication

Learning Deep Structured Semantic Models for Web Search using Clickthrough Data

Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck

October 2013

Publication Publication Project

Investigation of Recurrent-Neural-Network Architectures and Learning Methods for Spoken Language Understanding

Grégoire Mesnil, Xiaodong He, Li Deng, Yoshua Bengio

Interspeech 2013 | August 2013

Publication

Recent Advances in Deep Learning for Speech Research at Microsoft

Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Mike Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, Alex Acero

May 2013

Publication Project

Deep Stacking Networks for Information Retrieval

Li Deng, Xiaodong He, Jianfeng Gao

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013

Publication

Use of Kernel Deep Convex Networks and End-To-End Learning for Spoken Language Understanding

Li Deng, Gokhan Tur, Xiaodong He, Dilek Hakkani-Tür

December 2012

Publication Project

Symbolic Functions From Neural Computation

Paul Smolensky

Philosophical Transactions of the Royal Society A | January 2012, Vol 370: pp. 3543-3569

Publication

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao

NeurIPS 2023 | April 2023

Publication Github

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

RegionCLIP: Region-based Language-Image Pretraining

Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao

CVPR 2022 | June 2022

Publication

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

LAFITE: Towards Language-Free Training for Text-to-Image Generation

Yufan Zhou, Ruiyi Zhang, Changyou Chen, Chunyuan Li, Chris Tensmeyer, Tong Yu, Jiuxiang Gu, Jinhui Xu, Tong Sun

CVPR 2022 | June 2022

Publication

Unified Contrastive Learning in Image-Text-Label Space

Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao

CVPR 2022 | June 2022

Publication

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

K-LITE: Learning Transferable Visual Models with External Knowledge

Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao

NeurIPS 2022 | April 2022

Oral Presentation (1%)

Publication Project

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao

NeurIPS (Datasets and Benchmarks Track) | April 2022

Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/

Publication

FocalNet: Focal Modulation Networks

Jianwei Yang, Chunyuan Li, Jianfeng Gao

2022 Neural Information Processing Systems | March 2022

Publication

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

KRIT: Knowledge-Reasoning Intelligence in vision-language Transformer

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Yonatan Bisk, Jianfeng Gao

MSR-TR-2021-34 | September 2021

Published by Microsoft

Publication Project Project

VinVL: Revisiting Visual Representations in Vision-Language Models

Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao

CVPR 2021 | June 2021

Publication Project

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation

Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa

CVPR 2019 | June 2019

Oral

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He

AAAI 2019 | January 2019

Publication Project Project Project

Turbo Learning for CaptionBot and DrawingBot

Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang

NeurIPS 2018 | December 2018

PDF Publication Project Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Dapeng Wu, Jianfeng Wang, Xiaodong He

May 2018

arxiv

Publication

Deep Learning with Low Precision by Half-wave Gaussian Quantization

Zhaowei Cai, Xiaodong He, Jian Sun, Nuno Vasconcelos

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

StyleNet: Generating Attractive Visual Captions with Styles

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017

Publication

Semantic Compositional Networks for Visual Captioning

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017

Publication Publication

MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition

Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao

ECCV 2016 | August 2016

Publication Publication

Rich Image Captioning in the Wild

Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz

DeepVision workshop, Proceedings of CVPR 2016 | June 2016

Publication Project

Visual Storytelling

Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Website: www.sind.ai

Publication Publication

Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)

Xiaodong He

MSR-TR-2016-16 | April 2016

Publication

Language Models for Image Captioning: The Quirks and What Works

Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell

July 2015

Publication

Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)

Xiaodong He

June 2015

Publication

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig

CVPR 2015 | June 2015

Tied for 1st Prize

Publication Project Project

Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao

arXiv: 2403.00833 | February 2024

Publication Publication Project

An Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

NLP Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | May 2023

Publication Project Project

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

Multi-domain Task-oriented Dialog Challenge II at DSTC9

Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao

AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021

Publication

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach

Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon

Interspeech | September 2019

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Turbo Learning for CaptionBot and DrawingBot

Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang

NeurIPS 2018 | December 2018

PDF Publication Project Project

Nudging Neural Conversational Model with Domain Knowledge

Sungjin Lee

November 2018

Publication

Modeling Interestingness with Deep Neural Networks

Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng

MSR-TR-2014-56 | October 2014

Publication Project

An Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

MindAgent: Emergent Gaming Interaction

Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao

Processings of NAACL 2024 | January 2024

Publication Project Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao

ACL 2023 | July 2023

Publication

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L. Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao

Proceedings of ACL 2023 | May 2023

Publication Publication Project Project

NLP Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao

Proceedings of Transactions of the Association for Computational Linguistics (TACL) | May 2023

Publication Project Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao

Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023

Publication Project Project

Neural Approaches to Conversational Information Retrieval

Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell

Published by Springer | March 2023, Vol 44

ISBN: 978-3-031-23079-0

The Information Retrieval Series.

Preprint

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

EMNLP | December 2022

Publication Project

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2022 | December 2022

Publication Publication Project Project

INK: Intensive Neural Knowledge

James Park, Qiuyuan Huang, Yonatan Bisk, Jianwei Yang, Subhojit Som, Ali Farhadi, Yejin Choi, Jianfeng Gao

MSR-TR-2022-38 | July 2022

Published by Microsoft MSR-TR-2022-38

Publication Project

Grounded Language-Image Pre-training

Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao

CVPR | June 2022

Publication Project

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang

June 2022

Publication Project

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao

May 2022

Publication Github Project

VLC: Training Vision-Language Transformers from Captions

Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

Proceedings of Transactions on Machine Learning Research | May 2022

Publication Project Project

Neurocompositional computing in human and machine intelligence: A tutorial

Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao

MSR-TR-2022-5 | May 2022

Published by Microsoft

52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).

Project

METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals

Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao

April 2022

arXiv:2204.06644

Publication

LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners

Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao

NAACL 2022 | April 2022

Publication Github Project Project

KAT: A Knowledge Augmented Transformer for Vision-and-Language

Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao

NAACL 2022. Long paper, Oral. | January 2022

No.1 of OK-VQA Leaderboard (2021).

Publication Project

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao

NeurIPS 2021 | December 2021

Publication Github Project

NICE: Neural Image Commenting with Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao

EMNLP 2021 | October 2021

Publication Project

KRIT: Knowledge-Reasoning Intelligence in vision-language Transformer

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Yonatan Bisk, Jianfeng Gao

MSR-TR-2021-34 | September 2021

Published by Microsoft

Publication Project Project

Data Augmentation for Spoken Language Understanding via Pretrained Models

Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao

INTERSPEECH | September 2021

Publication

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project

Go-Figure: A Meta Evaluation of Factuality in Summarization

Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao

ACL-IJCNLP 2021 | August 2021

Preprint Publication

KB-VLP: Knowledge Based Vision and Language Pretraining

Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao

Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021

Publication Project

Learning Inference Rules with Neural TP-Reasoner

Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, workshop | December 2020

Publication Project Project

Few-shot Natural Language Generation for Task-Oriented Dialog

Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao

Empirical Methods in Natural Language Processing (EMNLP) | November 2020

Publication Project

NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy

Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao

NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020

Publication Publication Project

Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

ICML 2020 | July 2020

Publication Project Project

RAT-SQL: Relation-Aware Schema Encoding and Linking for Text-to-SQL Parsers

Bailin Wang, Richard Shin, Xiaodong Liu, Alex Polozov, Matthew Richardson

ACL 2020 | June 2020

Publication Project

On the Variance of the Adaptive Learning Rate and Beyond

Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han

Eighth International Conference on Learning Representations (ICLR) | April 2020

Publication PDF Project

ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems

Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang

ACL 2020 Demo | April 2020

Publication Project

Multi-domain Task-oriented Dialog Challenge II

Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao

The Ninth Dialog System Technology Challenge | March 2020

PDF Project

Results of the Multi-Domain Task-Completion Dialog Challenge

Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada

Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020

PDF Project

TP-N2F: Tensor Product Representation for Natural To Formal Language Generation

Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao

Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019

Best Paper Award at KR2ML Workshop in NeurIPS 2019.

Publication PDF Project Project

TIGEr: Text-to-Image Grounding for Image Caption Evaluation

Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning

Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao

EMNLP 2019 | November 2019

Publication Project

Structuring Latent Spaces for Stylized Response Generation

Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan

EMNLP-IJCNLP 2019 | September 2019

Publication Project Project

Few-Shot Dialogue Generation Without Annotated Data: A Transfer Learning Approach

Igor Shalyminov, Sungjin Lee, Arash Eshghi, Oliver Lemon

Interspeech | September 2019

Publication

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang

CVPR 2019 | June 2019

Best Student Paper Award in CVPR 2019.

Publication Video Project Project Project

Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation

Qiuyuan Huang, Zhe Gan, Asli Celikyilmaz, Oliver Wu, Jianfeng Wang, Xiaodong He

AAAI 2019 | January 2019

Publication Project Project Project

Turbo Learning for CaptionBot and DrawingBot

Qiuyuan Huang, Pengchuan Zhang, Oliver Wu, Lei Zhang

NeurIPS 2018 | December 2018

PDF Publication Project Project

Nudging Neural Conversational Model with Domain Knowledge

Sungjin Lee

November 2018

Publication

Deep Communicating Agents for Abstractive Summarization

Asli Celikyilmaz, Antoine Bosselut, Xiaodong He, Yejin Choi

2018 Conference of the North American Chapter of the Association for Computational Linguistics – Human Language Technologies (NAACL-HLT 2018) | July 2018

Publication Project

Towards Neural Phrase-based Machine Translation

Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng

ICLR 2018 Conference | April 2018

Publication Publication

Adversarial Ranking for Language Generation

Kevin Lin, Dianqi Li, Xiaodong He, Zhengyou Zhang, Ming-Ting Sun

NIPS 2017 | December 2017

Publication

Deep Learning in Conversational Language Understanding

Gokhan Tur, Asli Celikyilmaz, Xiaodong He, Dilek Hakkani-Tur, Li Deng

Deep Learning in Natural Language Processing. (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

Deep Learning for Spoken and Text Dialog Systems

Asli Celikyilmaz, Li Deng, Dilek Hakkani-Tur

Deep Learning in Natural Language Processing (eds. Li Deng and Yang Liu) | Published by Springer | 2017

Publication

End-to-End Task-Completion Neural Dialogue Systems

Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz

the 8th International Joint Conference on Natural Language Processing | November 2017

Publication Project

Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension

David Golub, Po-Sen Huang, Xiaodong He, Li Deng

EMNLP 2017 | September 2017

Publication Publication

Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning

Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017

Publication Publication Project

Learning Generic Sentence Representations Using Convolutional Neural Networks

Zhe Gan, Yunchen Pu, Ricardo Henao, Chunyuan Li, Xiaodong He, Lawrence Carin

EMNLP 2017 | September 2017

Publication

A Nested Attention Neural Hybrid Model for Grammatical Error Correction

Jianfeng Gao

ACL 2017 | July 2017

Publication

End-To-End Joint Learning of Natural Language Understanding and Dialog Manager

Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng

The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017

Publication Project

A User Simulator for Task-Completion Dialogues

Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen

December 2016, pp. 14

Publication Project

Frustratingly Easy Neural Domain Adaptation

Young-Bum Kim, Karl Stratos, Ruhi Sarikaya

COLING | December 2016

Publication

Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads

Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng

EMNLP 2016 | November 2016

Publication Publication

Character-Level Question Answering with Attention

David Golub, Xiaodong He

EMNLP 2016 | November 2016

Publication Publication

Intent Detection using Semantically Enriched Word Embeddings

Joo-Kyung Kim, Gokhan Tur, Asli Celikyilmaz, Bin Cao, Ye-Yi Wang

IEEE SLT 2016 | September 2016

Publication

Generating Natural Questions About an Image

Nasrin Mostafzadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics | August 2016

Publication Publication Download Project

Deep Reinforcement Learning with a Natural Language Action Space

Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016

Publication

Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

IJCAI 2016 | July 2016

Publication

Rich Image Captioning in the Wild

Kenneth Tran, Xiaodong He, Lei Zhang, Jian Sun, Cornelia Carapcea, Chris Thrasher, Chris Buehler, Chris Sienkiewicz

DeepVision workshop, Proceedings of CVPR 2016 | June 2016

Publication Project

Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM

Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication Project

End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding

Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng

Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016

Publication

Hierarchical Attention Networks for Document Classification

Zichao Yang, Diyi Yang, Chris Dyer, Xiaodong He, Alex Smola, Eduard Hovy

NAACL 2016 | June 2016

Publication

A Corpus and Cloze Evaluation for Deeper Understanding of Commonsense Stories

Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, James Allen

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Publication Publication

Visual Storytelling

Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell

Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016 | June 2016

Website: www.sind.ai

Publication Publication

Reasoning in Vector Space: An Exploratory Study of Question Answering

Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky

Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016

Publication

Table Cell Search for Question Answering

Huan Sun, Hao Ma, Xiaodong He, Scott Wen-tau Yih, Yu Su, Xifeng Yan

Proceedings of the companion publication of the 25th international conference on World Wide Web | April 2016

Publication

Multimodal Learning for Image Captioning and Visual Question Answering (talk at UC Berkeley, BVLC)

Xiaodong He

MSR-TR-2016-16 | April 2016

Publication

Zero-Shot Learning of Intent Embeddings for Expansion by Convolutional Deep Structured Semantic Models

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

IEEE ICASSP | March 2016

Publication Project

Detecting Actionable Items in Meetings by Convolutional Deep Structured Semantic Models

Yun-Nung Chen, Dilek Hakkani-Tür, Xiaodong He

Proceedings of 2015 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2015) | December 2015

Publication

Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base

Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao

Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015

Outstanding Paper Award

Publication Publication Project Project

Language Models for Image Captioning: The Quirks and What Works

Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell

July 2015

Publication

Deep Semantic Learning: Teach machines to understand text, image, and knowledge graph (Invited talk at CVPR DeepVision workshop)

Xiaodong He

June 2015

Publication

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig

CVPR 2015 | June 2015

Tied for 1st Prize

Publication Project Project

Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)

Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao

May 2015

Publication

Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval

Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang

May 2015

Publication

Using Recurrent Neural Networks for Slot Filling in Spoken Language Understanding

Grégoire Mesnil, Yann Dauphin, Kaisheng Yao, Yoshua Bengio, Li Deng, Xiaodong He, Larry Heck, Gokhan Tur, Dilek Hakkani-Tür, Dong Yu, Geoffrey Zweig

IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2015

Publication

A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

CIKM | November 2014

Publication Project

Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)

Xiaodong He, Jianfeng Gao, Li Deng

CIKM | November 2014

Publication

Learning Continuous Phrase Representations for Translation Modeling

Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng

Proceedings of ACL | June 2014

Publication

Semantic Parsing for Single-Relation Question Answering

Scott Wen-tau Yih, Xiaodong He, Chris Meek

Proceedings of ACL | June 2014

Publication Publication Publication Project

A Convolutional Latent Semantic Model for Web Search

Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil

MSR-TR-2014-55 | April 2014

Publication Publication

Learning Deep Structured Semantic Models for Web Search using Clickthrough Data

Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck

October 2013

Publication Publication Project

An Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

February 2024

Publication Publication Project

Agent AI: Surveying the Horizons of Multimodal Interaction

Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao

arXiv: 2401.03568 | January 2024

Publication Project

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon

KDD 2021 | August 2021

Publication Publication Project