Jianfeng Gao

Distinguished Scientist & Vice President

Publications

View by:

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Adapting Web Agents with Synthetic Supervision
  
  Zhaoyang Wang, Yiming Liang, Xuchao Zhang, Qianhui Wu, Siwei Han, Anson Bastos, Rujia Wang, Chetan Bansal, Baolin Peng, Jianfeng Gao, Saravan Rajmohan, Huaxiu Yao
  
  November 2025
  
  Publication Project
- Interpretable Next-token Prediction via the Generalized Induction Head
  
  Eunji Kim, Sriya Mantena, Weiwei Yang, Chandan Singh, Sungroh Yoon, Jianfeng Gao
  
  NeurIPS 2025 | October 2025
  
  Publication
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
  
  Yucheng Li, Huiqiang Jiang, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICML 2025 | July 2025
  
  Preprint Github Project
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
  
  Qianhui Wu, Kanzhi Cheng, Rui Yang, Chaoyun Zhang, Jianwei Yang, Huiqiang Jiang, Jian Mu, Baolin Peng, Bo Qiao, Reuben Tan, Si Qin, Lars Liden, Qingwei Lin 林庆维, Huan Zhang, Tong Zhang, Jianbing Zhang, Dongmei Zhang, Jianfeng Gao
  
  NeurIPS 2025 | June 2025
  
  Publication Project Project
- Training Language Models to Generate Quality Code with Program Analysis Feedback
  
  Feng Yao, Zilong Wang, Liyuan Liu, Junxia Cui, Li Zhong, Xiaohan Fu, Haohui Mai, Vish Krishnan, Jianfeng Gao, Jingbo Shang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Text Generation Beyond Discrete Token Sampling
  
  Yufan Zhuang, Liyuan Liu, Chandan Singh, Jingbo Shang, Jianfeng Gao
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
  
  Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
  
  CHI 2025 | April 2025
  
  Publication Video Video Access
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Project
- Magma: A Foundation Model for Multimodal AI Agents
  
  Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
  
  February 2025
  
  Publication Video Access
- Simplifying DINO via Coding Rate Regularization
  
  Ziyang Wu, Jingyuan Zhang, Druv Pai, XuDong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
  
  ICML 2025 | February 2025
  
  DOI Publication Publication
- LLaVA-Rad MIMIC-CXR Annotations
  
  Juan Manuel Zambrano Chaves (juanza), Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Akshay Chaudhari, Serena Yeung, Curtis Langlotz, Sheng Wang, Hoifung Poon
  
  January 2025
  
  Publication
- Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
  
  Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  NeurIPS 2024 | December 2024
  
  DOI Publication Publication
- SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  
  Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICLR 2025 | December 2024
  
  Preprint Github Project
- Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
  
  Jitesh Jain, Zhengyuan Yang, Humphrey Shi, Jianfeng Gao, Jianwei Yang
  
  NeurIPS 2025 | December 2024
  
  Publication
- Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
  
  Paul Smolensky, Jianfeng Gao, Roland Fernandez
  
  2024 Neural Information Processing Systems | December 2024
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
  
  Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
  
  2024 Neural Information Processing Systems | October 2024
  
  Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Access
- BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
  
  Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
  
  June 2024
  
  DOI Video
- Crafting Interpretable Embeddings by Asking LLMs Questions
  
  Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
  
  NeurIPS 2024 | May 2024
  
  DOI Publication Publication
- A whole-slide foundation model for digital pathology from real-world data
  
  Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
  
  Nature | May 2024
  
  Publication DOI Publication
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
  
  Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
  
  Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
  
  Publication Project Project
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
  
  Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
  
  March 2024
  
  Publication
- Agent AI Towards a Holistic Intelligence
  
  Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
  
  arXiv: 2403.00833 | February 2024
  
  Publication Publication Project
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
  
  Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
  
  January 2024
  
  Publication
- MindAgent: Emergent Gaming Interaction
  
  Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
  
  Processings of NAACL 2024 | January 2024
  
  Publication Project Project
- TrustLLM: Trustworthiness in Large Language Models
  
  Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
  
  ICML 2024 | January 2024
  
  DOI Publication Publication
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Bridging Discrete and Backpropagation: Straight-Through and Beyond
  
  Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
  
  NeurIPS 2023 (Oral) | December 2023
  
  Publication Github
- Visual In-Context Prompting
  
  Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
  
  CVPR 2024 | November 2023
  
  DOI Publication Publication
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Tree Prompting: Efficient Task Adaptation without Fine-Tuning
  
  Chandan Singh, Jianfeng Gao
  
  EMNLP | November 2023
  
  Publication
- BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
  
  Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
  
  October 2023
  
  Publication
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
  
  Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
  
  Proceedings of NeurIPS 2023 | October 2023
  
  Publication Project
- Multimodal Foundation Models: From Specialists to General-Purpose Assistants
  
  Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
  
  September 2023
  
  118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
  
  Publication Project
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  
  Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
  
  ACL | May 2023
  
  Publication Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Instruction Tuning with GPT-4
  
  Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
  
  MSR-TR-2023-35 | April 2023
  
  Published by Microsoft
  
  Project Page: https://instruction-tuning-with-gpt-4.github.io/
  
  Publication Project
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Neural Approaches to Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
  
  Published by Springer | March 2023, Vol 44
  
  ISBN: 978-3-031-23079-0
  
  The Information Retrieval Series.
  
  Preprint
- Efficient Long Sequence Modeling via State Space Augmented Transformer
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
  
  December 2022
  
  Preprint
  
  Publication Github
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
  
  Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  EMNLP | December 2022
  
  Publication Project
- AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
  
  Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2022 | December 2022
  
  Publication Publication Project Project
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication Project
- Fault-Aware Neural Code Rankers
  
  Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
  
  NeurIPS 2022 | November 2022
  
  Publication Publication Project
- Explaining Patterns in Data with Language Models via Interpretable Autoprompting
  
  Chandan Singh, Jyoti Aneja, Jianfeng Gao
  
  October 2022
  
  Publication Github Project
- Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
  
  Chandan Singh, Jianfeng Gao
  
  September 2022
  
  Publication Github
- Interactive Code Generation via Test-Driven User-Intent Formalization
  
  Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
  
  August 2022
  
  Publication Project
- Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
  
  Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
  
  ArXiv | August 2022, Vol abs/2208.06061
  
  DOI Publication
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication Project
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication Project
- OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
  
  Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
  
  June 2022
  
  Publication Project
- Unified Contrastive Learning in Image-Text-Label Space
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
  
  Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
  
  May 2022
  
  Publication Github Project
- VLC: Training Vision-Language Transformers from Captions
  
  Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  Proceedings of Transactions on Machine Learning Research | May 2022
  
  Publication Project Project
- Neurocompositional computing in human and machine intelligence: A tutorial
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
  
  MSR-TR-2022-5 | May 2022
  
  Published by Microsoft
  
  52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
  
  Project
- Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
  
  AI Mag. | May 2022, Vol 43: pp. 308-322
  
  Publication Project
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication Project
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
  
  Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
  
  NeurIPS (Datasets and Benchmarks Track) | April 2022
  
  Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
  
  Publication
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
  
  Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  NAACL 2022 | April 2022
  
  Publication Github Project Project
- METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
  
  Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
  
  April 2022
  
  arXiv:2204.06644
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
  
  Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | April 2022
  
  Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- FocalNet: Focal Modulation Networks
  
  Jianwei Yang, Chunyuan Li, Jianfeng Gao
  
  2022 Neural Information Processing Systems | March 2022
  
  Publication
- Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
  
  Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
  
  NeurIPS 2021 | March 2022
  
  PDF Publication Github
- KAT: A Knowledge Augmented Transformer for Vision-and-Language
  
  Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  NAACL 2022. Long paper, Oral. | January 2022
  
  No.1 of OK-VQA Leaderboard (2021).
  
  Publication Project
- Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
  
  Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
  
  NAACL 2022 | December 2021
  
  Publication
- ValueNet: A New Dataset for Human Value Driven Dialogue System
  
  Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
  
  AAAI 2022 | December 2021
  
  Publication
- RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  AAAI 2022 | December 2021
  
  Publication
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
  
  Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Focal Attention for Long-Range Interactions in Vision Transformers
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Preprint Github
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- Taming Sparsely Activated Transformer with Stochastic Experts.
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
  
  October 2021
  
  Publication Publication
- Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
  
  Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication Github
- TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
  
  Jianwei Yang, Yonatan Bisk, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication
- Very Deep Transformers for Neural Machine Translation
  
  Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
  
  October 2021
  
  Publication Github
- ARCH: Efficient Adversarial Regularized Training with Caching
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Go-Figure: A Meta Evaluation of Factuality in Summarization
  
  Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Preprint Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- KB-VLP: Knowledge Based Vision and Language Pretraining
  
  Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
  
  Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
  
  Publication Project
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication Project
- Targeted Adversarial Training for Natural Language Understanding
  
  Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
  
  NAACL | June 2021
  
  Publication Github
- Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
  
  Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
  
  North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
  
  Publication
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication Project
- XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
  
  Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | June 2021
  
  arXiv:2106.04563
  
  Publication Github Project Project
- Compositional Processing Emerges in Neural Networks Solving Math Problems
  
  Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
  
  CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
  
  Publication Publication Project
- DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
  
  Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
  
  2021 International Conference on Learning Representations | May 2021
  
  Under review
  
  PDF Publication Github Project Project
- Joint Retrieval and Generation Training for Grounded Text Generation
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  May 2021
  
  Publication
- Text Editing by Command
  
  Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
  
  NAACL | April 2021
  
  PDF Publication
- Contrastive Multi-document Question Generation
  
  Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
  
  European Chapter of the Association for Computational Linguistics (EACL) | April 2021
  
  PDF Publication Project
- SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
  
  Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
  
  Transactions of the Association for Computational Linguistics | April 2021
  
  PDF Video Github
- Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
  
  Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
  
  AAAI 2021 | April 2021
  
  Publication
- Token-wise Curriculum Learning for Neural Machine Translation
  
  Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | March 2021
  
  Publication
- Multi-domain Task-oriented Dialog Challenge II at DSTC9
  
  Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
  
  AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project Project
- A Controllable Model of Grounded Response Generation
  
  Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
  
  AAAI 2021 | January 2021
  
  PDF Publication Publication
- Reader-Guided Passage Reranking for Open-Domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Self-supervised Pre-training with Hard Examples Improves Visual Representations.
  
  Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
  
  December 2020
  
  Publication
- Learning Inference Rules with Neural TP-Reasoner
  
  Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, workshop | December 2020
  
  Publication Project Project
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication Project
- Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
  
  Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
  
  ArXiv | November 2020, Vol abs/2011.09530
  
  Publication
- CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
  
  Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
  
  MSR-TR-2020-49 | November 2020
  
  Published by Microsoft
  
  The participation report of our top non-manual entry in TREC COVID Round 2.
  
  PDF Publication
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
  
  Publication Publication Project
- Generation-Augmented Retrieval for Open-domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | September 2020
  
  Publication
- HittER: Hierarchical Transformers for Knowledge Graph Embeddings
  
  Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
  
  EMNLP 2021 | August 2020
  
  Publication Github
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project Project
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Access
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
  
  Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  37th International Conference on Machine Learning (ICML 2020) | July 2020
  
  Publication Github Project
- Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  ICML 2020 | July 2020
  
  Publication Project Project
- MIND: A Large-scale Dataset for News Recommendation
  
  Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
  
  ACL 2020 | July 2020
  
  Publication Access
- Recent Advances in Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett
  
  SIGIR 2020 | July 2020
  
  Tutorial Slides
  
  Publication
- Few-Shot Generative Conversational Query Rewriting
  
  Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
  
  SIGIR 2020 | June 2020
  
  Best Short Paper Award
  
  PDF
- Novel Human-Object Interaction Detection via Adversarial Domain Generalization
  
  Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
  
  May 2020
  
  Publication
- OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
  
  Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
  
  April 2020
  
  Publication Github
- Feature Quantization Improves GAN Training
  
  Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
  
  April 2020
  
  Publication Github
- Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
  
  Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
  
  CVPR 2020 | April 2020
  
  Publication Github
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
  
  Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
  
  ACL 2020 Demo | April 2020
  
  Publication Project
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
  
  Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Github
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
  
  Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
  
  April 2020
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II
  
  Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
  
  The Ninth Dialog System Technology Challenge | March 2020
  
  PDF Project
- Vision-Language Navigation Policy Learning and Adaptation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
  
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
  
  Publication Publication Project Project
- Complementary Auxiliary Classifiers for Label-Conditional Text Generation
  
  Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
  
  AAAI 2020 | February 2020
  
  Publication
- Results of the Multi-Domain Task-Completion Dialog Challenge
  
  Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
  
  Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
  
  PDF Project
- Unified Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
  
  Publication
- Uniﬁed Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI | February 2020
  
  Publication Project Project
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
  
  Publication Publication
- Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
  
  Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
  
  Publication PDF
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  The third Conversational AI workshop, NeurIPS | December 2019
  
  Publication
- TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
  
  Best Paper Award at KR2ML Workshop in NeurIPS 2019.
  
  Publication PDF Project Project
- Unified Language Model Pre-training for Natural Language Understanding and Generation
  
  Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
  
  Publication Github Project
- TIGEr: Text-to-Image Grounding for Image Caption Evaluation
  
  Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
  
  Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
  
  Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
  
  arXiv:1911.00536 | November 2019
  
  PDF Project Project
- HUBERT Untangles BERT to Improve Transfer across NLP Tasks
  
  Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
  
  arxiv | October 2019
  
  https://arxiv.org/abs/1910.12647
  
  Publication
- Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
  
  Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
  
  September 2019
  
  * Equal contributions
  
  Publication
- Structuring Latent Spaces for Stylized Response Generation
  
  Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  EMNLP-IJCNLP 2019 | September 2019
  
  Publication Project Project
- DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
  
  Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
  
  BioNLP 2019 | August 2019
  
  PDF
- Efficient Navigation with Language Pre-training and Stochastic Sampling
  
  xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
  
  EMNLP-IJCNLP | August 2019
  
  DOI
- Budgeted Policy Learning for Task-Oriented Dialogue Systems
  
  Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
  
  ACL 2019 | July 2019
  
  Publication Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  ACL | July 2019
  
  PDF Publication Github Project Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
  
  Publication
- Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
  
  Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
  
  Association for Computational Linguistics 2019 | July 2019
  
  Publication Project
- Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
  
  Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
  
  ACL 2019 | July 2019
  
  Publication
- Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
  
  Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
  
  CVPR 2019 | June 2019
  
  Oral
  
  Publication
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
  
  Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
  
  Proc. of ACL | June 2019
  
  PDF Project Project
- Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  ACL 2019 | June 2019
  
  Publication Project
- Neural Approaches to Conversational AI – Tutorial at ICML 2018
  
  Jianfeng Gao, Michel Galley
  
  ICML 2019 Tutorial | June 2019
  
  PDF
- Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  April 2019
  
  PDF Publication Github Project
- StoryGAN: A Sequential Conditional GAN for Story Visualization
  
  Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
  
  CVPR 2019 | April 2019
  
  PDF Publication
- Consistent Dialogue Generation with Self-supervised Feature Learning
  
  Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  preprint | March 2019
  
  Publication
- Jointly Optimizing Diversity and Relevance in Neural Response Generation
  
  Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  NAACL-HLT 2019 | March 2019
  
  Publication Project
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Object-driven Text-to-Image Synthesis via Adversarial Training
  
  Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
  
  CVPR 2019 | February 2019
  
  PDF Publication Project
- Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
  
  Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
  
  NAACL 2019 | February 2019
  
  PDF
- Neural Approaches to Conversational AI
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  Foundations and Trends in Information Retrieval | February 2019
  
  Publication Project Project Project Project Project
- Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
  
  Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
  
  AAAI 2019 | January 2019
  
  Publication Project
- Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
  
  Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
  
  AAAI 2019 | January 2019
  
  Publication Project
- The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
  
  Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
  
  MSR-TR-2018-42 | December 2018
  
  Published by Microsoft
  
  Publication Project Project
- Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
  
  Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
  
  NeurIPS 2018 | December 2018
  
  Publication Project Project Project
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  NIPS 2018 | December 2018
  
  Publication
- Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
  
  Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
  
  NIPS 2018 | December 2018
  
  Publication
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
  
  2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
  
  Publication
- Deep dyna-q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
  
  Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
  
  Publication
- Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
  
  Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
  
  EMNLP 2018 | October 2018
  
  Publication Publication Project Project
- Subgoal Discovery for Hierarchical Dialogue Policy Learning
  
  Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
  
  EMNLP 2018 | October 2018
  
  Publication Project Project Project
- Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
  
  Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
  
  SLT 2018 | July 2018
  
  Publication Project
- Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  ACL and SIGIR tutorial | July 2018
  
  ACL and SIGIR tutorial
  
  Publication Project
- Discourse-Aware Neural Rewards for Coherent Text Generation
  
  Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
  
  2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
  
  Publication
- Systems and methods for automated query answer generation
  
  Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
  
  June 2018
  
  Publication Project Project
- Link Prediction using Embedded Knowledge Graphs
  
  Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
  
  arXiv | April 2018
  
  Publication Publication Project
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
  
  ICASSP 2018 | April 2018
  
  Publication Project
- Dynamic Fusion Networks for Machine Reading Comprehension
  
  Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
  
  February 2018
  
  PDF Github
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  February 2018
  
  arXiv preprint
  
  Publication
- A Knowledge-Grounded Neural Conversation Model
  
  Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
  
  AAAI | February 2018
  
  Publication Project Project Project
- BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
  
  Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
  
  AAAI 2018 | February 2018
  
  Publication Publication Project
- Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
  
  ACL 2018 | January 2018
  
  Publication Publication Project
- Language-Based Image Editing with Recurrent Attentive Models
  
  Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
  
  MSR-TR-2017-50 | December 2017
  
  The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  
  Publication Project
- Stochastic Answer Networks for Machine Reading Comprehension
  
  Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
  
  MSR-TR-2017-51 | December 2017
  
  Publication Project
- The MSR-NLP System at Dialog System Technology Challenges 6
  
  Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
  
  Dialog System Technology Challenges (DSTC) | November 2017
  
  Publication Project
- Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
  
  Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
  
  IJCNLP | November 2017
  
  Publication Project Project Project
- Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
  
  Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
  
  IJCNLP | November 2017
  
  Publication Project
- End-to-End Task-Completion Neural Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  the 8th International Joint Conference on Natural Language Processing | November 2017
  
  Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
  
  Publication Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
  
  Publication
- ReasoNet: Learning to Stop Reading in Machine Comprehension
  
  Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
  
  23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
  
  Publication Publication Project
- Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
  
  Publication Publication Project
- Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
  
  Jianfeng Gao
  
  MSR-TR-2017-36 | July 2017
  
  Publication Project Project Project Project
- Semantic Compositional Networks for Visual Captioning
  
  Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
  
  Publication Publication
- StyleNet: Generating Attractive Visual Captions with Styles
  
  Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
  
  Publication
- A Nested Attention Neural Hybrid Model for Grammatical Error Correction
  
  Jianfeng Gao
  
  ACL 2017 | July 2017
  
  Publication
- Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  March 2017
  
  Publication Project
- End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
  
  Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
  
  The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
  
  Publication Project
- Character-level Deep Conflation for Business Data Analytics
  
  Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
  
  ICASSP 2017 | February 2017
  
  Publication Publication Project
- Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
  
  Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
  
  SIGIR 16 | January 2017
  
  Publication
- A User Simulator for Task-Completion Dialogues
  
  Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
  
  December 2016, pp. 14
  
  Publication Project
- Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
  
  Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  December 2016
  
  Publication
- MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
  
  Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
  
  November 2016
  
  Publication Publication Access Project Project Project
- TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
  
  Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
  
  November 2016
  
  Publication Publication
- Bi-directional Attention with Agreement for Dependency Parsing
  
  Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
  
  EMNLP | November 2016
  
  Publication Publication
- Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
  
  Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
  
  EMNLP 2016 | November 2016
  
  Publication Publication
- Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
  
  Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  MSR-TR-2016-61 | September 2016
  
  arXiv:1609.03286
  
  Publication
- End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-63 | September 2016
  
  Publication Project
- Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
  
  Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-62 | August 2016
  
  arXiv:1608.05081
  
  Publication Project
- Deep Reinforcement Learning with a Natural Language Action Space
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
  
  Publication
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
  
  Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
  
  ECCV 2016 | August 2016
  
  Publication Publication
- Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  IJCAI 2016 | July 2016
  
  Publication
- A Proposal for Evaluating Answer Distillation from Web Data
  
  Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
  
  Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
  
  PDF PDF
- Stacked Attention Networks for Image Question Answering
  
  Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
  
  CVPR 2016 | June 2016
  
  Publication Publication Project
- Deep Reinforcement Learning for Dialogue Generation
  
  Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
  
  Proc. of EMNLP | June 2016
  
  Publication Publication Project Project
- End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
  
  Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication
- Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
  
  Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication Project
- A Persona-Based Neural Conversation Model
  
  Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | June 2016
  
  Publication Publication Project Project Project Project
- Reasoning in Vector Space: An Exploratory Study of Question Answering
  
  Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
  
  Publication
- A Diversity-Promoting Objective Function for Neural Conversation Models
  
  Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  Proc. of NAACL-HLT | March 2016
  
  Publication Publication Project Project Project Project
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
  
  Publication Publication
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
  
  Publication Publication Project
- Basic Reasoning with Tensor Product Representations
  
  Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
  
  January 2016
  
  Publication
- End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
  
  Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
  
  NIPS | December 2015
  
  Publication
- Deep Reinforcement Learning with an Action Space Defined by Natural Language
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  ICML 2016 | November 2015
  
  PDF Publication
- Recurrent Reinforcement Learning: A Hybrid Approach
  
  Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
  
  MSR-TR-2015-98 | September 2015
  
  Proceedings of COLING-94, Kyoto, Japan
  
  Publication
- Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
  
  Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
  
  Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
  
  Outstanding Paper Award
  
  Publication Publication Project Project
- ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
  
  Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | July 2015
  
  Publication Publication Project Project
- A Deep Embedding Model for Co-occurrence Learning
  
  Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
  
  June 2015
  
  Publication
- A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
  
  Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
  
  Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
  
  Publication Publication Access Project Project Project
- From Captions to Visual Concepts and Back
  
  Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
  
  CVPR 2015 | June 2015
  
  Tied for 1st Prize
  
  Publication Project Project
- Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  May 2015
  
  Publication
- Embedding Entities and Relations for Learning and Inference in Knowledge Bases
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
  
  Publication Publication Project
- Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
  
  Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
  
  May 2015
  
  Publication
- Deep Learning for Web Search and Natural Language Processing
  
  Jianfeng Gao, Xiaodong He, Li Deng
  
  MSR-TR-2015-7 | January 2015
  
  Publication
- Learning Multi-Relational Semantics Using Neural-Embedding Models
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  NIPS 2014 workshop on Learning Semantics | December 2014
  
  Publication Publication
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  CIKM | November 2014
  
  Publication Project
- Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  CIKM | November 2014
  
  Publication
- Large-scale Expected BLEU Training of Phrase-based Reordering Models
  
  Michael Auli, Michel Galley, Jianfeng Gao
  
  Proc. of EMNLP | October 2014
  
  Publication
- Modeling Interestingness with Deep Neural Networks
  
  Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
  
  MSR-TR-2014-56 | October 2014
  
  Publication Project
- Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
  
  Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
  
  MSR-TR-2014-109 | August 2014
  
  Publication
- Online Classification Using a Voted RDA Method
  
  Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
  
  Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
  
  Publication
- Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
  
  Michael Auli, Jianfeng Gao
  
  June 2014
  
  Publication
- Learning Continuous Phrase Representations for Translation Modeling
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  Proceedings of ACL | June 2014
  
  Publication
- Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
  
  Publication
- A Convolutional Latent Semantic Model for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  MSR-TR-2014-55 | April 2014
  
  Publication Publication
- Learning Semantic Representations Using Convolutional Neural Networks for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  April 2014
  
  Publication Project
- Minimum Translation Modeling with Recurrent Neural Networks
  
  Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
  
  April 2014
  
  Publication
- Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
  
  Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
  
  October 2013
  
  Publication Publication Project
- A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
  
  Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
  
  MSR-TR-2013-89 | September 2013
  
  Publication
- Learning Semantic Representations for the Phrase Translation Model
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  MSR-TR-2013-88 | September 2013
  
  Publication
- Modeling Click-through Based Word-pairs for Web Search
  
  Jagadeesh Jagarlamudi, Jianfeng Gao
  
  August 2013
  
  Publication
- Query Expansion Using Path-constrained Random Walks
  
  Jianfeng Gao, Gu Xu, Jinxi Xu
  
  SIGIR 2013, Dublin, Ireland. | August 2013
  
  Publication
- Beyond Left-to-Right: Multiple Decomposition Structures for SMT
  
  Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
  
  NAACL | June 2013
  
  Publication
- Training MRF-Based Phrase Translation Models using Gradient Ascent
  
  Jianfeng Gao, Xiaodong He
  
  The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
  
  Publication
- Deep Stacking Networks for Information Retrieval
  
  Li Deng, Xiaodong He, Jianfeng Gao
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- End-To-End Learning of Parsing Models for Information Retrieval
  
  Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- Towards Concept-based Translation Models using Search Logs for Query Expansion
  
  Jianfeng Gao, Jian-Yun Nie
  
  November 2012
  
  Publication
- Combining Signals for Cross-Lingual Relevance Feedback
  
  Katrina Parton, Jianfeng Gao
  
  AIRS2012 | August 2012
  
  Publication
- Learning Lexicon Models from Search Logs for Query Expansion
  
  Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
  
  Proceedings of EMNLP | July 2012
  
  Publication
- MSR SPLAT, A Language Analysis Toolkit
  
  Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
  
  Proceedings of NAACL-HLT 2012 | June 2012
  
  Publication
- A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
  
  Hisami Suzuki, Jianfeng Gao
  
  Proceedings of EMNLP | May 2012
  
  Publication
- Statistical Translation and Web Search Ranking
  
  Jianfeng Gao
  
  ACL/SIGIR Summer School | August 2011
  
  Publication
- Clickthrough-Based Latent Semantic Models for Web Search
  
  Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
  
  Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
  
  Publication
- Domain Adaptation via Pseudo In-Domain Data Selection
  
  Amittai Axelrod, Xiaodong He, Jianfeng Gao
  
  EMNLP | July 2011
  
  Publication
- The MSRA Machine Translation System for IWSLT-2010
  
  Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
  
  Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
  
  Publication
- A Large Scale Ranker-Based System for Search Query Spelling Correction
  
  Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
  
  The 23rd International Conference on Computational Linguistics | August 2010
  
  Publication
- A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
  
  Alex Cheng, Fei Xia, Jianfeng Gao
  
  Coling 2010 Organizing Committee | August 2010
  
  Publication
- A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
  
  Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
  
  Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
  
  Publication
- Multi-Style Language Model for Web Scale Information Retrieval
  
  Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
  
  Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
  
  Publication
- Adapting Bboosting for Information Retrieval Measures
  
  Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
  
  Information Retrieval | June 2010, Vol 13: pp. 254-270
  
  Publication
- Learning Phrase-Based Spelling Error Models from Clickthrough Data
  
  Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
  
  ACL 2010 | May 2010
  
  Publication
- Exploring Web Scale Language models for Search Query Processing
  
  Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
  
  Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
  
  Publication
- Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
  
  Jianfeng Gao, Xiaodong He, Jian-Yun Nie
  
  CIKM | January 2010
  
  Publication
- Discovery of Term Variation in Japanese Web Search Queries
  
  Hisami Suzuki, Xiao Li, Jianfeng Gao
  
  Proceedings of EMNLP | August 2009
  
  Publication
- Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
  
  Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
  
  EMNLP | August 2009
  
  Publication
- Smoothing Clickthrough Data for Web Search Ranking
  
  Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
  
  SIGIR | July 2009
  
  Publication
- Using Statistical Techniques and Web Search to Correct ESL Errors
  
  Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
  
  Calico Journal | June 2009, Vol 26(3)
  
  Publication
- Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
  
  Publication
- Ranking, Boosting, and Model Adaptation
  
  Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
  
  MSR-TR-2008-109 | October 2008
  
  Publication
- Selecting good expansion terms for pseudo-relevance feedback
  
  Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
  
  SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
  
  ISBN: 978-1-600558-164-4
  
  Publication
- A Web-based English Proofing System for English as a Second Language Users
  
  Xing Yi, Jianfeng Gao, Bill Dolan
  
  International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
  
  Publication
- Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
  
  Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
  
  In Proceedings of Coling | January 2008
  
  Publication
- Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  EMNLP | January 2008
  
  Publication
- The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
  
  Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
  
  The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
  
  Publication
- Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
  
  Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
  
  Proceedings of IJCNLP, Hyderabad, India | January 2008
  
  Publication Publication Project
- Microsoft Research Treelet Translation System: NIST MT Evaluation 06
  
  Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
  
  MSR-TR-2007-144 | November 2007
  
  Publication Publication
- MSRLM: a Scalable Language Modeling Toolkit
  
  Patrick Nguyen, Jianfeng Gao, Milind Mahajan
  
  MSR-TR-2007-144 | November 2007
  
  Publication
- Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
  
  Jianfeng Gao, Hisami Suzuki
  
  August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
  
  Tutorial slides at the MSR Weihai Summer School, August 2007
  
  Publication
- A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  July 2007
  
  Publication
- A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
  
  Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
  
  Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
  
  Publication
- A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
  
  Jianfeng Gao, Mark Johnson
  
  January 2007
  
  Publication
- Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
  
  CIKM | January 2007
  
  Publication
- Scalable Training of L1-Regularized Log-Linear Models
  
  Galen Andrew, Jianfeng Gao
  
  International Conference on Machine Learning | January 2007
  
  Publication
- Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
  
  Jianfeng Gao, Jian-Yun Nie
  
  SIGIR | October 2006
  
  Publication
- A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
  
  Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
  
  ACL/SIGPARSE | April 2006
  
  Publication
- A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
  
  Jianfeng Gao, Hisami Suzuki, Wei Yuan
  
  Proceedings of EMNLP | April 2006
  
  Publication Publication
- Statistical Query Translation Models for Cross- Language Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Ming Zhou
  
  ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
  
  Publication
- A Supervised Learning Approach to Entity Search
  
  Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
  
  AIRS 2006 | January 2006
  
  Publication
- Approximation Lasso Methods for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Bin Yu
  
  Proceedings of ACL | January 2006
  
  Publication
- Microsoft Research IME Corpus
  
  Hisami Suzuki, Jianfeng Gao
  
  MSR-TR-2005-168 | December 2005
  
  Publication Access
- Person Resolution in Person Search Results: WebHawk
  
  Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
  
  CIKM'05, Bremen, Germany | October 2005
  
  Publication
- Minimum Sample Risk Methods for Language Modeling
  
  Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
  
  HLT/EMNLP | October 2005
  
  Publication
- Automatic Acquisition of Chinese-English Parallel Corpus from the Web
  
  Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
  
  October 2005
  
  Publication
- An Information-Theoretic Approach to Automatic Evaluation of Summaries
  
  Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  August 2005
  
  Publication Publication
- Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
  
  Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
  
  Computational Linguistics | June 2005, Vol 31(4): pp. 44
  
  Publication
- An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
  
  Wei Yuan, Jianfeng Gao, Hisami Suzuki
  
  IJCNLP 2005, LNAI 3651 | February 2005
  
  Publication
- A DOM Tree Alignment Model for Mining Parallel Data from the Web
  
  Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
  
  COLING-ACL | January 2005
  
  Publication
- Adaptive Chinese Word Segmentation
  
  Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
  
  July 2004
  
  Publication Access
- Dependence Language Model for Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
  
  July 2004
  
  Publication
- Introduction to the Special Issue on Statistical Language Modeling
  
  Jianfeng Gao, Chin-Yew Lin
  
  ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
  
  Publication Publication
- Capturing Long Distance Dependency in Language Modeling: An Empirical Study
  
  Jianfeng Gao, Hisami Suzuki
  
  International Conference on Natural Language Processing | May 2004
  
  Publication Publication
- Mining Web Logs for Actionable Knowledge
  
  Qiang Yang, Charles X. Ling, Jianfeng Gao
  
  Intelligent Technologies for Information Analysis | Published by Springer | 2004
  
  Publication
- The Use of SVM for Chinese New Word Identification
  
  Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
  
  March 2004
  
  Publication
- Linear Discriminant Model for Information Retrieval
  
  Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
  
  January 2004
  
  Publication Publication
- Improved Source-Channel Models for Chinese Word Segmentation
  
  Jianfeng Gao, Mu Li, Chang-Ning Huang
  
  July 2003
  
  Publication Publication
- Unsupervised Learning of Dependency Structure for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki
  
  July 2003
  
  Publication Publication
- Exploiting Headword Dependency and Predictive Clustering for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Yang Wen
  
  Proceedings for EMNLP | July 2002
  
  Publication
- Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
  
  Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
  
  SIGIR | May 2002
  
  Publication Publication
- Exploring Asymmetric Clustering for Statistical Language Modeling
  
  Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
  
  ACL | May 2002
  
  Publication
- NTCIR-3 CLIR Experiments at MSRA
  
  Hongzhao He, Jianfeng Gao
  
  May 2002
  
  Publication
- Improving Encarta Search Engine Performance by Mining User Logs
  
  Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
  
  International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
  
  Publication
- Improving Query Translation for CLIR Using Statistical Models
  
  Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
  
  SIGIR'01, New Orleans, Lousiana, USA | September 2001
  
  Publication
- TREC-10 Web Track Experiments at MSRNCN
  
  Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
  
  TREC-10 | May 2001
  
  Publication
- Improving the Effectiveness of Information Retrieval with Clustering and Fusion
  
  Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
  
  Publication
- The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
  
  Jianfeng Gao, Joshua Goodman, Jiangbo Miao
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
  
  Publication
- Distribution-based Pruning of Backoff Language Models
  
  Jianfeng Gao, Kai-Fu Lee
  
  October 2000
  
  Publication Publication
- Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
  
  Jian Zhang, Jianfeng Gao, Zhou Ming
  
  October 2000
  
  Publication Publication
- Language Model Compression by Predictive Clustering
  
  Joshua Goodman, Jianfeng Gao
  
  October 2000
  
  Publication
- Language Model Size Reduction by Pruning and Clustering
  
  Jianfeng Gao, Joshua Goodman
  
  Proceedings International Conference on Spoken Language Processing | October 2000
  
  Publication
- Lexicon Optimization for Chinese Language Modeling
  
  Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
  
  October 2000
  
  Publication
- N-gram Distribution Based Language Model Adaptation
  
  Jianfeng Gao, Mingjing Li, Kai-Fu Lee
  
  October 2000
  
  Publication
- PENS: A Machine-aided English Writing System for Chinese Users
  
  Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
  
  October 2000
  
  Publication Publication
- On the Use of Words and N-grams for Chinese Information Retrieval
  
  Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
  
  September 2000
  
  Publication
- A Unified Approach to Statistical Language Modeling for Chinese
  
  Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
  
  June 2000
  
  Publication
- TREC-9 CLIR experiments at MSRCN
  
  Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
  
  TREC-9 | April 2000
  
  Publication
- Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
  
  Joshua Goodman, Jianfeng Gao
  
  April 1999
  
  PhD Thesis: Shanghai Jiaotong University | April 1999
  
  Publication

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Adapting Web Agents with Synthetic Supervision
  
  Zhaoyang Wang, Yiming Liang, Xuchao Zhang, Qianhui Wu, Siwei Han, Anson Bastos, Rujia Wang, Chetan Bansal, Baolin Peng, Jianfeng Gao, Saravan Rajmohan, Huaxiu Yao
  
  November 2025
  
  Publication Project
- Interpretable Next-token Prediction via the Generalized Induction Head
  
  Eunji Kim, Sriya Mantena, Weiwei Yang, Chandan Singh, Sungroh Yoon, Jianfeng Gao
  
  NeurIPS 2025 | October 2025
  
  Publication
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
  
  Yucheng Li, Huiqiang Jiang, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICML 2025 | July 2025
  
  Preprint Github Project
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
  
  Qianhui Wu, Kanzhi Cheng, Rui Yang, Chaoyun Zhang, Jianwei Yang, Huiqiang Jiang, Jian Mu, Baolin Peng, Bo Qiao, Reuben Tan, Si Qin, Lars Liden, Qingwei Lin 林庆维, Huan Zhang, Tong Zhang, Jianbing Zhang, Dongmei Zhang, Jianfeng Gao
  
  NeurIPS 2025 | June 2025
  
  Publication Project Project
- Training Language Models to Generate Quality Code with Program Analysis Feedback
  
  Feng Yao, Zilong Wang, Liyuan Liu, Junxia Cui, Li Zhong, Xiaohan Fu, Haohui Mai, Vish Krishnan, Jianfeng Gao, Jingbo Shang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Text Generation Beyond Discrete Token Sampling
  
  Yufan Zhuang, Liyuan Liu, Chandan Singh, Jingbo Shang, Jianfeng Gao
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
  
  Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
  
  CHI 2025 | April 2025
  
  Publication Video Video Access
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Project
- Magma: A Foundation Model for Multimodal AI Agents
  
  Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
  
  February 2025
  
  Publication Video Access
- Simplifying DINO via Coding Rate Regularization
  
  Ziyang Wu, Jingyuan Zhang, Druv Pai, XuDong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
  
  ICML 2025 | February 2025
  
  DOI Publication Publication
- LLaVA-Rad MIMIC-CXR Annotations
  
  Juan Manuel Zambrano Chaves (juanza), Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Akshay Chaudhari, Serena Yeung, Curtis Langlotz, Sheng Wang, Hoifung Poon
  
  January 2025
  
  Publication
- Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
  
  Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  NeurIPS 2024 | December 2024
  
  DOI Publication Publication
- SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  
  Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICLR 2025 | December 2024
  
  Preprint Github Project
- Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
  
  Jitesh Jain, Zhengyuan Yang, Humphrey Shi, Jianfeng Gao, Jianwei Yang
  
  NeurIPS 2025 | December 2024
  
  Publication
- Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
  
  Paul Smolensky, Jianfeng Gao, Roland Fernandez
  
  2024 Neural Information Processing Systems | December 2024
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Access
- DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
  
  Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
  
  2024 Neural Information Processing Systems | October 2024
  
  Publication
- Crafting Interpretable Embeddings by Asking LLMs Questions
  
  Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
  
  NeurIPS 2024 | May 2024
  
  DOI Publication Publication
- A whole-slide foundation model for digital pathology from real-world data
  
  Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
  
  Nature | May 2024
  
  Publication DOI Publication
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
  
  Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
  
  Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
  
  Publication Project Project
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
  
  Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
  
  March 2024
  
  Publication
- Agent AI Towards a Holistic Intelligence
  
  Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
  
  arXiv: 2403.00833 | February 2024
  
  Publication Publication Project
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- TrustLLM: Trustworthiness in Large Language Models
  
  Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
  
  ICML 2024 | January 2024
  
  DOI Publication Publication
- MindAgent: Emergent Gaming Interaction
  
  Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
  
  Processings of NAACL 2024 | January 2024
  
  Publication Project Project
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Bridging Discrete and Backpropagation: Straight-Through and Beyond
  
  Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
  
  NeurIPS 2023 (Oral) | December 2023
  
  Publication Github
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Tree Prompting: Efficient Task Adaptation without Fine-Tuning
  
  Chandan Singh, Jianfeng Gao
  
  EMNLP | November 2023
  
  Publication
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
  
  Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
  
  Proceedings of NeurIPS 2023 | October 2023
  
  Publication Project
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Multimodal Foundation Models: From Specialists to General-Purpose Assistants
  
  Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
  
  September 2023
  
  118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
  
  Publication Project
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  
  Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
  
  ACL | May 2023
  
  Publication Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Instruction Tuning with GPT-4
  
  Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
  
  MSR-TR-2023-35 | April 2023
  
  Published by Microsoft
  
  Project Page: https://instruction-tuning-with-gpt-4.github.io/
  
  Publication Project
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Efficient Long Sequence Modeling via State Space Augmented Transformer
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
  
  December 2022
  
  Preprint
  
  Publication Github
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
  
  Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  EMNLP | December 2022
  
  Publication Project
- AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
  
  Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2022 | December 2022
  
  Publication Publication Project Project
- Fault-Aware Neural Code Rankers
  
  Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
  
  NeurIPS 2022 | November 2022
  
  Publication Publication Project
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication Project
- Explaining Patterns in Data with Language Models via Interpretable Autoprompting
  
  Chandan Singh, Jyoti Aneja, Jianfeng Gao
  
  October 2022
  
  Publication Github Project
- Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
  
  Chandan Singh, Jianfeng Gao
  
  September 2022
  
  Publication Github
- Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
  
  Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
  
  ArXiv | August 2022, Vol abs/2208.06061
  
  DOI Publication
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication Project
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication Project
- OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
  
  Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
  
  June 2022
  
  Publication Project
- Unified Contrastive Learning in Image-Text-Label Space
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
  
  Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
  
  May 2022
  
  Publication Github Project
- VLC: Training Vision-Language Transformers from Captions
  
  Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  Proceedings of Transactions on Machine Learning Research | May 2022
  
  Publication Project Project
- Neurocompositional computing in human and machine intelligence: A tutorial
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
  
  MSR-TR-2022-5 | May 2022
  
  Published by Microsoft
  
  52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
  
  Project
- Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
  
  AI Mag. | May 2022, Vol 43: pp. 308-322
  
  Publication Project
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication Project
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
  
  Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
  
  NeurIPS (Datasets and Benchmarks Track) | April 2022
  
  Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
  
  Publication
- METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
  
  Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
  
  April 2022
  
  arXiv:2204.06644
  
  Publication
- Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
  
  Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | April 2022
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
  
  Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  NAACL 2022 | April 2022
  
  Publication Github Project Project
- FocalNet: Focal Modulation Networks
  
  Jianwei Yang, Chunyuan Li, Jianfeng Gao
  
  2022 Neural Information Processing Systems | March 2022
  
  Publication
- Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
  
  Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
  
  NeurIPS 2021 | March 2022
  
  PDF Publication Github
- KAT: A Knowledge Augmented Transformer for Vision-and-Language
  
  Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  NAACL 2022. Long paper, Oral. | January 2022
  
  No.1 of OK-VQA Leaderboard (2021).
  
  Publication Project
- Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
  
  Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
  
  NAACL 2022 | December 2021
  
  Publication
- ValueNet: A New Dataset for Human Value Driven Dialogue System
  
  Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
  
  AAAI 2022 | December 2021
  
  Publication
- RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  AAAI 2022 | December 2021
  
  Publication
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
  
  Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Focal Attention for Long-Range Interactions in Vision Transformers
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Preprint Github
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- Taming Sparsely Activated Transformer with Stochastic Experts.
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
  
  October 2021
  
  Publication Publication
- Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
  
  Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication Github
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Go-Figure: A Meta Evaluation of Factuality in Summarization
  
  Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Preprint Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- KB-VLP: Knowledge Based Vision and Language Pretraining
  
  Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
  
  Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
  
  Publication Project
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication Project
- Targeted Adversarial Training for Natural Language Understanding
  
  Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
  
  NAACL | June 2021
  
  Publication Github
- Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
  
  Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
  
  North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
  
  Publication
- Compositional Processing Emerges in Neural Networks Solving Math Problems
  
  Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
  
  CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
  
  Publication Publication Project
- DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
  
  Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
  
  2021 International Conference on Learning Representations | May 2021
  
  Under review
  
  PDF Publication Github Project Project
- Joint Retrieval and Generation Training for Grounded Text Generation
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  May 2021
  
  Publication
- Text Editing by Command
  
  Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
  
  NAACL | April 2021
  
  PDF Publication
- Contrastive Multi-document Question Generation
  
  Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
  
  European Chapter of the Association for Computational Linguistics (EACL) | April 2021
  
  PDF Publication Project
- SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
  
  Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
  
  Transactions of the Association for Computational Linguistics | April 2021
  
  PDF Video Github
- Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
  
  Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
  
  AAAI 2021 | April 2021
  
  Publication
- Multi-domain Task-oriented Dialog Challenge II at DSTC9
  
  Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
  
  AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project Project
- A Controllable Model of Grounded Response Generation
  
  Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
  
  AAAI 2021 | January 2021
  
  PDF Publication Publication
- Reader-Guided Passage Reranking for Open-Domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Self-supervised Pre-training with Hard Examples Improves Visual Representations.
  
  Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
  
  December 2020
  
  Publication
- Learning Inference Rules with Neural TP-Reasoner
  
  Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, workshop | December 2020
  
  Publication Project Project
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication Project
- Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
  
  Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
  
  ArXiv | November 2020, Vol abs/2011.09530
  
  Publication
- CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
  
  Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
  
  MSR-TR-2020-49 | November 2020
  
  Published by Microsoft
  
  The participation report of our top non-manual entry in TREC COVID Round 2.
  
  PDF Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
  
  Publication Publication Project
- HittER: Hierarchical Transformers for Knowledge Graph Embeddings
  
  Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
  
  EMNLP 2021 | August 2020
  
  Publication Github
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project Project
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
  
  Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  37th International Conference on Machine Learning (ICML 2020) | July 2020
  
  Publication Github Project
- MIND: A Large-scale Dataset for News Recommendation
  
  Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
  
  ACL 2020 | July 2020
  
  Publication Access
- Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  ICML 2020 | July 2020
  
  Publication Project Project
- Few-Shot Generative Conversational Query Rewriting
  
  Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
  
  SIGIR 2020 | June 2020
  
  Best Short Paper Award
  
  PDF
- Novel Human-Object Interaction Detection via Adversarial Domain Generalization
  
  Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
  
  May 2020
  
  Publication
- Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
  
  Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
  
  CVPR 2020 | April 2020
  
  Publication Github
- Feature Quantization Improves GAN Training
  
  Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
  
  April 2020
  
  Publication Github
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
  
  Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
  
  April 2020
  
  Publication Project
- RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
  
  Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Github
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
  
  Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
  
  ACL 2020 Demo | April 2020
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II
  
  Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
  
  The Ninth Dialog System Technology Challenge | March 2020
  
  PDF Project
- Vision-Language Navigation Policy Learning and Adaptation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
  
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
  
  Publication Publication Project Project
- Unified Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
  
  Publication
- Results of the Multi-Domain Task-Completion Dialog Challenge
  
  Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
  
  Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
  
  PDF Project
- Complementary Auxiliary Classifiers for Label-Conditional Text Generation
  
  Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
  
  AAAI 2020 | February 2020
  
  Publication
- Uniﬁed Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI | February 2020
  
  Publication Project Project
- Unified Language Model Pre-training for Natural Language Understanding and Generation
  
  Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
  
  Publication Github Project
- Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
  
  Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
  
  Publication PDF
- TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
  
  Best Paper Award at KR2ML Workshop in NeurIPS 2019.
  
  Publication PDF Project Project
- DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
  
  Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
  
  arXiv:1911.00536 | November 2019
  
  PDF Project Project
- HUBERT Untangles BERT to Improve Transfer across NLP Tasks
  
  Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
  
  arxiv | October 2019
  
  https://arxiv.org/abs/1910.12647
  
  Publication
- Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
  
  Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
  
  September 2019
  
  * Equal contributions
  
  Publication
- Structuring Latent Spaces for Stylized Response Generation
  
  Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  EMNLP-IJCNLP 2019 | September 2019
  
  Publication Project Project
- DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
  
  Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
  
  BioNLP 2019 | August 2019
  
  PDF
- Efficient Navigation with Language Pre-training and Stochastic Sampling
  
  xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
  
  EMNLP-IJCNLP | August 2019
  
  DOI
- Budgeted Policy Learning for Task-Oriented Dialogue Systems
  
  Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
  
  ACL 2019 | July 2019
  
  Publication Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  ACL | July 2019
  
  PDF Publication Github Project Project
- Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
  
  Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
  
  Association for Computational Linguistics 2019 | July 2019
  
  Publication Project
- Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
  
  Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
  
  ACL 2019 | July 2019
  
  Publication
- Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
  
  Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
  
  CVPR 2019 | June 2019
  
  Oral
  
  Publication
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  ACL 2019 | June 2019
  
  Publication Project
- Consistent Dialogue Generation with Self-supervised Feature Learning
  
  Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  preprint | March 2019
  
  Publication
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Jointly Optimizing Diversity and Relevance in Neural Response Generation
  
  Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  NAACL-HLT 2019 | March 2019
  
  Publication Project
- Object-driven Text-to-Image Synthesis via Adversarial Training
  
  Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
  
  CVPR 2019 | February 2019
  
  PDF Publication Project
- Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
  
  Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
  
  NAACL 2019 | February 2019
  
  PDF
- Neural Approaches to Conversational AI
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  Foundations and Trends in Information Retrieval | February 2019
  
  Publication Project Project Project Project Project
- Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
  
  Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
  
  AAAI 2019 | January 2019
  
  Publication Project
- Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
  
  Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
  
  AAAI 2019 | January 2019
  
  Publication Project
- The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
  
  Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
  
  MSR-TR-2018-42 | December 2018
  
  Published by Microsoft
  
  Publication Project Project
- Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
  
  Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
  
  NeurIPS 2018 | December 2018
  
  Publication Project Project Project
- Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
  
  Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
  
  NIPS 2018 | December 2018
  
  Publication
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  NIPS 2018 | December 2018
  
  Publication
- Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
  
  Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
  
  EMNLP 2018 | October 2018
  
  Publication Publication Project Project
- Subgoal Discovery for Hierarchical Dialogue Policy Learning
  
  Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
  
  EMNLP 2018 | October 2018
  
  Publication Project Project Project
- Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
  
  Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
  
  SLT 2018 | July 2018
  
  Publication Project
- Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  ACL and SIGIR tutorial | July 2018
  
  ACL and SIGIR tutorial
  
  Publication Project
- Discourse-Aware Neural Rewards for Coherent Text Generation
  
  Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
  
  2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
  
  Publication
- Link Prediction using Embedded Knowledge Graphs
  
  Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
  
  arXiv | April 2018
  
  Publication Publication Project
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
  
  ICASSP 2018 | April 2018
  
  Publication Project
- Dynamic Fusion Networks for Machine Reading Comprehension
  
  Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
  
  February 2018
  
  PDF Github
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  February 2018
  
  arXiv preprint
  
  Publication
- BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
  
  Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
  
  AAAI 2018 | February 2018
  
  Publication Publication Project
- Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
  
  ACL 2018 | January 2018
  
  Publication Publication Project
- Language-Based Image Editing with Recurrent Attentive Models
  
  Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
  
  MSR-TR-2017-50 | December 2017
  
  The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  
  Publication Project
- Stochastic Answer Networks for Machine Reading Comprehension
  
  Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
  
  MSR-TR-2017-51 | December 2017
  
  Publication Project
- The MSR-NLP System at Dialog System Technology Challenges 6
  
  Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
  
  Dialog System Technology Challenges (DSTC) | November 2017
  
  Publication Project
- End-to-End Task-Completion Neural Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  the 8th International Joint Conference on Natural Language Processing | November 2017
  
  Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
  
  Publication Publication Project
- ReasoNet: Learning to Stop Reading in Machine Comprehension
  
  Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
  
  23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
  
  Publication Publication Project
- Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
  
  Publication Publication Project
- Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
  
  Jianfeng Gao
  
  MSR-TR-2017-36 | July 2017
  
  Publication Project Project Project Project
- StyleNet: Generating Attractive Visual Captions with Styles
  
  Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
  
  Publication
- Semantic Compositional Networks for Visual Captioning
  
  Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
  
  Publication Publication
- A Nested Attention Neural Hybrid Model for Grammatical Error Correction
  
  Jianfeng Gao
  
  ACL 2017 | July 2017
  
  Publication
- Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  March 2017
  
  Publication Project
- End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
  
  Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
  
  The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
  
  Publication Project
- Character-level Deep Conflation for Business Data Analytics
  
  Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
  
  ICASSP 2017 | February 2017
  
  Publication Publication Project
- A User Simulator for Task-Completion Dialogues
  
  Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
  
  December 2016, pp. 14
  
  Publication Project
- Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
  
  Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  December 2016
  
  Publication
- MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
  
  Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
  
  November 2016
  
  Publication Publication Access Project Project Project
- TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
  
  Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
  
  November 2016
  
  Publication Publication
- Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
  
  Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
  
  EMNLP 2016 | November 2016
  
  Publication Publication
- Bi-directional Attention with Agreement for Dependency Parsing
  
  Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
  
  EMNLP | November 2016
  
  Publication Publication
- Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
  
  Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  MSR-TR-2016-61 | September 2016
  
  arXiv:1609.03286
  
  Publication
- End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-63 | September 2016
  
  Publication Project
- Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
  
  Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-62 | August 2016
  
  arXiv:1608.05081
  
  Publication Project
- Deep Reinforcement Learning with a Natural Language Action Space
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
  
  Publication
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
  
  Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
  
  ECCV 2016 | August 2016
  
  Publication Publication
- Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  IJCAI 2016 | July 2016
  
  Publication
- A Proposal for Evaluating Answer Distillation from Web Data
  
  Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
  
  Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
  
  PDF PDF
- Stacked Attention Networks for Image Question Answering
  
  Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
  
  CVPR 2016 | June 2016
  
  Publication Publication Project
- Deep Reinforcement Learning for Dialogue Generation
  
  Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
  
  Proc. of EMNLP | June 2016
  
  Publication Publication Project Project
- Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
  
  Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication Project
- End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
  
  Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication
- A Persona-Based Neural Conversation Model
  
  Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | June 2016
  
  Publication Publication Project Project Project Project
- Reasoning in Vector Space: An Exploratory Study of Question Answering
  
  Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
  
  Publication
- A Diversity-Promoting Objective Function for Neural Conversation Models
  
  Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  Proc. of NAACL-HLT | March 2016
  
  Publication Publication Project Project Project Project
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
  
  Publication Publication
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
  
  Publication Publication Project
- Basic Reasoning with Tensor Product Representations
  
  Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
  
  January 2016
  
  Publication
- End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
  
  Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
  
  NIPS | December 2015
  
  Publication
- Deep Reinforcement Learning with an Action Space Defined by Natural Language
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  ICML 2016 | November 2015
  
  PDF Publication
- Recurrent Reinforcement Learning: A Hybrid Approach
  
  Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
  
  MSR-TR-2015-98 | September 2015
  
  Proceedings of COLING-94, Kyoto, Japan
  
  Publication
- Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
  
  Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
  
  Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
  
  Outstanding Paper Award
  
  Publication Publication Project Project
- ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
  
  Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | July 2015
  
  Publication Publication Project Project
- A Deep Embedding Model for Co-occurrence Learning
  
  Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
  
  June 2015
  
  Publication
- From Captions to Visual Concepts and Back
  
  Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
  
  CVPR 2015 | June 2015
  
  Tied for 1st Prize
  
  Publication Project Project
- A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
  
  Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
  
  Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
  
  Publication Publication Access Project Project Project
- Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  May 2015
  
  Publication
- Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
  
  Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
  
  May 2015
  
  Publication
- Embedding Entities and Relations for Learning and Inference in Knowledge Bases
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
  
  Publication Publication Project
- Deep Learning for Web Search and Natural Language Processing
  
  Jianfeng Gao, Xiaodong He, Li Deng
  
  MSR-TR-2015-7 | January 2015
  
  Publication
- Learning Multi-Relational Semantics Using Neural-Embedding Models
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  NIPS 2014 workshop on Learning Semantics | December 2014
  
  Publication Publication
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  CIKM | November 2014
  
  Publication Project
- Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  CIKM | November 2014
  
  Publication
- Modeling Interestingness with Deep Neural Networks
  
  Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
  
  MSR-TR-2014-56 | October 2014
  
  Publication Project
- Large-scale Expected BLEU Training of Phrase-based Reordering Models
  
  Michael Auli, Michel Galley, Jianfeng Gao
  
  Proc. of EMNLP | October 2014
  
  Publication
- Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
  
  Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
  
  MSR-TR-2014-109 | August 2014
  
  Publication
- Online Classification Using a Voted RDA Method
  
  Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
  
  Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
  
  Publication
- Learning Continuous Phrase Representations for Translation Modeling
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  Proceedings of ACL | June 2014
  
  Publication
- Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
  
  Publication
- Minimum Translation Modeling with Recurrent Neural Networks
  
  Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
  
  April 2014
  
  Publication
- Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
  
  Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
  
  October 2013
  
  Publication Publication Project
- Learning Semantic Representations for the Phrase Translation Model
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  MSR-TR-2013-88 | September 2013
  
  Publication
- Deep Stacking Networks for Information Retrieval
  
  Li Deng, Xiaodong He, Jianfeng Gao
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- MSR SPLAT, A Language Analysis Toolkit
  
  Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
  
  Proceedings of NAACL-HLT 2012 | June 2012
  
  Publication
- Adapting Bboosting for Information Retrieval Measures
  
  Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
  
  Information Retrieval | June 2010, Vol 13: pp. 254-270
  
  Publication
- Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
  
  Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
  
  Computational Linguistics | June 2005, Vol 31(4): pp. 44
  
  Publication
- Introduction to the Special Issue on Statistical Language Modeling
  
  Jianfeng Gao, Chin-Yew Lin
  
  ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
  
  Publication Publication
- GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
  
  Qianhui Wu, Kanzhi Cheng, Rui Yang, Chaoyun Zhang, Jianwei Yang, Huiqiang Jiang, Jian Mu, Baolin Peng, Bo Qiao, Reuben Tan, Si Qin, Lars Liden, Qingwei Lin 林庆维, Huan Zhang, Tong Zhang, Jianbing Zhang, Dongmei Zhang, Jianfeng Gao
  
  NeurIPS 2025 | June 2025
  
  Publication Project Project
- Magma: A Foundation Model for Multimodal AI Agents
  
  Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
  
  February 2025
  
  Publication Video Access
- Simplifying DINO via Coding Rate Regularization
  
  Ziyang Wu, Jingyuan Zhang, Druv Pai, XuDong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
  
  ICML 2025 | February 2025
  
  DOI Publication Publication
- LLaVA-Rad MIMIC-CXR Annotations
  
  Juan Manuel Zambrano Chaves (juanza), Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Akshay Chaudhari, Serena Yeung, Curtis Langlotz, Sheng Wang, Hoifung Poon
  
  January 2025
  
  Publication
- Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
  
  Jitesh Jain, Zhengyuan Yang, Humphrey Shi, Jianfeng Gao, Jianwei Yang
  
  NeurIPS 2025 | December 2024
  
  Publication
- BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
  
  Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
  
  June 2024
  
  DOI Video
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
  
  Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
  
  March 2024
  
  Publication
- Agent AI Towards a Holistic Intelligence
  
  Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
  
  arXiv: 2403.00833 | February 2024
  
  Publication Publication Project
- BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
  
  Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
  
  January 2024
  
  Publication
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Bridging Discrete and Backpropagation: Straight-Through and Beyond
  
  Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
  
  NeurIPS 2023 (Oral) | December 2023
  
  Publication Github
- Visual In-Context Prompting
  
  Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
  
  CVPR 2024 | November 2023
  
  DOI Publication Publication
- BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
  
  Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
  
  October 2023
  
  Publication
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Instruction Tuning with GPT-4
  
  Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
  
  MSR-TR-2023-35 | April 2023
  
  Published by Microsoft
  
  Project Page: https://instruction-tuning-with-gpt-4.github.io/
  
  Publication Project
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication Project
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication Project
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication Project
- Unified Contrastive Learning in Image-Text-Label Space
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- VLC: Training Vision-Language Transformers from Captions
  
  Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  Proceedings of Transactions on Machine Learning Research | May 2022
  
  Publication Project Project
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication Project
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
  
  Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
  
  NeurIPS (Datasets and Benchmarks Track) | April 2022
  
  Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
  
  Publication
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- FocalNet: Focal Modulation Networks
  
  Jianwei Yang, Chunyuan Li, Jianfeng Gao
  
  2022 Neural Information Processing Systems | March 2022
  
  Publication
- KAT: A Knowledge Augmented Transformer for Vision-and-Language
  
  Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  NAACL 2022. Long paper, Oral. | January 2022
  
  No.1 of OK-VQA Leaderboard (2021).
  
  Publication Project
- Focal Attention for Long-Range Interactions in Vision Transformers
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Preprint Github
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
  
  Jianwei Yang, Yonatan Bisk, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication
- Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
  
  Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication Github
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication Project
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication Project
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project Project
- Self-supervised Pre-training with Hard Examples Improves Visual Representations.
  
  Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
  
  December 2020
  
  Publication
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication Project
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project Project
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- Unified Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
  
  Publication
- Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
  
  Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
  
  September 2019
  
  * Equal contributions
  
  Publication
- Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
  
  Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
  
  CVPR 2019 | June 2019
  
  Oral
  
  Publication
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- StoryGAN: A Sequential Conditional GAN for Story Visualization
  
  Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
  
  CVPR 2019 | April 2019
  
  PDF Publication
- Object-driven Text-to-Image Synthesis via Adversarial Training
  
  Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
  
  CVPR 2019 | February 2019
  
  PDF Publication Project
- StyleNet: Generating Attractive Visual Captions with Styles
  
  Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
  
  Publication
- Semantic Compositional Networks for Visual Captioning
  
  Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
  
  Publication Publication
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
  
  Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
  
  ECCV 2016 | August 2016
  
  Publication Publication
- From Captions to Visual Concepts and Back
  
  Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
  
  CVPR 2015 | June 2015
  
  Tied for 1st Prize
  
  Publication Project Project
- The MSRA Machine Translation System for IWSLT-2010
  
  Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
  
  Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
  
  Publication
- An Information-Theoretic Approach to Automatic Evaluation of Summaries
  
  Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  August 2005
  
  Publication Publication
- Distribution-based Pruning of Backoff Language Models
  
  Jianfeng Gao, Kai-Fu Lee
  
  October 2000
  
  Publication Publication
- PENS: A Machine-aided English Writing System for Chinese Users
  
  Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
  
  October 2000
  
  Publication Publication
- N-gram Distribution Based Language Model Adaptation
  
  Jianfeng Gao, Mingjing Li, Kai-Fu Lee
  
  October 2000
  
  Publication
- Language Model Compression by Predictive Clustering
  
  Joshua Goodman, Jianfeng Gao
  
  October 2000
  
  Publication
- Lexicon Optimization for Chinese Language Modeling
  
  Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
  
  October 2000
  
  Publication
- Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
  
  Jian Zhang, Jianfeng Gao, Zhou Ming
  
  October 2000
  
  Publication Publication
- Language Model Size Reduction by Pruning and Clustering
  
  Jianfeng Gao, Joshua Goodman
  
  Proceedings International Conference on Spoken Language Processing | October 2000
  
  Publication
- On the Use of Words and N-grams for Chinese Information Retrieval
  
  Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
  
  September 2000
  
  Publication
- A Unified Approach to Statistical Language Modeling for Chinese
  
  Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
  
  June 2000
  
  Publication
- MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
  
  Yucheng Li, Huiqiang Jiang, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICML 2025 | July 2025
  
  Preprint Github Project
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
  
  Qianhui Wu, Kanzhi Cheng, Rui Yang, Chaoyun Zhang, Jianwei Yang, Huiqiang Jiang, Jian Mu, Baolin Peng, Bo Qiao, Reuben Tan, Si Qin, Lars Liden, Qingwei Lin 林庆维, Huan Zhang, Tong Zhang, Jianbing Zhang, Dongmei Zhang, Jianfeng Gao
  
  NeurIPS 2025 | June 2025
  
  Publication Project Project
- SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  
  Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICLR 2025 | December 2024
  
  Preprint Github Project
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Access
- LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
  
  Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
  
  Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
  
  Publication Project Project
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- MindAgent: Emergent Gaming Interaction
  
  Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
  
  Processings of NAACL 2024 | January 2024
  
  Publication Project Project
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  
  Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
  
  ACL | May 2023
  
  Publication Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Neural Approaches to Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
  
  Published by Springer | March 2023, Vol 44
  
  ISBN: 978-3-031-23079-0
  
  The Information Retrieval Series.
  
  Preprint
- Efficient Long Sequence Modeling via State Space Augmented Transformer
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
  
  December 2022
  
  Preprint
  
  Publication Github
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
  
  Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  EMNLP | December 2022
  
  Publication Project
- AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
  
  Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2022 | December 2022
  
  Publication Publication Project Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication Project
- OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
  
  Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
  
  June 2022
  
  Publication Project
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
  
  Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
  
  May 2022
  
  Publication Github Project
- VLC: Training Vision-Language Transformers from Captions
  
  Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  Proceedings of Transactions on Machine Learning Research | May 2022
  
  Publication Project Project
- Neurocompositional computing in human and machine intelligence: A tutorial
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
  
  MSR-TR-2022-5 | May 2022
  
  Published by Microsoft
  
  52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
  
  Project
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
  
  Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
  
  April 2022
  
  arXiv:2204.06644
  
  Publication
- Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
  
  Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | April 2022
  
  Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
  
  Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  NAACL 2022 | April 2022
  
  Publication Github Project Project
- KAT: A Knowledge Augmented Transformer for Vision-and-Language
  
  Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  NAACL 2022. Long paper, Oral. | January 2022
  
  No.1 of OK-VQA Leaderboard (2021).
  
  Publication Project
- Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
  
  Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
  
  NAACL 2022 | December 2021
  
  Publication
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
  
  Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- Taming Sparsely Activated Transformer with Stochastic Experts.
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
  
  October 2021
  
  Publication Publication
- Very Deep Transformers for Neural Machine Translation
  
  Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
  
  October 2021
  
  Publication Github
- ARCH: Efficient Adversarial Regularized Training with Caching
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Go-Figure: A Meta Evaluation of Factuality in Summarization
  
  Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Preprint Publication
- KB-VLP: Knowledge Based Vision and Language Pretraining
  
  Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
  
  Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
  
  Publication Project
- XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
  
  Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | June 2021
  
  arXiv:2106.04563
  
  Publication Github Project Project
- Text Editing by Command
  
  Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
  
  NAACL | April 2021
  
  PDF Publication
- Token-wise Curriculum Learning for Neural Machine Translation
  
  Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | March 2021
  
  Publication
- A Controllable Model of Grounded Response Generation
  
  Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
  
  AAAI 2021 | January 2021
  
  PDF Publication Publication
- Reader-Guided Passage Reranking for Open-Domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Learning Inference Rules with Neural TP-Reasoner
  
  Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, workshop | December 2020
  
  Publication Project Project
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication Project
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
  
  Publication Publication Project
- Generation-Augmented Retrieval for Open-domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | September 2020
  
  Publication
- HittER: Hierarchical Transformers for Knowledge Graph Embeddings
  
  Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
  
  EMNLP 2021 | August 2020
  
  Publication Github
- MIND: A Large-scale Dataset for News Recommendation
  
  Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
  
  ACL 2020 | July 2020
  
  Publication Access
- Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  ICML 2020 | July 2020
  
  Publication Project Project
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
  
  Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
  
  April 2020
  
  Publication Project
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
  
  Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
  
  ACL 2020 Demo | April 2020
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II
  
  Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
  
  The Ninth Dialog System Technology Challenge | March 2020
  
  PDF Project
- Unified Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
  
  Publication
- Results of the Multi-Domain Task-Completion Dialog Challenge
  
  Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
  
  Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
  
  PDF Project
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
  
  Publication Publication
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  The third Conversational AI workshop, NeurIPS | December 2019
  
  Publication
- Unified Language Model Pre-training for Natural Language Understanding and Generation
  
  Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
  
  Publication Github Project
- TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
  
  Best Paper Award at KR2ML Workshop in NeurIPS 2019.
  
  Publication PDF Project Project
- TIGEr: Text-to-Image Grounding for Image Caption Evaluation
  
  Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
  
  Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
  
  Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
  
  arXiv:1911.00536 | November 2019
  
  PDF Project Project
- HUBERT Untangles BERT to Improve Transfer across NLP Tasks
  
  Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
  
  arxiv | October 2019
  
  https://arxiv.org/abs/1910.12647
  
  Publication
- Structuring Latent Spaces for Stylized Response Generation
  
  Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  EMNLP-IJCNLP 2019 | September 2019
  
  Publication Project Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  ACL | July 2019
  
  PDF Publication Github Project Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
  
  Publication
- Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
  
  Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
  
  Association for Computational Linguistics 2019 | July 2019
  
  Publication Project
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Neural Approaches to Conversational AI – Tutorial at ICML 2018
  
  Jianfeng Gao, Michel Galley
  
  ICML 2019 Tutorial | June 2019
  
  PDF
- Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
  
  Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
  
  Proc. of ACL | June 2019
  
  PDF Project Project
- Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  April 2019
  
  PDF Publication Github Project
- Consistent Dialogue Generation with Self-supervised Feature Learning
  
  Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  preprint | March 2019
  
  Publication
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Jointly Optimizing Diversity and Relevance in Neural Response Generation
  
  Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  NAACL-HLT 2019 | March 2019
  
  Publication Project
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  NIPS 2018 | December 2018
  
  Publication
- Deep dyna-q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
  
  Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
  
  Publication
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
  
  2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
  
  Publication
- A Knowledge-Grounded Neural Conversation Model
  
  Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
  
  AAAI | February 2018
  
  Publication Project Project Project
- The MSR-NLP System at Dialog System Technology Challenges 6
  
  Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
  
  Dialog System Technology Challenges (DSTC) | November 2017
  
  Publication Project
- Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
  
  Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
  
  IJCNLP | November 2017
  
  Publication Project
- Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
  
  Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
  
  IJCNLP | November 2017
  
  Publication Project Project Project
- End-to-End Task-Completion Neural Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  the 8th International Joint Conference on Natural Language Processing | November 2017
  
  Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
  
  Publication Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
  
  Publication
- A Nested Attention Neural Hybrid Model for Grammatical Error Correction
  
  Jianfeng Gao
  
  ACL 2017 | July 2017
  
  Publication
- End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
  
  Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
  
  The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
  
  Publication Project
- A User Simulator for Task-Completion Dialogues
  
  Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
  
  December 2016, pp. 14
  
  Publication Project
- Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
  
  Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  December 2016
  
  Publication
- Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
  
  Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
  
  EMNLP 2016 | November 2016
  
  Publication Publication
- Deep Reinforcement Learning with a Natural Language Action Space
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
  
  Publication
- Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  IJCAI 2016 | July 2016
  
  Publication
- Deep Reinforcement Learning for Dialogue Generation
  
  Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
  
  Proc. of EMNLP | June 2016
  
  Publication Publication Project Project
- Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
  
  Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication Project
- End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
  
  Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication
- A Persona-Based Neural Conversation Model
  
  Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | June 2016
  
  Publication Publication Project Project Project Project
- Reasoning in Vector Space: An Exploratory Study of Question Answering
  
  Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
  
  Publication
- A Diversity-Promoting Objective Function for Neural Conversation Models
  
  Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  Proc. of NAACL-HLT | March 2016
  
  Publication Publication Project Project Project Project
- Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
  
  Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
  
  Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
  
  Outstanding Paper Award
  
  Publication Publication Project Project
- ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
  
  Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | July 2015
  
  Publication Publication Project Project
- From Captions to Visual Concepts and Back
  
  Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
  
  CVPR 2015 | June 2015
  
  Tied for 1st Prize
  
  Publication Project Project
- A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
  
  Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
  
  Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
  
  Publication Publication Access Project Project Project
- Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  May 2015
  
  Publication
- Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
  
  Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
  
  May 2015
  
  Publication
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  CIKM | November 2014
  
  Publication Project
- Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  CIKM | November 2014
  
  Publication
- Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
  
  Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
  
  MSR-TR-2014-109 | August 2014
  
  Publication
- Learning Continuous Phrase Representations for Translation Modeling
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  Proceedings of ACL | June 2014
  
  Publication
- A Convolutional Latent Semantic Model for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  MSR-TR-2014-55 | April 2014
  
  Publication Publication
- Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
  
  Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
  
  October 2013
  
  Publication Publication Project
- Learning Semantic Representations for the Phrase Translation Model
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  MSR-TR-2013-88 | September 2013
  
  Publication
- A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
  
  Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
  
  MSR-TR-2013-89 | September 2013
  
  Publication
- Beyond Left-to-Right: Multiple Decomposition Structures for SMT
  
  Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
  
  NAACL | June 2013
  
  Publication
- Training MRF-Based Phrase Translation Models using Gradient Ascent
  
  Jianfeng Gao, Xiaodong He
  
  The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
  
  Publication
- End-To-End Learning of Parsing Models for Information Retrieval
  
  Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- MSR SPLAT, A Language Analysis Toolkit
  
  Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
  
  Proceedings of NAACL-HLT 2012 | June 2012
  
  Publication
- A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
  
  Hisami Suzuki, Jianfeng Gao
  
  Proceedings of EMNLP | May 2012
  
  Publication
- A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
  
  Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
  
  Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
  
  Publication
- Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
  
  Jianfeng Gao, Xiaodong He, Jian-Yun Nie
  
  CIKM | January 2010
  
  Publication
- Discovery of Term Variation in Japanese Web Search Queries
  
  Hisami Suzuki, Xiao Li, Jianfeng Gao
  
  Proceedings of EMNLP | August 2009
  
  Publication
- Smoothing Clickthrough Data for Web Search Ranking
  
  Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
  
  SIGIR | July 2009
  
  Publication
- Using Statistical Techniques and Web Search to Correct ESL Errors
  
  Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
  
  Calico Journal | June 2009, Vol 26(3)
  
  Publication
- Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
  
  Publication
- Ranking, Boosting, and Model Adaptation
  
  Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
  
  MSR-TR-2008-109 | October 2008
  
  Publication
- Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
  
  Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
  
  Proceedings of IJCNLP, Hyderabad, India | January 2008
  
  Publication Publication Project
- The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
  
  Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
  
  The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
  
  Publication
- MSRLM: a Scalable Language Modeling Toolkit
  
  Patrick Nguyen, Jianfeng Gao, Milind Mahajan
  
  MSR-TR-2007-144 | November 2007
  
  Publication
- Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
  
  Jianfeng Gao, Hisami Suzuki
  
  August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
  
  Tutorial slides at the MSR Weihai Summer School, August 2007
  
  Publication
- A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
  
  Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
  
  Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
  
  Publication
- A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
  
  Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
  
  ACL/SIGPARSE | April 2006
  
  Publication
- A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
  
  Jianfeng Gao, Hisami Suzuki, Wei Yuan
  
  Proceedings of EMNLP | April 2006
  
  Publication Publication
- A Supervised Learning Approach to Entity Search
  
  Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
  
  AIRS 2006 | January 2006
  
  Publication
- Approximation Lasso Methods for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Bin Yu
  
  Proceedings of ACL | January 2006
  
  Publication
- Microsoft Research IME Corpus
  
  Hisami Suzuki, Jianfeng Gao
  
  MSR-TR-2005-168 | December 2005
  
  Publication Access
- Automatic Acquisition of Chinese-English Parallel Corpus from the Web
  
  Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
  
  October 2005
  
  Publication
- An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
  
  Wei Yuan, Jianfeng Gao, Hisami Suzuki
  
  IJCNLP 2005, LNAI 3651 | February 2005
  
  Publication
- Adaptive Chinese Word Segmentation
  
  Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
  
  July 2004
  
  Publication Access
- Dependence Language Model for Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
  
  July 2004
  
  Publication
- Introduction to the Special Issue on Statistical Language Modeling
  
  Jianfeng Gao, Chin-Yew Lin
  
  ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
  
  Publication Publication
- Capturing Long Distance Dependency in Language Modeling: An Empirical Study
  
  Jianfeng Gao, Hisami Suzuki
  
  International Conference on Natural Language Processing | May 2004
  
  Publication Publication
- The Use of SVM for Chinese New Word Identification
  
  Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
  
  March 2004
  
  Publication
- Linear Discriminant Model for Information Retrieval
  
  Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
  
  January 2004
  
  Publication Publication
- Unsupervised Learning of Dependency Structure for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki
  
  July 2003
  
  Publication Publication
- Improved Source-Channel Models for Chinese Word Segmentation
  
  Jianfeng Gao, Mu Li, Chang-Ning Huang
  
  July 2003
  
  Publication Publication
- Exploiting Headword Dependency and Predictive Clustering for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Yang Wen
  
  Proceedings for EMNLP | July 2002
  
  Publication
- LLaVA-Rad MIMIC-CXR Annotations
  
  Juan Manuel Zambrano Chaves (juanza), Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Akshay Chaudhari, Serena Yeung, Curtis Langlotz, Sheng Wang, Hoifung Poon
  
  January 2025
  
  Publication
- Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
  
  Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  NeurIPS 2024 | December 2024
  
  DOI Publication Publication
- A whole-slide foundation model for digital pathology from real-world data
  
  Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
  
  Nature | May 2024
  
  Publication DOI Publication
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
  
  Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
  
  March 2024
  
  Publication
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Access
- DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
  
  Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
  
  BioNLP 2019 | August 2019
  
  PDF
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Targeted Adversarial Training for Natural Language Understanding
  
  Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
  
  NAACL | June 2021
  
  Publication Github
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
  
  Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
  
  CHI 2025 | April 2025
  
  Publication Video Video Access
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Project
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Access
- LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
  
  Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
  
  Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
  
  Publication Project Project
- Agent AI Towards a Holistic Intelligence
  
  Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
  
  arXiv: 2403.00833 | February 2024
  
  Publication Publication Project
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II at DSTC9
  
  Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
  
  AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
  
  Publication
- NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
  
  Publication Publication Project
- OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
  
  Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
  
  April 2020
  
  Publication Github
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
  
  Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
  
  ACL 2020 Demo | April 2020
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II
  
  Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
  
  The Ninth Dialog System Technology Challenge | March 2020
  
  PDF Project
- Results of the Multi-Domain Task-Completion Dialog Challenge
  
  Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
  
  Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
  
  PDF Project
- Structuring Latent Spaces for Stylized Response Generation
  
  Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  EMNLP-IJCNLP 2019 | September 2019
  
  Publication Project Project
- Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
  
  Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
  
  Association for Computational Linguistics 2019 | July 2019
  
  Publication Project
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Consistent Dialogue Generation with Self-supervised Feature Learning
  
  Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  preprint | March 2019
  
  Publication
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Jointly Optimizing Diversity and Relevance in Neural Response Generation
  
  Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  NAACL-HLT 2019 | March 2019
  
  Publication Project
- Modeling Interestingness with Deep Neural Networks
  
  Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
  
  MSR-TR-2014-56 | October 2014
  
  Publication Project
- Large-scale Expected BLEU Training of Phrase-based Reordering Models
  
  Michael Auli, Michel Galley, Jianfeng Gao
  
  Proc. of EMNLP | October 2014
  
  Publication
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- Neural Approaches to Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
  
  Published by Springer | March 2023, Vol 44
  
  ISBN: 978-3-031-23079-0
  
  The Information Retrieval Series.
  
  Preprint
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Contrastive Multi-document Question Generation
  
  Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
  
  European Chapter of the Association for Computational Linguistics (EACL) | April 2021
  
  PDF Publication Project
- CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
  
  Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
  
  MSR-TR-2020-49 | November 2020
  
  Published by Microsoft
  
  The participation report of our top non-manual entry in TREC COVID Round 2.
  
  PDF Publication
- Recent Advances in Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett
  
  SIGIR 2020 | July 2020
  
  Tutorial Slides
  
  Publication
- Few-Shot Generative Conversational Query Rewriting
  
  Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
  
  SIGIR 2020 | June 2020
  
  Best Short Paper Award
  
  PDF
- Systems and methods for automated query answer generation
  
  Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
  
  June 2018
  
  Publication Project Project
- Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
  
  Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
  
  SIGIR 16 | January 2017
  
  Publication
- A Proposal for Evaluating Answer Distillation from Web Data
  
  Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
  
  Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
  
  PDF PDF
- Learning Multi-Relational Semantics Using Neural-Embedding Models
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  NIPS 2014 workshop on Learning Semantics | December 2014
  
  Publication Publication
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  CIKM | November 2014
  
  Publication Project
- Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  CIKM | November 2014
  
  Publication
- Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
  
  Publication
- Learning Semantic Representations Using Convolutional Neural Networks for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  April 2014
  
  Publication Project
- Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
  
  Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
  
  October 2013
  
  Publication Publication Project
- Modeling Click-through Based Word-pairs for Web Search
  
  Jagadeesh Jagarlamudi, Jianfeng Gao
  
  August 2013
  
  Publication
- Query Expansion Using Path-constrained Random Walks
  
  Jianfeng Gao, Gu Xu, Jinxi Xu
  
  SIGIR 2013, Dublin, Ireland. | August 2013
  
  Publication
- Deep Stacking Networks for Information Retrieval
  
  Li Deng, Xiaodong He, Jianfeng Gao
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- Towards Concept-based Translation Models using Search Logs for Query Expansion
  
  Jianfeng Gao, Jian-Yun Nie
  
  November 2012
  
  Publication
- Combining Signals for Cross-Lingual Relevance Feedback
  
  Katrina Parton, Jianfeng Gao
  
  AIRS2012 | August 2012
  
  Publication
- Learning Lexicon Models from Search Logs for Query Expansion
  
  Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
  
  Proceedings of EMNLP | July 2012
  
  Publication
- Statistical Translation and Web Search Ranking
  
  Jianfeng Gao
  
  ACL/SIGIR Summer School | August 2011
  
  Publication
- Clickthrough-Based Latent Semantic Models for Web Search
  
  Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
  
  Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
  
  Publication
- Learning Phrase-Based Spelling Error Models from Clickthrough Data
  
  Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
  
  ACL 2010 | May 2010
  
  Publication
- Exploring Web Scale Language models for Search Query Processing
  
  Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
  
  Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
  
  Publication
- Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
  
  Jianfeng Gao, Xiaodong He, Jian-Yun Nie
  
  CIKM | January 2010
  
  Publication
- Selecting good expansion terms for pseudo-relevance feedback
  
  Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
  
  SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
  
  ISBN: 978-1-600558-164-4
  
  Publication
- Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
  
  Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
  
  In Proceedings of Coling | January 2008
  
  Publication
- A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  July 2007
  
  Publication
- A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
  
  Jianfeng Gao, Mark Johnson
  
  January 2007
  
  Publication
- Fault-Aware Neural Code Rankers
  
  Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
  
  NeurIPS 2022 | November 2022
  
  Publication Publication Project
- Interactive Code Generation via Test-Driven User-Intent Formalization
  
  Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
  
  August 2022
  
  Publication Project
- A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
  
  Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
  
  MSR-TR-2013-89 | September 2013
  
  Publication
- A Large Scale Ranker-Based System for Search Query Spelling Correction
  
  Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
  
  The 23rd International Conference on Computational Linguistics | August 2010
  
  Publication
- Improving Query Translation for CLIR Using Statistical Models
  
  Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
  
  SIGIR'01, New Orleans, Lousiana, USA | September 2001
  
  Publication
- TREC-10 Web Track Experiments at MSRNCN
  
  Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
  
  TREC-10 | May 2001
  
  Publication
- Improving the Effectiveness of Information Retrieval with Clustering and Fusion
  
  Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
  
  Publication
- The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
  
  Jianfeng Gao, Joshua Goodman, Jiangbo Miao
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
  
  Publication
- TREC-9 CLIR experiments at MSRCN
  
  Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
  
  TREC-9 | April 2000
  
  Publication
- Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
  
  Joshua Goodman, Jianfeng Gao
  
  April 1999
  
  PhD Thesis: Shanghai Jiaotong University | April 1999
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
  
  Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Github
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- StoryGAN: A Sequential Conditional GAN for Story Visualization
  
  Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
  
  CVPR 2019 | April 2019
  
  PDF Publication
- Semantic Compositional Networks for Visual Captioning
  
  Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
  
  Publication Publication
- A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
  
  Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
  
  MSR-TR-2013-89 | September 2013
  
  Publication
- Towards Concept-based Translation Models using Search Logs for Query Expansion
  
  Jianfeng Gao, Jian-Yun Nie
  
  November 2012
  
  Publication
- Combining Signals for Cross-Lingual Relevance Feedback
  
  Katrina Parton, Jianfeng Gao
  
  AIRS2012 | August 2012
  
  Publication
- A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
  
  Alex Cheng, Fei Xia, Jianfeng Gao
  
  Coling 2010 Organizing Committee | August 2010
  
  Publication
- Multi-Style Language Model for Web Scale Information Retrieval
  
  Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
  
  Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
  
  Publication
- Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
  
  Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
  
  EMNLP | August 2009
  
  Publication
- Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
  
  Publication
- A Web-based English Proofing System for English as a Second Language Users
  
  Xing Yi, Jianfeng Gao, Bill Dolan
  
  International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
  
  Publication
- Microsoft Research Treelet Translation System: NIST MT Evaluation 06
  
  Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
  
  MSR-TR-2007-144 | November 2007
  
  Publication Publication
- Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
  
  CIKM | January 2007
  
  Publication
- Scalable Training of L1-Regularized Log-Linear Models
  
  Galen Andrew, Jianfeng Gao
  
  International Conference on Machine Learning | January 2007
  
  Publication
- Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
  
  Jianfeng Gao, Jian-Yun Nie
  
  SIGIR | October 2006
  
  Publication
- Statistical Query Translation Models for Cross- Language Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Ming Zhou
  
  ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
  
  Publication
- Person Resolution in Person Search Results: WebHawk
  
  Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
  
  CIKM'05, Bremen, Germany | October 2005
  
  Publication
- Minimum Sample Risk Methods for Language Modeling
  
  Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
  
  HLT/EMNLP | October 2005
  
  Publication
- A DOM Tree Alignment Model for Mining Parallel Data from the Web
  
  Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
  
  COLING-ACL | January 2005
  
  Publication
- Introduction to the Special Issue on Statistical Language Modeling
  
  Jianfeng Gao, Chin-Yew Lin
  
  ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
  
  Publication Publication
- Mining Web Logs for Actionable Knowledge
  
  Qiang Yang, Charles X. Ling, Jianfeng Gao
  
  Intelligent Technologies for Information Analysis | Published by Springer | 2004
  
  Publication
- Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
  
  Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
  
  SIGIR | May 2002
  
  Publication Publication
- Exploring Asymmetric Clustering for Statistical Language Modeling
  
  Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
  
  ACL | May 2002
  
  Publication
- NTCIR-3 CLIR Experiments at MSRA
  
  Hongzhao He, Jianfeng Gao
  
  May 2002
  
  Publication
- Improving Encarta Search Engine Performance by Mining User Logs
  
  Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
  
  International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
  
  Publication
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
  
  Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
  
  NIPS 2018 | December 2018
  
  Publication
- Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
  
  Michael Auli, Jianfeng Gao
  
  June 2014
  
  Publication
- Domain Adaptation via Pseudo In-Domain Data Selection
  
  Amittai Axelrod, Xiaodong He, Jianfeng Gao
  
  EMNLP | July 2011
  
  Publication
- Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  EMNLP | January 2008
  
  Publication
- A Persona-Based Neural Conversation Model
  
  Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | June 2016
  
  Publication Publication Project Project Project Project

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Adapting Web Agents with Synthetic Supervision
  
  Zhaoyang Wang, Yiming Liang, Xuchao Zhang, Qianhui Wu, Siwei Han, Anson Bastos, Rujia Wang, Chetan Bansal, Baolin Peng, Jianfeng Gao, Saravan Rajmohan, Huaxiu Yao
  
  November 2025
  
  Publication Project
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- Magma: A Foundation Model for Multimodal AI Agents
  
  Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao
  
  February 2025
  
  Publication Video Access
- LLaVA-Rad MIMIC-CXR Annotations
  
  Juan Manuel Zambrano Chaves (juanza), Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Akshay Chaudhari, Serena Yeung, Curtis Langlotz, Sheng Wang, Hoifung Poon
  
  January 2025
  
  Publication
- Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
  
  Juan Manuel Zambrano Chaves, Shih-Cheng Huang, Yanbo Xu, Hanwen Xu, Naoto Usuyama (naotous), Sheng Zhang, Fei Wang, Yujia Xie, Mahmoud Khademi, Ziyi Yang, Hany Hassan Awadalla, Julia Gong, Houdong Hu, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Yu Gu, Cliff Wong, Mu-Hsin Wei, Tristan Naumann, Muhao Chen, Matthew P Lungren, Serena Yeung-Levy, Curtis P. Langlotz, Sheng Wang, Hoifung Poon
  
  March 2024
  
  Publication
- BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
  
  Sheng Zhang, Yanbo Xu, Naoto Usuyama, Hanwen Xu, Jaspreet Bagga, Rob Tinn, Sam Preston, Rajesh Rao, Mu Wei, Naveen Valluri, Cliff Wong, Andrea Tupini, Yu Wang, Matt Mazzola, Swadheen Shukla, Lars Liden, Jianfeng Gao, Matthew P Lungren, Tristan Naumann, Sheng Wang, Hoifung Poon
  
  January 2024
  
  Publication
- BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys
  
  Yu Gu, Jianwei Yang, Naoto Usuyama, Chunyuan Li, Sheng Zhang, Matthew P Lungren, Jianfeng Gao, Hoifung Poon
  
  October 2023
  
  Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Interactive Code Generation via Test-Driven User-Intent Formalization
  
  Shuvendu Lahiri, Sarah Fakhoury, Aaditya Naik, Georgios Sakkas, Saikat Chakraborty, Piali Choudhury, Curtis von Veh, Madan Musuvathi, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao
  
  August 2022
  
  Publication Project
- GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
  
  Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
  
  May 2022
  
  Publication Github Project
- Self-supervised Pre-training with Hard Examples Improves Visual Representations.
  
  Chunyuan Li, Xiujun Li, Lei Zhang, Baolin Peng, Mingyuan Zhou, Jianfeng Gao
  
  December 2020
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Video Access
- Novel Human-Object Interaction Detection via Adversarial Domain Generalization
  
  Yuhang Song, Wenbo Li, Lei Zhang, Jianwei Yang, Emre Kiciman, Hamid Palangi, Jianfeng Gao, C.-C. Jay Kuo, Pengchuan Zhang
  
  May 2020
  
  Publication
- OPTIMUS: Organizing Sentences via Pre-trained Modeling of a Latent Space
  
  Chunyuan Li, Xiang Gao, Yuan Li, Xiujun Li, Baolin Peng, Yizhe Zhang, Jianfeng Gao
  
  April 2020
  
  Publication Github
- Feature Quantization Improves GAN Training
  
  Yang Zhao, Chunyuan Li, Ping Yu, Jianfeng Gao, Changyou Chen
  
  April 2020
  
  Publication Github
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization
  
  Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Tuo Zhao
  
  April 2020
  
  Publication Project
- Systems and methods for automated query answer generation
  
  Saurabh Kumar Tiwary, Mir Rosenberg, Jianfeng Gao, Xia Song, Rangan Majumder, Li Deng
  
  June 2018
  
  Publication Project Project
- Dynamic Fusion Networks for Machine Reading Comprehension
  
  Yichong Xu, JJ (Jingjing) Liu, Jianfeng Gao, Yelong Shen, Xiaodong Liu
  
  February 2018
  
  PDF Github
- Deep Learning and Continuous Representations for NLP (Tutorial for NAACL-HLT-2015)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  May 2015
  
  Publication
- Improving Query Translation for CLIR Using Statistical Models
  
  Jianfeng Gao, Jian-Yun Nie, Endong Xun, Jian Zhang, Ming Zhou, Changning Huang
  
  SIGIR'01, New Orleans, Lousiana, USA | September 2001
  
  Publication
- TREC-10 Web Track Experiments at MSRNCN
  
  Jianfeng Gao, Guihong Cao, Hongzhao He, Min Zhang, Jian-Yun Nie, Stephen Walker, Stephen Robertson
  
  TREC-10 | May 2001
  
  Publication
- Distribution-based Pruning of Backoff Language Models
  
  Jianfeng Gao, Kai-Fu Lee
  
  October 2000
  
  Publication Publication
- PENS: A Machine-aided English Writing System for Chinese Users
  
  Ting Liu, Ming Zhou, Jianfeng Gao, Endong Xun, Changning Huang
  
  October 2000
  
  Publication Publication
- N-gram Distribution Based Language Model Adaptation
  
  Jianfeng Gao, Mingjing Li, Kai-Fu Lee
  
  October 2000
  
  Publication
- Language Model Compression by Predictive Clustering
  
  Joshua Goodman, Jianfeng Gao
  
  October 2000
  
  Publication
- Lexicon Optimization for Chinese Language Modeling
  
  Jun Zhao, Jianfeng Gao, Eric Chang, Mingjing Li
  
  October 2000
  
  Publication
- Extraction of Chinese Compound Words – An Experimental Study on a Very Large Corpus
  
  Jian Zhang, Jianfeng Gao, Zhou Ming
  
  October 2000
  
  Publication Publication
- Language Model Size Reduction by Pruning and Clustering
  
  Jianfeng Gao, Joshua Goodman
  
  Proceedings International Conference on Spoken Language Processing | October 2000
  
  Publication
- On the Use of Words and N-grams for Chinese Information Retrieval
  
  Jian Zhang, Jian-Yun Nie, Jianfeng Gao, Zhou Ming
  
  September 2000
  
  Publication
- A Unified Approach to Statistical Language Modeling for Chinese
  
  Jianfeng Gao, Hai-Feng Wang, Mingjing Li Li, Kai-Fu Lee
  
  June 2000
  
  Publication
- TREC-9 CLIR experiments at MSRCN
  
  Jianfeng Gao, Jian-Yun Nie, Jian Zhang, Endong Xun, Yi Su, Ming Zhou, Chang-Ning Huang
  
  TREC-9 | April 2000
  
  Publication
- Interpretable Next-token Prediction via the Generalized Induction Head
  
  Eunji Kim, Sriya Mantena, Weiwei Yang, Chandan Singh, Sungroh Yoon, Jianfeng Gao
  
  NeurIPS 2025 | October 2025
  
  Publication
- MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention
  
  Yucheng Li, Huiqiang Jiang, Chengruidong Zhang, Qianhui Wu, Xufang Luo, Surin Ahn, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICML 2025 | July 2025
  
  Preprint Github Project
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
  
  Qianhui Wu, Kanzhi Cheng, Rui Yang, Chaoyun Zhang, Jianwei Yang, Huiqiang Jiang, Jian Mu, Baolin Peng, Bo Qiao, Reuben Tan, Si Qin, Lars Liden, Qingwei Lin 林庆维, Huan Zhang, Tong Zhang, Jianbing Zhang, Dongmei Zhang, Jianfeng Gao
  
  NeurIPS 2025 | June 2025
  
  Publication Project Project
- Training Language Models to Generate Quality Code with Program Analysis Feedback
  
  Feng Yao, Zilong Wang, Liyuan Liu, Junxia Cui, Li Zhong, Xiaohan Fu, Haohui Mai, Vish Krishnan, Jianfeng Gao, Jingbo Shang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Text Generation Beyond Discrete Token Sampling
  
  Yufan Zhuang, Liyuan Liu, Chandan Singh, Jingbo Shang, Jianfeng Gao
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way
  
  Chenglong Wang, Bongshin Lee, Steven Drucker, Dan Marshall, Jianfeng Gao
  
  CHI 2025 | April 2025
  
  Publication Video Video Access
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Project
- Simplifying DINO via Coding Rate Regularization
  
  Ziyang Wu, Jingyuan Zhang, Druv Pai, XuDong Wang, Chandan Singh, Jianwei Yang, Jianfeng Gao, Yi Ma
  
  ICML 2025 | February 2025
  
  DOI Publication Publication
- Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries
  
  Zelalem Gero, Chandan Singh, Yiqing Xie, Sheng Zhang, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  NeurIPS 2024 | December 2024
  
  DOI Publication Publication
- SCBench: A KV Cache-Centric Analysis of Long-Context Methods
  
  Yucheng Li, Huiqiang Jiang, Qianhui Wu, Xufang Luo, Surin Ahn, Chengruidong Zhang, Amir H. Abdi, Dongsheng Li, Jianfeng Gao, Yuqing Yang, Lili Qiu
  
  ICLR 2025 | December 2024
  
  Preprint Github Project
- Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
  
  Jitesh Jain, Zhengyuan Yang, Humphrey Shi, Jianfeng Gao, Jianwei Yang
  
  NeurIPS 2025 | December 2024
  
  Publication
- Compositional Generalization Across Distributional Shifts with Sparse Tree Operations
  
  Paul Smolensky, Jianfeng Gao, Roland Fernandez
  
  2024 Neural Information Processing Systems | December 2024
  
  Publication
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs
  
  Lingchen Meng, Jianwei Yang, Rui Tian, Xiyang Dai, Zuxuan Wu, Jianfeng Gao, Yu-Gang Jiang
  
  2024 Neural Information Processing Systems | October 2024
  
  Publication
- Crafting Interpretable Embeddings by Asking LLMs Questions
  
  Vinamra Benara, Chandan Singh, John X. Morris, Richard Antonello, Ion Stoica, Alexander Huth, Jianfeng Gao
  
  NeurIPS 2024 | May 2024
  
  DOI Publication Publication
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- Agent AI Towards a Holistic Intelligence
  
  Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley J. Llorens, John Langford, Hoi Vo, Fei-Fei Li, Katsushi Ikeuchi, Jianfeng Gao
  
  arXiv: 2403.00833 | February 2024
  
  Publication Publication Project
- An Interactive Agent Foundation Model
  
  Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley J. Llorens, Hoi Vo, Katsushi Ikeuchi, Fei-Fei Li, Jianfeng Gao, Naoki Wake, Qiuyuan Huang
  
  February 2024
  
  Publication Publication Project
- TrustLLM: Trustworthiness in Large Language Models
  
  Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zheng Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, B. Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Haodong Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, M. Kellis, M. Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, M. Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, S. Jana, Tian-Xiang Chen, Tianming Liu, Tianying Zhou, William Wang, Xiang Li, Xiang-Yu Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao
  
  ICML 2024 | January 2024
  
  DOI Publication Publication
- MindAgent: Emergent Gaming Interaction
  
  Steven Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-chun Zhu, Demetri Terzopoulos, Feifei Li, Jianfeng Gao
  
  Processings of NAACL 2024 | January 2024
  
  Publication Project Project
- Agent AI: Surveying the Horizons of Multimodal Interaction
  
  Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong , Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Fei-Fei Li, Jianfeng Gao
  
  arXiv: 2401.03568 | January 2024
  
  Publication Project
- Bridging Discrete and Backpropagation: Straight-Through and Beyond
  
  Liyuan Liu, Chengyu Dong, Xiaodong Liu, Bin Yu, Jianfeng Gao
  
  NeurIPS 2023 (Oral) | December 2023
  
  Publication Github
- Visual In-Context Prompting
  
  Feng Li, Qing Jiang, Hao Zhang, Tianhe Ren, Shilong Liu, Xueyan Zou, Hu-Sheng Xu, Hongyang Li, Chunyuan Li, Jianwei Yang, Lei Zhang, Jianfeng Gao
  
  CVPR 2024 | November 2023
  
  DOI Publication Publication
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Tree Prompting: Efficient Task Adaptation without Fine-Tuning
  
  Chandan Singh, Jianfeng Gao
  
  EMNLP | November 2023
  
  Publication
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models
  
  Jae Sung Park, Jack Hessel, Khyathi Chandu, Paul Pu Liang, Ximing Lu, Peter West, Qiuyuan Huang, Jianfeng Gao, Ali Farhadi, Yejin Choi
  
  Proceedings of NeurIPS 2023 | October 2023
  
  Publication Project
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models
  
  Borui Wang, Qiuyuan Huang, Budhaditya Deb, Aaron L Halfaker, Liqun Shao, Daniel McDuff, Ahmed Awadallah, Dragomir Radev, Jianfeng Gao
  
  Proceedings of ACL 2023 | May 2023
  
  Publication Publication Project Project
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  
  Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao
  
  ACL | May 2023
  
  Publication Project
- ArK: Augmented Reality with Knowledge Emergent Infrastructure
  
  Qiuyuan Huang, James Park, Abhinav Gupta, Pan Lu, Paul Bennett, Ran Gong, Subhojit Som, Baolin Peng, Owais Khan Mohammed, Chris Pal, Yejin Choi, Jianfeng Gao
  
  Selected as the project in HackBox 2023; Shipped to Office Teams | April 2023
  
  Publication Project Project
- AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models
  
  Dongkuan Xu, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Debadeepta Dey, Wenhui Wang, Xiang Zhang, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2022 | December 2022
  
  Publication Publication Project Project
- Fault-Aware Neural Code Rankers
  
  Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu Lahiri, Madan Musuvathi, Jianfeng Gao
  
  NeurIPS 2022 | November 2022
  
  Publication Publication Project
- Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  
  Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang
  
  NeurIPS 2022 | November 2022
  
  Publication Project
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- RegionCLIP: Region-based Language-Image Pretraining
  
  Yiwu Zhong, Jianwei Yang, Pengchuan Zhang, Chunyuan Li, Noel Codella, Liunian Harold Li, Luowei Zhou, Xiyang Dai, Lu Yuan, Yin Li, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- GLIPv2: Unifying Localization and Vision-Language Understanding
  
  Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
  
  NeurIPS 2022 | June 2022
  
  Preprint
  
  Publication Project
- Grounded Language-Image Pre-training
  
  Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, Kai-Wei Chang, Jianfeng Gao
  
  CVPR | June 2022
  
  Publication Project
- Unified Contrastive Learning in Image-Text-Label Space
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Bin Xiao, Ce Liu, Lu Yuan, Jianfeng Gao
  
  CVPR 2022 | June 2022
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- K-LITE: Learning Transferable Visual Models with External Knowledge
  
  Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Anna Rohrbach, Jianfeng Gao
  
  NeurIPS 2022 | April 2022
  
  Oral Presentation (1%)
  
  Publication Project
- ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
  
  Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Yong Jae Lee, Houdong Hu, Zicheng Liu, Jianfeng Gao
  
  NeurIPS (Datasets and Benchmarks Track) | April 2022
  
  Benchmark Page: https://computer-vision-in-the-wild.github.io/ELEVATER/
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- FocalNet: Focal Modulation Networks
  
  Jianwei Yang, Chunyuan Li, Jianfeng Gao
  
  2022 Neural Information Processing Systems | March 2022
  
  Publication
- Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer
  
  Greg Yang, Edward J. Hu, Igor Babuschkin, Szymon Sidor, David Farhi, Jakub Pachocki, Xiaodong Liu, Weizhu Chen, Jianfeng Gao
  
  NeurIPS 2021 | March 2022
  
  PDF Publication Github
- KAT: A Knowledge Augmented Transformer for Vision-and-Language
  
  Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  NAACL 2022. Long paper, Oral. | January 2022
  
  No.1 of OK-VQA Leaderboard (2021).
  
  Publication Project
- Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
  
  Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao
  
  NAACL 2022 | December 2021
  
  Publication
- ValueNet: A New Dataset for Human Value Driven Dialogue System
  
  Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu
  
  AAAI 2022 | December 2021
  
  Publication
- RetGen: A Joint framework for Retrieval and Grounded Text Generation Modeling
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  AAAI 2022 | December 2021
  
  Publication
- Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models
  
  Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Awadallah, Bo Li
  
  35th Annual Conference on Neural Information Processing System (NeurIPS 2021) | December 2021
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Project
- Focal Attention for Long-Range Interactions in Vision Transformers
  
  Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Preprint Github
- NICE: Neural Image Commenting with Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Xiang Gao, Hamid Palangi, Jianfeng Wang, Kenneth Forbus, Jianfeng Gao
  
  EMNLP 2021 | October 2021
  
  Publication Project
- Taming Sparsely Activated Transformer with Stochastic Experts.
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan, Ruofei Zhang, Tuo Zhao, Jianfeng Gao, Hany Hassan Awadalla
  
  October 2021
  
  Publication Publication
- TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
  
  Jianwei Yang, Yonatan Bisk, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication
- Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding
  
  Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao
  
  ICCV 2021 | October 2021
  
  Publication Github
- ARCH: Efficient Adversarial Regularized Training with Caching
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Adversarial Regularization as Stackelberg Game: An Unrolled Optimization Approach
  
  Simiao Zuo, Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Project
- Go-Figure: A Meta Evaluation of Factuality in Summarization
  
  Saadia Gabriel, Asli Celikyilmaz, Rahul Jha, Yejin Choi, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Preprint Publication
- RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
  
  Baolin Peng, Chunyuan Li, Zhu Zhang, Chenguang Zhu, Jinchao Li, Jianfeng Gao
  
  ACL-IJCNLP 2021 | August 2021
  
  Publication
- KB-VLP: Knowledge Based Vision and Language Pretraining
  
  Kezhen Chen, Qiuyuan Huang, Yonatan Bisk, Daniel McDuff, Jianfeng Gao
  
  Proceedings of the 38 th International Conference on Machine Learning, PMLR 139, 2021. ICML, workshop, 2021 | July 2021
  
  Publication Project
- VinVL: Revisiting Visual Representations in Vision-Language Models
  
  Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
  
  CVPR 2021 | June 2021
  
  Publication Project
- Targeted Adversarial Training for Natural Language Understanding
  
  Lis Pereira, Xiaodong Liu, Hao Cheng, Hoifung Poon, Jianfeng Gao, Ichiro Kobayashi
  
  NAACL | June 2021
  
  Publication Github
- M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
  
  Minheng Ni, Haoyang Huang, Lin Su, Edward Cui, Taroon Bharti, Lijuan Wang, Jianfeng Gao, Dongdong Zhang, Nan Duan
  
  CVPR 2021 | June 2021
  
  Publication Project
- Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization
  
  Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao
  
  North American Chapter of the Association for Computational Linguistics: Human Language Technologies | June 2021
  
  Publication
- DeBERTa: Decoding-Enhanced BERT with Disentangled Attention
  
  Pengcheng He, Xiaodong Liu, Jianfeng Gao, Wei Chen
  
  2021 International Conference on Learning Representations | May 2021
  
  Under review
  
  PDF Publication Github Project Project
- Text Editing by Command
  
  Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan
  
  NAACL | April 2021
  
  PDF Publication
- Contrastive Multi-document Question Generation
  
  Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan
  
  European Chapter of the Association for Computational Linguistics (EACL) | April 2021
  
  PDF Publication Project
- SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching
  
  Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao
  
  Transactions of the Association for Computational Linguistics | April 2021
  
  PDF Video Github
- Data Augmentation for Abstractive Query-Focused Multi-Document Summarization
  
  Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao
  
  AAAI 2021 | April 2021
  
  Publication
- Token-wise Curriculum Learning for Neural Machine Translation
  
  Chen Liang, Haoming Jiang, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao, Tuo Zhao
  
  2021 Empirical Methods in Natural Language Processing | March 2021
  
  Publication
- Multi-domain Task-oriented Dialog Challenge II at DSTC9
  
  Jinchao Li, Qi Zhu, Lingxiao Luo, Lars Liden, Kaili Huang, Shahin Shayandeh, Runze Liang, Baolin Peng, Zheng Zhang, Swadheen Shukla, Ryuichi Takanobu, Minlie Huang, Jianfeng Gao
  
  AAAI-2021 Dialog System Technology Challenge 9 Workshop | February 2021
  
  Publication
- VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training
  
  Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  AAAI | February 2021
  
  PDF Publication Video Project Project
- A Controllable Model of Grounded Response Generation
  
  Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Xiang Gao, Chris Quirk, Rik Koncel-Kedziorski, Jianfeng Gao, Hannaneh Hajishirzi, Mari Ostendorf, Bill Dolan
  
  AAAI 2021 | January 2021
  
  PDF Publication Publication
- Reader-Guided Passage Reranking for Open-Domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Learning Inference Rules with Neural TP-Reasoner
  
  Kezhen Chen, Qiuyuan Huang, Paul Smolensky, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, workshop | December 2020
  
  Publication Project Project
- NICE: Neural Image Commenting Evaluation with an Emphasis on Emotion and Empathy
  
  Kezhen Chen, Qiuyuan Huang, Daniel McDuff, Jianfeng Wang, Hamid Palangi, Xiang Gao, Kevin Li, Kenneth Forbus, Jianfeng Gao
  
  NeurIPS 2020, Contributed talk in HLDS workshop. | October 2020
  
  Publication Publication Project
- Generation-Augmented Retrieval for Open-domain Question Answering
  
  Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, Wei Chen
  
  ACL-IJCNLP 2021 | September 2020
  
  Publication
- HittER: Hierarchical Transformers for Knowledge Graph Embeddings
  
  Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji
  
  EMNLP 2021 | August 2020
  
  Publication Github
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
  
  Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, Jianfeng Gao
  
  ECCV | August 2020
  
  Publication Video Github Project Project Project
- UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training
  
  Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  37th International Conference on Machine Learning (ICML 2020) | July 2020
  
  Publication Github Project
- Recent Advances in Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett
  
  SIGIR 2020 | July 2020
  
  Tutorial Slides
  
  Publication
- MIND: A Large-scale Dataset for News Recommendation
  
  Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, Ming Zhou
  
  ACL 2020 | July 2020
  
  Publication Access
- Mapping Natural-language Problems to Formal-language Solutions Using Structured Neural Representations
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  ICML 2020 | July 2020
  
  Publication Project Project
- Few-Shot Generative Conversational Query Rewriting
  
  Shi Yu, Jiahua Liu, Jingqin Yang, Chenyan Xiong, Paul Bennett, Jianfeng Gao, Zhiyuan Liu
  
  SIGIR 2020 | June 2020
  
  Best Short Paper Award
  
  PDF
- Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training
  
  Weituo Hao, Chunyuan Li, Xiujun Li, Lawrence Carin, Jianfeng Gao
  
  CVPR 2020 | April 2020
  
  Publication Github
- RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
  
  Sam Lobel, Chunyuan Li, Jianfeng Gao, Lawrence Carin
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Github
- On the Variance of the Adaptive Learning Rate and Beyond
  
  Liyuan Liu, Haoming Jiang, Pengcheng He, Weizhu Chen, Xiaodong Liu, Jianfeng Gao, Jiawei Han
  
  Eighth International Conference on Learning Representations (ICLR) | April 2020
  
  Publication PDF Project
- ConvLab-2: An Open-Source Toolkit for Building, Evaluating, and Diagnosing Dialogue Systems
  
  Qi Zhu, Zheng Zhang, Yan Fang, Xiang Li, Ryuichi Takanobu, Jinchao Li, Baolin Peng, Jianfeng Gao, Xiaoyan Zhu, Minlie Huang
  
  ACL 2020 Demo | April 2020
  
  Publication Project
- Multi-domain Task-oriented Dialog Challenge II
  
  Jinchao Li, Qi Zhu, Baolin Peng, Lars Liden, Runze Liang, Ryuichi Takanobu, Shahin Shayandeh, Swadheen Shukla, Zheng Zhang, Minlie Huang, Jianfeng Gao
  
  The Ninth Dialog System Technology Challenge | March 2020
  
  PDF Project
- Unified Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI Conference on Artificial Intelligence (AAAI 2020) | February 2020
  
  Publication
- Results of the Multi-Domain Task-Completion Dialog Challenge
  
  Jinchao Li, Baolin Peng, Sungjin Lee, Jianfeng Gao, Ryuichi Takanobu, Qi Zhu, Minlie Huang, Hannes Schulz, Adam Atkinson, Mahmoud Adada
  
  Proceedings of the 34th AAAI Conference on Artificial Intelligence, Eighth Dialog System Technology Challenge Workshop | February 2020
  
  PDF Project
- Complementary Auxiliary Classifiers for Label-Conditional Text Generation
  
  Yuan Li, Chunyuan Li, Yizhe Zhang, Xiujun Li, Guoqing Zheng, Lawrence Carin, Jianfeng Gao
  
  AAAI 2020 | February 2020
  
  Publication
- Uniﬁed Vision-Language Pre-Training for Image Captioning and VQA
  
  Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao
  
  AAAI | February 2020
  
  Publication Project Project
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  Third NeurIPS workshop on Conversational AI: “Today's Practice and Tomorrow's Potential” | December 2019
  
  Publication Publication
- The Eighth Dialog System Technology Challenge
  
  Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K Kummerfeld, Walter S Lasecki, Chiori Hori, Anoop Cherian, Tim K Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
  
  The third Conversational AI workshop, NeurIPS | December 2019
  
  Publication
- Unified Language Model Pre-training for Natural Language Understanding and Generation
  
  Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon
  
  33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | December 2019
  
  Publication Github Project
- Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving
  
  Imanol Schlag, Paul Smolensky, Roland Fernandez, Nebojsa Jojic, Jürgen Schmidhuber, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019 | December 2019
  
  Publication PDF
- TP-N2F: Tensor Product Representation for Natural To Formal Language Generation
  
  Kezhen Chen, Qiuyuan Huang, Hamid Palangi, Paul Smolensky, Kenneth D. Forbus, Jianfeng Gao
  
  Thirty-third Conference on Neural Information Processing Systems (NeurIPS) 2019, workshop | December 2019
  
  Best Paper Award at KR2ML Workshop in NeurIPS 2019.
  
  Publication PDF Project Project
- TIGEr: Text-to-Image Grounding for Image Caption Evaluation
  
  Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- REO-Relevance, Extraness, Omission: A Fine-grained Evaluation for Image Captioning
  
  Ming Jiang, Junjie Hu, Qiuyuan Huang, Lei Zhang, Jana Diesner, Jianfeng Gao
  
  EMNLP 2019 | November 2019
  
  Publication Project
- DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation
  
  Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, JJ (Jingjing) Liu, Bill Dolan
  
  arXiv:1911.00536 | November 2019
  
  PDF Project Project
- Structuring Latent Spaces for Stylized Response Generation
  
  Xiang Gao, Yizhe Zhang, Sungjin Lee, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  EMNLP-IJCNLP 2019 | September 2019
  
  Publication Project Project
- DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain.
  
  Yichong Xu, Xiaodong Liu, Chunyuan Li, Hoifung Poon, Jianfeng Gao
  
  BioNLP 2019 | August 2019
  
  PDF
- Efficient Navigation with Language Pre-training and Stochastic Sampling
  
  xiujun li, Chunyuan Li, Qiaolin Xia, Asli Celikyilmaz, Jianfeng Gao, Noah A. Smith, Yejin Choi
  
  EMNLP-IJCNLP | August 2019
  
  DOI
- Budgeted Policy Learning for Task-Oriented Dialogue Systems
  
  Zhirui Zhang, Xiujun Li, Jianfeng Gao, Enhong Chen
  
  ACL 2019 | July 2019
  
  Publication Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Xiang Li, Yaoqin Zhang, Zheng Zhang, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  ACL | July 2019
  
  PDF Publication Github Project Project
- ConvLab: Multi-Domain End-to-End Dialog System Platform
  
  Sungjin Lee, Qi Zhu, Ryuichi Takanobu, Zheng Zhang, Yaoqin Zhang, Xiang Li, Jinchao Li, Baolin Peng, Xiujun Li, Minlie Huang, Jianfeng Gao
  
  Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations | July 2019
  
  Publication
- Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling
  
  Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao, Khuram Shahid, Nithya Govindarajan, Yizhe Zhang, Jianfeng Gao, Michel Galley, Chris Brockett, Tulasi Menon, Bill Dolan
  
  Association for Computational Linguistics 2019 | July 2019
  
  Publication Project
- Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
  
  Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen, Xin Wang, Jianfeng Gao, Lawrence Carin
  
  ACL 2019 | July 2019
  
  Publication
- Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
  
  Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, JJ (Jingjing) Liu, Jianfeng Gao, Yejin Choi, Siddhartha Srinivasa
  
  CVPR 2019 | June 2019
  
  Oral
  
  Publication
- Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-Fang Weng, William Yang Wang, Lei Zhang
  
  CVPR 2019 | June 2019
  
  Best Student Paper Award in CVPR 2019.
  
  Publication Video Project Project Project
- Neural Approaches to Conversational AI – Tutorial at ICML 2018
  
  Jianfeng Gao, Michel Galley
  
  ICML 2019 Tutorial | June 2019
  
  PDF
- Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading
  
  Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, Jianfeng Gao
  
  Proc. of ACL | June 2019
  
  PDF Project Project
- Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  ACL 2019 | June 2019
  
  Publication Project
- StoryGAN: A Sequential Conditional GAN for Story Visualization
  
  Yitong Li, Zhe Gan, Yelong Shen, JJ (Jingjing) Liu, Yu Cheng, Yuexin Wu, Lawrence Carin, David Carlson, Jianfeng Gao
  
  CVPR 2019 | April 2019
  
  PDF Publication
- Consistent Dialogue Generation with Self-supervised Feature Learning
  
  Yizhe Zhang, Xiang Gao, Sungjin Lee, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  preprint | March 2019
  
  Publication
- Multi-Domain Task-Completion Dialog Challenge
  
  Sungjin Lee, Hannes Schulz, Adam Atkinson, Jianfeng Gao, Kaheer Suleman, Layla El Asri, Mahmoud Adada, Minlie Huang, Shikhar Sharma, Wendy Tay, Xiujun Li
  
  Dialog System Technology Challenges 8 | March 2019
  
  PDF Project Project
- Jointly Optimizing Diversity and Relevance in Neural Response Generation
  
  Xiang Gao, Sungjin Lee, Yizhe Zhang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  NAACL-HLT 2019 | March 2019
  
  Publication Project
- Object-driven Text-to-Image Synthesis via Adversarial Training
  
  Wenbo Li, Pengchuan Zhang, Lei Zhang, Qiuyuan Huang, Xiaodong He, Siwei Lyu, Jianfeng Gao
  
  CVPR 2019 | February 2019
  
  PDF Publication Project
- Cyclical Annealing Schedule: A Simple Approach to Mitigate KL Vanishing
  
  Hao Fu, Chunyuan Li, Xiaodong Liu, Jianfeng Gao, Asli Celikyilmaz, Lawrence Carin
  
  NAACL 2019 | February 2019
  
  PDF
- Switch-based Active Deep Dyna-Q: Efficient Adaptive Planning for Task-Completion Dialogue Policy Learning
  
  Yuexin Wu, Xiujun Li, JJ (Jingjing) Liu, Jianfeng Gao, Yiming Yang
  
  AAAI 2019 | January 2019
  
  Publication Project
- Interactive Semantic Parsing for If-Then Recipes via Hierarchical Reinforcement Learning
  
  Ziyu Yao, Xiujun Li, Jianfeng Gao, Brian Sadler, Huan Sun
  
  AAAI 2019 | January 2019
  
  Publication Project
- Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization
  
  Yizhe Zhang, Michel Galley, Jianfeng Gao, Zhe Gan, Xiujun Li, Chris Brockett, Bill Dolan
  
  NeurIPS 2018 | December 2018
  
  Publication Project Project Project
- Navigating with Graph Representations for Fast and Scalable Decoding of Neural Language Models
  
  Minjia Zhang, Xiaodong Liu, Wenhan Wang, Jianfeng Gao, Yuxiong He
  
  NIPS 2018 | December 2018
  
  Publication
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  NIPS 2018 | December 2018
  
  Publication
- Deep dyna-q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Kam-Fai Wong, Shang-Yu Su
  
  Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) | December 2018
  
  Publication
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, Jingjing Liu, Yun-Nung Chen, Kam-Fai Wong
  
  2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) | December 2018
  
  Publication
- Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning
  
  Shang-Yu Su, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen
  
  EMNLP 2018 | October 2018
  
  Publication Publication Project Project
- Subgoal Discovery for Hierarchical Dialogue Policy Learning
  
  Da Tang, Xiujun Li, Jianfeng Gao, Chong Wang, Lihong Li, Tony Jebara
  
  EMNLP 2018 | October 2018
  
  Publication Project Project Project
- Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
  
  Xiujun Li, Sarah Panda, JJ (Jingjing) Liu, Jianfeng Gao
  
  SLT 2018 | July 2018
  
  Publication Project
- Neural Approaches to Conversational AI – Tutorial at ACL/SIGIR 2018
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  ACL and SIGIR tutorial | July 2018
  
  ACL and SIGIR tutorial
  
  Publication Project
- Discourse-Aware Neural Rewards for Coherent Text Generation
  
  Antoine Bosselut, Asli Celikyilmaz, Xiaodong He, Jianfeng Gao, Po-Sen Huang, Yejin Choi
  
  2018 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2018) | July 2018
  
  Publication
- Adversarial Advantage Actor-Critic Model for Task-Completion Dialogue Policy Learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Yun-Nung Chen, Kam-Fai Wong
  
  ICASSP 2018 | April 2018
  
  Publication Project
- BBQ-Networks: Efficient Exploration in Deep Reinforcement Learning for Task-Oriented Dialogue Systems
  
  Zachary Lipton, Xiujun Li, Jianfeng Gao, Lihong Li, Faisal Ahmed, Li Deng
  
  AAAI 2018 | February 2018
  
  Publication Publication Project
- A Knowledge-Grounded Neural Conversation Model
  
  Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Scott Wen-tau Yih, Michel Galley
  
  AAAI | February 2018
  
  Publication Project Project Project
- Deep Dyna-Q: Integrating planning for task-completion dialogue policy learning
  
  Baolin Peng, Xiujun Li, Jianfeng Gao, JJ (Jingjing) Liu, Kam-Fai Wong, Shang-Yu Su
  
  ACL 2018 | January 2018
  
  Publication Publication Project
- Multi-Task Learning of Speaker-Role-Based Neural Conversation Models
  
  Yi Luan, Chris Brockett, Bill Dolan, Jianfeng Gao, Michel Galley
  
  IJCNLP | November 2017
  
  Publication Project
- Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation
  
  Nasrin Mostafazadeh, Chris Brockett, Bill Dolan, Michel Galley, Jianfeng Gao, Georgios P. Spithourakis, Lucy Vanderwende
  
  IJCNLP | November 2017
  
  Publication Project Project Project
- End-to-End Task-Completion Neural Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  the 8th International Joint Conference on Natural Language Processing | November 2017
  
  Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Li, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing | September 2017
  
  Publication
- ReasoNet: Learning to Stop Reading in Machine Comprehension
  
  Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen, Weizhu Chen
  
  23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) | August 2017
  
  Publication Publication Project
- Towards End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics | July 2017
  
  Publication Publication Project
- StyleNet: Generating Attractive Visual Captions with Styles
  
  Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 | July 2017
  
  Publication
- Semantic Compositional Networks for Visual Captioning
  
  Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng
  
  Computer Vision and Pattern Recognition (CVPR), 2017 (spotlight) | July 2017
  
  Publication Publication
- A Nested Attention Neural Hybrid Model for Grammatical Error Correction
  
  Jianfeng Gao
  
  ACL 2017 | July 2017
  
  Publication
- End-To-End Joint Learning of Natural Language Understanding and Dialog Manager
  
  Xuesong Yang, Yun-Nung Chen, Dilek Hakkani-Tur, Paul A. Crook, Xiujun Li, Jianfeng Gao, Li Deng
  
  The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP2017) | March 2017
  
  Publication Project
- Character-level Deep Conflation for Business Data Analytics
  
  Zhe Gan, PD Singh, Ameet Joshi, Xiaodong He, Jianshu Chen, Jianfeng Gao, Li Deng
  
  ICASSP 2017 | February 2017
  
  Publication Publication Project
- Learning for Efficient Supervised Query Expansion via Two-stage Feature Selection
  
  Zhiwei Zhang, Qifan Wang, Luo Si, Jianfeng Gao
  
  SIGIR 16 | January 2017
  
  Publication
- Syntax or Semantics? Knowledge-Guided Joint Semantic Frame Parsing
  
  Yun-Nung (Vivian) Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  December 2016
  
  Publication
- Deep Reinforcement Learning with a Combinatorial Action Space for Predicting Popular Reddit Threads
  
  Ji He, Mari Ostendorf, Xiaodong He, Jianshu Chen, Jianfeng Gao, Lihong Li, Li Deng
  
  EMNLP 2016 | November 2016
  
  Publication Publication
- Bi-directional Attention with Agreement for Dependency Parsing
  
  Hao Cheng, Hao Fang, Xiaodong He, Jianfeng Gao, Li Deng
  
  EMNLP | November 2016
  
  Publication Publication
- Deep Reinforcement Learning with a Natural Language Action Space
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL) | August 2016
  
  Publication
- MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition
  
  Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, Jianfeng Gao
  
  ECCV 2016 | August 2016
  
  Publication Publication
- Deep Learning and Continuous Representations for Natural Language Processing (Tutorial at IJCAI 2016)
  
  Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao
  
  IJCAI 2016 | July 2016
  
  Publication
- A Proposal for Evaluating Answer Distillation from Web Data
  
  Bhaskar Mitra, Grady Simon, Jianfeng Gao, Nick Craswell, Li Deng
  
  Proceedings of the Second WebQA Workshop (SIGIR 2016) | July 2016
  
  PDF PDF
- Stacked Attention Networks for Image Question Answering
  
  Zichao Yang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Smola
  
  CVPR 2016 | June 2016
  
  Publication Publication Project
- Deep Reinforcement Learning for Dialogue Generation
  
  Jiwei Li, Will Monroe, Alan Ritter, Michel Galley, Jianfeng Gao, Dan Jurafsky
  
  Proc. of EMNLP | June 2016
  
  Publication Publication Project Project
- Multi-Domain Joint Semantic Frame Parsing using Bi-directional RNN-LSTM
  
  Dilek Hakkani-Tür, Gokhan Tur, Asli Celikyilmaz, Yun-Nung Vivian Chen, Jianfeng Gao, Li Deng, Ye-Yi Wang
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication Project
- End-to-End Memory Networks with Knowledge Carryover for Multi-Turn Spoken Language Understanding
  
  Yun-Nung Vivian Chen, Dilek Hakkani-Tür, Gokhan Tur, Jianfeng Gao, Li Deng
  
  Proceedings of The 17th Annual Meeting of the International Speech Communication Association (INTERSPEECH 2016) | June 2016
  
  Publication
- A Persona-Based Neural Conversation Model
  
  Jiwei Li, Michel Galley, Chris Brockett, Georgios P. Spithourakis, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | June 2016
  
  Publication Publication Project Project Project Project
- Reasoning in Vector Space: An Exploratory Study of Question Answering
  
  Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng, Paul Smolensky
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2016 | May 2016
  
  Publication
- A Diversity-Promoting Objective Function for Neural Conversation Models
  
  Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan
  
  Proc. of NAACL-HLT | March 2016
  
  Publication Publication Project Project Project Project
- Basic Reasoning with Tensor Product Representations
  
  Paul Smolensky, Moontae Lee, Xiaodong He, Scott Wen-tau Yih, Jianfeng Gao, Li Deng
  
  January 2016
  
  Publication
- End-to-end Learning of Latent Dirichlet Allocation by Mirror-Descent Back Propagation
  
  Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng
  
  NIPS | December 2015
  
  Publication
- Deep Reinforcement Learning with an Action Space Defined by Natural Language
  
  Ji He, Jianshu Chen, Xiaodong He, Jianfeng Gao, Lihong Li, Li Deng, Mari Ostendorf
  
  ICML 2016 | November 2015
  
  PDF Publication
- Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base
  
  Scott Wen-tau Yih, Ming-Wei Chang, Xiaodong He, Jianfeng Gao
  
  Proceedings of the Joint Conference of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on Natural Language Processing of the AFNLP | July 2015
  
  Outstanding Paper Award
  
  Publication Publication Project Project
- ˆ†BLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
  
  Michel Galley, Chris Brockett, Alessandro Sordoni, Yangfeng Ji, Michael Auli, Chris Quirk, Margaret Mitchell, Jianfeng Gao, Bill Dolan
  
  Proc. of ACL | July 2015
  
  Publication Publication Project Project
- A Deep Embedding Model for Co-occurrence Learning
  
  Yelong Shen, Ruoming Jin, Jianshu Chen, Xiaodong He, Jianfeng Gao, Li Deng
  
  June 2015
  
  Publication
- From Captions to Visual Concepts and Back
  
  Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Larry Zitnick, Geoffrey Zweig
  
  CVPR 2015 | June 2015
  
  Tied for 1st Prize
  
  Publication Project Project
- A Neural Network Approach to Context-Sensitive Generation of Conversational Responses
  
  Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Meg Mitchell, Jian-Yun Nie, Jianfeng Gao, Bill Dolan
  
  Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT) | June 2015
  
  Publication Publication Access Project Project Project
- Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
  
  Xiaodong Liu, Jianfeng Gao, Xiaodong He, Li Deng, Kevin Duh, Ye-Yi Wang
  
  May 2015
  
  Publication
- Embedding Entities and Relations for Learning and Inference in Knowledge Bases
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  Proceedings of the International Conference on Learning Representations (ICLR) 2015 | May 2015
  
  Publication Publication Project
- Learning Multi-Relational Semantics Using Neural-Embedding Models
  
  Bishan Yang, Scott Wen-tau Yih, Xiaodong He, Jianfeng Gao, Li Deng
  
  NIPS 2014 workshop on Learning Semantics | December 2014
  
  Publication Publication
- A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  CIKM | November 2014
  
  Publication Project
- Deep Learning for Natural Language Processing: Theory and Practice (Tutorial)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  CIKM | November 2014
  
  Publication
- Large-scale Expected BLEU Training of Phrase-based Reordering Models
  
  Michael Auli, Michel Galley, Jianfeng Gao
  
  Proc. of EMNLP | October 2014
  
  Publication
- Online Classification Using a Voted RDA Method
  
  Tianbing Xu, Jianfeng Gao, Lin Xiao, Amelia C. Regan
  
  Proceedings of the AAAI Conference on Artificial Intelligence | July 2014
  
  Publication
- Learning Continuous Phrase Representations for Translation Modeling
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  Proceedings of ACL | June 2014
  
  Publication
- Decoder Integration and Expected BLEU Training for Recurrent Neural Network Language Models
  
  Michael Auli, Jianfeng Gao
  
  June 2014
  
  Publication
- Deep Learning for Natural Language Processing and Related Applications (Tutorial at ICASSP)
  
  Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2014
  
  Publication
- Learning Semantic Representations Using Convolutional Neural Networks for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  April 2014
  
  Publication Project
- Minimum Translation Modeling with Recurrent Neural Networks
  
  Yuening Hu, Michael Auli, Qin Gao, Jianfeng Gao
  
  April 2014
  
  Publication
- Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
  
  Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
  
  October 2013
  
  Publication Publication Project
- Modeling Click-through Based Word-pairs for Web Search
  
  Jagadeesh Jagarlamudi, Jianfeng Gao
  
  August 2013
  
  Publication
- Query Expansion Using Path-constrained Random Walks
  
  Jianfeng Gao, Gu Xu, Jinxi Xu
  
  SIGIR 2013, Dublin, Ireland. | August 2013
  
  Publication
- Beyond Left-to-Right: Multiple Decomposition Structures for SMT
  
  Hui Zhang, Kristina Toutanova, Chris Quirk, Jianfeng Gao
  
  NAACL | June 2013
  
  Publication
- Training MRF-Based Phrase Translation Models using Gradient Ascent
  
  Jianfeng Gao, Xiaodong He
  
  The North American Chapter of the Association for Computational Linguistics (NAACL) | June 2013
  
  Publication
- Deep Stacking Networks for Information Retrieval
  
  Li Deng, Xiaodong He, Jianfeng Gao
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- End-To-End Learning of Parsing Models for Information Retrieval
  
  Jennifer Gillenwater, Xiaodong He, Jianfeng Gao, Li Deng
  
  IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) | May 2013
  
  Publication
- Towards Concept-based Translation Models using Search Logs for Query Expansion
  
  Jianfeng Gao, Jian-Yun Nie
  
  November 2012
  
  Publication
- Combining Signals for Cross-Lingual Relevance Feedback
  
  Katrina Parton, Jianfeng Gao
  
  AIRS2012 | August 2012
  
  Publication
- Learning Lexicon Models from Search Logs for Query Expansion
  
  Jianfeng Gao, Shasha Xie, Xiaodong He, Alnur Ali
  
  Proceedings of EMNLP | July 2012
  
  Publication
- MSR SPLAT, A Language Analysis Toolkit
  
  Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Scott Wen-tau Yih, Lucy Vanderwende, Colin Cherry
  
  Proceedings of NAACL-HLT 2012 | June 2012
  
  Publication
- A Unified Approach To Transliteration-based Text Input With Online Spelling Correction
  
  Hisami Suzuki, Jianfeng Gao
  
  Proceedings of EMNLP | May 2012
  
  Publication
- Statistical Translation and Web Search Ranking
  
  Jianfeng Gao
  
  ACL/SIGIR Summer School | August 2011
  
  Publication
- Clickthrough-Based Latent Semantic Models for Web Search
  
  Jianfeng Gao, Kristina Toutanova, Scott Wen-tau Yih
  
  Proceedings of the Thirty-Fourth Annual International ACM SIGIR Conference | July 2011
  
  Publication
- Domain Adaptation via Pseudo In-Domain Data Selection
  
  Amittai Axelrod, Xiaodong He, Jianfeng Gao
  
  EMNLP | July 2011
  
  Publication
- The MSRA Machine Translation System for IWSLT-2010
  
  Henry Li, Nan Duan, Yinggong Zhao, Shujie Liu, Lei Cui, Mei-Yuh Hwang, Amittai Axelrod, Jianfeng Gao, Yaodong Zhang, Li Deng
  
  Proc. the 7th International Workshop on Spoken Language Translation (IWSLT2010), Paris, France | December 2010
  
  Publication
- A Large Scale Ranker-Based System for Search Query Spelling Correction
  
  Jianfeng Gao, Chris Quirk, Xiaolong(Shiao-Long) Li
  
  The 23rd International Conference on Computational Linguistics | August 2010
  
  Publication
- A Comparison of Unsupervised Methods for Part-of-Speech Tagging in Chinese
  
  Alex Cheng, Fei Xia, Jianfeng Gao
  
  Coling 2010 Organizing Committee | August 2010
  
  Publication
- A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing
  
  Jianfeng Gao, Patrick Nguyen, Xiaolong(Shiao-Long) Li, Chris Thrasher, Mu Li, Kuansan Wang
  
  Proceeding of the 33rd Annual ACM SIGIR Conference | July 2010
  
  Publication
- Multi-Style Language Model for Web Scale Information Retrieval
  
  Kuansan Wang, Xiaolong(Shiao-Long) Li, Jianfeng Gao
  
  Proceedings of the 33rd Annual ACM SIGIR Conference (SIGIR'2010), 19-23 July 2010, Geneva, Switzerland | July 2010
  
  Publication
- Learning Phrase-Based Spelling Error Models from Clickthrough Data
  
  Xu Sun, Jianfeng Gao, Daniel Micol, Chris Quirk
  
  ACL 2010 | May 2010
  
  Publication
- Exploring Web Scale Language models for Search Query Processing
  
  Jian Huang, Jianfeng Gao, Jiangbo Miao, Xiaolong(Shiao-Long) Li, Kuansan Wang, Fritz Behr
  
  Proceedings of the 19th International World Wide Web Conference (WWW'2010), Raleigh, NC | April 2010
  
  Publication
- Clickthrough-Based Translation Models for Web Search: from Word Models to Phrase Models
  
  Jianfeng Gao, Xiaodong He, Jian-Yun Nie
  
  CIKM | January 2010
  
  Publication
- Model Adaptation via Model Interpolation and Boosting for Web Search Ranking
  
  Jianfeng Gao, Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Yi Su, Nazan Khan, Shalin Shah, Hongyan Zhou
  
  EMNLP | August 2009
  
  Publication
- Discovery of Term Variation in Japanese Web Search Queries
  
  Hisami Suzuki, Xiao Li, Jianfeng Gao
  
  Proceedings of EMNLP | August 2009
  
  Publication
- Smoothing Clickthrough Data for Web Search Ranking
  
  Jianfeng Gao, Wei Yuan, Xiao Li, Kefeng Deng, Jian-Yun Nie
  
  SIGIR | July 2009
  
  Publication
- Selecting good expansion terms for pseudo-relevance feedback
  
  Guihong Cao, Jian-Yun Nie, Jianfeng Gao, Stephen Robertson
  
  SIGIR 2008: Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval | August 2008
  
  ISBN: 978-1-600558-164-4
  
  Publication
- Using Contextual Speller Techniques and Language Modeling for ESL Error Correction
  
  Michael Gamon, Jianfeng Gao, Chris Brockett, Alexander Klementiev, Bill Dolan, Dmitriy Belenko, Lucy Vanderwende
  
  Proceedings of IJCNLP, Hyderabad, India | January 2008
  
  Publication Publication Project
- Bayesian Semi-supervised Chinese Word Segmentation for Statistical Machine Translation
  
  Jia Xu, Jianfeng Gao, Kristina Toutanova, Hermann Ney
  
  In Proceedings of Coling | January 2008
  
  Publication
- Indirect-HMM-based Hypothesis Alignment for Combining Outputs from Machine Translation Systems
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  EMNLP | January 2008
  
  Publication
- The MSR-MSRA MT System for NIST Open Machine Translation 2008 Evaluation
  
  Xiaodong He, Jianfeng Gao, Chris Quirk, Patrick Nguyen, Arul Menezes, Robert Moore, Kristina Toutanova, Mei Yang, Bill Dolan, Mu Li, Chi-Ho Li, Dongdong Zhang, Long Jiang, Ming Zhou, Henry Li
  
  The 2008 NIST Open Machine Translation Evaluation Workshop | January 2008
  
  Publication
- A Web-based English Proofing System for English as a Second Language Users
  
  Xing Yi, Jianfeng Gao, Bill Dolan
  
  International Joint Conference on Natural Language Processing (IJCNLP) | January 2008
  
  Publication
- A System to Mine Large-Scale Bilingual Dictionaries from Monolingual Web Pages
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  July 2007
  
  Publication
- Extending Query Translation to Cross-language Query Expansion with Markov Chain Models
  
  Guihong Cao, Jianfeng Gao, Jian-Yun Nie, Jing Bai
  
  CIKM | January 2007
  
  Publication
- A Comparison of Bayesian Estimators for Unsupervised Hidden Markov Model POS Taggers
  
  Jianfeng Gao, Mark Johnson
  
  January 2007
  
  Publication
- Scalable Training of L1-Regularized Log-Linear Models
  
  Galen Andrew, Jianfeng Gao
  
  International Conference on Machine Learning | January 2007
  
  Publication
- A Comparative Study of Parameter Estimation Methods for Statistical Natural Language Processing
  
  Jianfeng Gao, Galen Andrew, Mark Johnson, Kristina Toutanova
  
  Annual Meeting of the Association for Computational Linguistics (ACL) | January 2007
  
  Publication
- Study of Statistical Models for Query Translation: Finding a Good Unit of Translation
  
  Jianfeng Gao, Jian-Yun Nie
  
  SIGIR | October 2006
  
  Publication
- A Comparative Study of Discriminative Methods for Reranking LVCSR N-Best Hypotheses in Domain Adaptation and Generalization
  
  Zhengyu Zhou, Jianfeng Gao, Frank Soong, Helen Meng
  
  ACL/SIGPARSE | April 2006
  
  Publication
- A Comparative Study on Language Model Adaptation Using New Evaluation Metrics
  
  Jianfeng Gao, Hisami Suzuki, Wei Yuan
  
  Proceedings of EMNLP | April 2006
  
  Publication Publication
- A Supervised Learning Approach to Entity Search
  
  Guoping Hu, JJ (Jingjing) Liu, Hang Li, Yunbo Cao, Jian-Yun Nie, Jianfeng Gao
  
  AIRS 2006 | January 2006
  
  Publication
- Approximation Lasso Methods for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Bin Yu
  
  Proceedings of ACL | January 2006
  
  Publication
- Person Resolution in Person Search Results: WebHawk
  
  Xiaojun Wan, Jianfeng Gao, Mu Li, Binggong Ding
  
  CIKM'05, Bremen, Germany | October 2005
  
  Publication
- Minimum Sample Risk Methods for Language Modeling
  
  Jianfeng Gao, Hao Yu, Wei Yuan, Peng Xu
  
  HLT/EMNLP | October 2005
  
  Publication
- Automatic Acquisition of Chinese-English Parallel Corpus from the Web
  
  Ying Zhang, Ke Wu, Jianfeng Gao, Phil Vines
  
  October 2005
  
  Publication
- An Information-Theoretic Approach to Automatic Evaluation of Summaries
  
  Chin-Yew Lin, Guihong Cao, Jianfeng Gao, Jian-Yun Nie
  
  August 2005
  
  Publication Publication
- An Empirical Study on Language Model Adaptation Using a Metric of Domain Similarity
  
  Wei Yuan, Jianfeng Gao, Hisami Suzuki
  
  IJCNLP 2005, LNAI 3651 | February 2005
  
  Publication
- A DOM Tree Alignment Model for Mining Parallel Data from the Web
  
  Lei Shi, Cheng Niu, Ming Zhou, Jianfeng Gao
  
  COLING-ACL | January 2005
  
  Publication
- Adaptive Chinese Word Segmentation
  
  Jianfeng Gao, Andi Wu, Mu Li, Chang-Ning Huang, Hongqiao Li, Xinsong Xia, Haowei Qin
  
  July 2004
  
  Publication Access
- Dependence Language Model for Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Guangyuan Wu, Guihong Cao
  
  July 2004
  
  Publication
- Capturing Long Distance Dependency in Language Modeling: An Empirical Study
  
  Jianfeng Gao, Hisami Suzuki
  
  International Conference on Natural Language Processing | May 2004
  
  Publication Publication
- The Use of SVM for Chinese New Word Identification
  
  Hongqiao Li, Chang-Ning Huang, Jianfeng Gao, Xiaozhong Fan
  
  March 2004
  
  Publication
- Linear Discriminant Model for Information Retrieval
  
  Jianfeng Gao, Haoliang Qi, Xinsong Xia, Jian-Yun Nie
  
  January 2004
  
  Publication Publication
- Unsupervised Learning of Dependency Structure for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki
  
  July 2003
  
  Publication Publication
- Improved Source-Channel Models for Chinese Word Segmentation
  
  Jianfeng Gao, Mu Li, Chang-Ning Huang
  
  July 2003
  
  Publication Publication
- Exploiting Headword Dependency and Predictive Clustering for Language Modeling
  
  Jianfeng Gao, Hisami Suzuki, Yang Wen
  
  Proceedings for EMNLP | July 2002
  
  Publication
- Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependency relations
  
  Jianfeng Gao, Jian-Yun Nie, Hongzhao He, Weijun Chen, Ming Zhou
  
  SIGIR | May 2002
  
  Publication Publication
- Exploring Asymmetric Clustering for Statistical Language Modeling
  
  Jianfeng Gao, Joshua Goodman, Guihong Cao, Hang Li
  
  ACL | May 2002
  
  Publication
- NTCIR-3 CLIR Experiments at MSRA
  
  Hongzhao He, Jianfeng Gao
  
  May 2002
  
  Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Published by Microsoft
  
  Publication Preprint Access
- Instruction Tuning with GPT-4
  
  Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, Jianfeng Gao
  
  MSR-TR-2023-35 | April 2023
  
  Published by Microsoft
  
  Project Page: https://instruction-tuning-with-gpt-4.github.io/
  
  Publication Project
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Published by Microsoft
  
  Publication Project
- Neurocompositional computing in human and machine intelligence: A tutorial
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew Goldrick, Jianfeng Gao
  
  MSR-TR-2022-5 | May 2022
  
  Published by Microsoft
  
  52 pages main text, 78 pages total, 11 figures, 2 Appendices, 239 references. For a short presentation of some of this material, see https://arxiv.org/abs/2205.01128 (to appear in AI Magazine).
  
  Project
- CMT in TREC-COVID Round 2: Mitigating the Generalization Gaps from Web to Special Domain Search
  
  Chenyan Xiong, Zhenghao Liu, Si Sun, Zhuyun Dai, Kaitao Zhang, Shi Yu, Zhiyuan Liu, Hoifung Poon, Jianfeng Gao, Paul Bennett
  
  MSR-TR-2020-49 | November 2020
  
  Published by Microsoft
  
  The participation report of our top non-manual entry in TREC COVID Round 2.
  
  PDF Publication
- The Design and Implementation of XiaoIce, an Empathetic Social Chatbot
  
  Harry Shum, Jianfeng Gao (jfgao), Di Li, Li Zhou
  
  MSR-TR-2018-42 | December 2018
  
  Published by Microsoft
  
  Publication Project Project
- Language-Based Image Editing with Recurrent Attentive Models
  
  Jianbo Chen, Yelong Shen, Jianfeng Gao, Xiaodong Liu, Jingjing Liu, Jianfeng Gao
  
  MSR-TR-2017-50 | December 2017
  
  The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  
  Publication Project
- Stochastic Answer Networks for Machine Reading Comprehension
  
  Jianfeng Gao, Xiaodong Liu, Yelong Shen, Kevin Duh
  
  MSR-TR-2017-51 | December 2017
  
  Publication Project
- Introduction to Deep Learning for Natural Language Processing (Tutorial at DeepLearning2017 summer school in Bilbao)
  
  Jianfeng Gao
  
  MSR-TR-2017-36 | July 2017
  
  Publication Project Project Project Project
- Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks
  
  Yun-Nung Chen, Dilek Hakkani-Tur, Gokhan Tur, Asli Celikyilmaz, Jianfeng Gao, Li Deng
  
  MSR-TR-2016-61 | September 2016
  
  arXiv:1609.03286
  
  Publication
- End-to-End Reinforcement Learning of Dialogue Agents for Information Access
  
  Bhuwan Dhingra, Lihong Li, Xiujun Li, Jianfeng Gao, Yun-Nung Chen, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-63 | September 2016
  
  Publication Project
- Efficient Exploration for Dialogue Policy Learning with BBQ Networks & Replay Buffer Spiking
  
  Zachary C. Lipton, Jianfeng Gao, Lihong Li, Xiujun Li, Faisal Ahmed, Li Deng
  
  MSR-TR-2016-62 | August 2016
  
  arXiv:1608.05081
  
  Publication Project
- Recurrent Reinforcement Learning: A Hybrid Approach
  
  Xiujun Li, Lihong Li, Jianfeng Gao, Xiaodong He, Jianshu Chen, Li Deng, Ji He
  
  MSR-TR-2015-98 | September 2015
  
  Proceedings of COLING-94, Kyoto, Japan
  
  Publication
- Deep Learning for Web Search and Natural Language Processing
  
  Jianfeng Gao, Xiaodong He, Li Deng
  
  MSR-TR-2015-7 | January 2015
  
  Publication
- Modeling Interestingness with Deep Neural Networks
  
  Jianfeng Gao, Patrick Pantel, Michael Gamon, Xiaodong He, Li Deng
  
  MSR-TR-2014-56 | October 2014
  
  Publication Project
- Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
  
  Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng
  
  MSR-TR-2014-109 | August 2014
  
  Publication
- A Convolutional Latent Semantic Model for Web Search
  
  Yelong Shen, Xiaodong He, Jianfeng Gao, Li Deng, Gregoire Mesnil
  
  MSR-TR-2014-55 | April 2014
  
  Publication Publication
- Learning Semantic Representations for the Phrase Translation Model
  
  Jianfeng Gao, Xiaodong He, Scott Wen-tau Yih, Li Deng
  
  MSR-TR-2013-88 | September 2013
  
  Publication
- A Voted Regularized Dual Averaging Method for Large-Scale Discriminative Training in Natural Language Processing
  
  Jianfeng Gao, Tianbing Xu, Lin Xiao, Xiaodong He
  
  MSR-TR-2013-89 | September 2013
  
  Publication
- Ranking, Boosting, and Model Adaptation
  
  Chris J. C. Burges, Krysta M. Svore, Qiang Wu, Jianfeng Gao
  
  MSR-TR-2008-109 | October 2008
  
  Publication
- Microsoft Research Treelet Translation System: NIST MT Evaluation 06
  
  Xiaodong He, Arul Menezes, Chris Quirk, Anthony Aue, Simon Corston-Oliver, Jianfeng Gao, Patrick Nguyen
  
  MSR-TR-2007-144 | November 2007
  
  Publication Publication
- MSRLM: a Scalable Language Modeling Toolkit
  
  Patrick Nguyen, Jianfeng Gao, Milind Mahajan
  
  MSR-TR-2007-144 | November 2007
  
  Publication
- Microsoft Research IME Corpus
  
  Hisami Suzuki, Jianfeng Gao
  
  MSR-TR-2005-168 | December 2005
  
  Publication Access
- BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once
  
  Theodore Zhao, Yu Gu, Jianwei Yang, Naoto Usuyama, Ho Hin Lee, Tristan Naumann, Jianfeng Gao, Angela Crabtree, B. Piening, Carlo Bifulco, Mu-Hsin Wei, Hoifung Poon, Sheng Wang
  
  June 2024
  
  DOI Video
- Efficient Long Sequence Modeling via State Space Augmented Transformer
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Denis Charles, Eren Manavoglu, Tuo Zhao, Jianfeng Gao
  
  December 2022
  
  Preprint
  
  Publication Github
- Explaining Patterns in Data with Language Models via Interpretable Autoprompting
  
  Chandan Singh, Jyoti Aneja, Jianfeng Gao
  
  October 2022
  
  Publication Github Project
- Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models
  
  Chandan Singh, Jianfeng Gao
  
  September 2022
  
  Publication Github
- OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
  
  Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
  
  June 2022
  
  Publication Project
- METRO: Efficient Denoising Pretraining of Large Scale Autoencoding Language Models with Model Generated Signals
  
  Payal Bajaj, Chenyan Xiong, Guolin Ke, Xiaodong Liu, Saurabh Tiwary, Tie-Yan Liu, Paul Bennett, Xia Song, Jianfeng Gao
  
  April 2022
  
  arXiv:2204.06644
  
  Publication
- Very Deep Transformers for Neural Machine Translation
  
  Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao
  
  October 2021
  
  Publication Github
- Joint Retrieval and Generation Training for Grounded Text Generation
  
  Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan
  
  May 2021
  
  Publication
- Learning Visual Relation Priors for Image-Text Matching and Image Captioning with Neural Scene Graph Generators
  
  Kuang-Huei Lee *, Hamid Palangi *, Xi Chen, Houdong Hu, Jianfeng Gao
  
  September 2019
  
  * Equal contributions
  
  Publication
- Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding
  
  Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao
  
  April 2019
  
  PDF Publication Github Project
- M-Walk: Learning to Walk in Graph with Monte Carlo Tree Search
  
  Yelong Shen, Jianshu Chen, Po-Sen Huang, Yuqing Guo, Jianfeng Gao
  
  February 2018
  
  arXiv preprint
  
  Publication
- Foundations of Statistical Natural Language Processing: A Case Study of Text Input System
  
  Jianfeng Gao, Hisami Suzuki
  
  August 2007 | Tutorial slides at the MSR Weihai Summer School, August 2007 edition edition
  
  Tutorial slides at the MSR Weihai Summer School, August 2007
  
  Publication
- Improving the Effectiveness of Information Retrieval with Clustering and Fusion
  
  Jian Zhang, Jianfeng Gao, Ming Zhou, Jiaxing Wang
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 109-125
  
  Publication
- The Use of Clustering Techniques for Language Modeling – Application to Asian Languages
  
  Jianfeng Gao, Joshua Goodman, Jiangbo Miao
  
  Computational Linguistics and Chinese Language Processing | April 2001, pp. 27-60
  
  Publication
- A whole-slide foundation model for digital pathology from real-world data
  
  Hanwen Xu, Naoto Usuyama, Jaspreet Bagga, Sheng Zhang, Rajesh Rao, Tristan Naumann, Cliff Wong, Zelalem Gero, Javier González, Yu Gu, Yanbo Xu, Mu-Hsin Wei, Wenhui Wang, Shuming Ma, Furu Wei, Jianwei Yang, Chunyuan Li, Jianfeng Gao, Jaylen Rosemon, Tucker Bower, Soohee Lee, R. Weerasinghe, Bill Wright, Ari Robicsek, Brian Piening, Carlo Bifulco, Sheng Wang, Hoifung Poon
  
  Nature | May 2024
  
  Publication DOI Publication
- LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering
  
  Dingmin Wang, Qiuyuan Huang, Matthew Jackson, Jianfeng Gao
  
  Proceedings of Transactions of the Association for Computational Linguistics (TACL) | April 2024, pp. 247-263
  
  Publication Project Project
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning
  
  Yaqing Wang, Sahaj Agarwal, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  EMNLP | December 2022
  
  Publication Project
- Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages
  
  Paul Soulos, Sudha Rao, Caitlin Smith, Eric Rosen, Asli Celikyilmaz, Tom McCoy, Yichen Jiang, Coleman Haley, Roland Fernandez, Hamid Palangi, Jianfeng Gao, Paul Smolensky
  
  ArXiv | August 2022, Vol abs/2208.06061
  
  DOI Publication
- VLC: Training Vision-Language Transformers from Captions
  
  Liangke Gui, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao
  
  Proceedings of Transactions on Machine Learning Research | May 2022
  
  Publication Project Project
- Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems
  
  Paul Smolensky, R. Thomas McCoy, Roland Fernandez, Matthew A. Goldrick, Jianfeng Gao
  
  AI Mag. | May 2022, Vol 43: pp. 308-322
  
  Publication Project
- Sparsely Activated Mixture-of-Experts are Robust Multi-Task Learners
  
  Shashank Gupta, Subhabrata (Subho) Mukherjee, Krishan Subudhi, Eduardo Gonzalez, Damien Jose, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | April 2022
  
  Publication
- LiST: Lite Prompted Self-training Makes Parameter-efficient Few-shot Learners
  
  Yaqing Wang, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Awadallah, Jianfeng Gao
  
  NAACL 2022 | April 2022
  
  Publication Github Project Project
- Florence: A New Foundation Model for Computer Vision
  
  Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang
  
  arXiv preprint arXiv:2111.11432 | November 2021
  
  Publication Project
- Data Augmentation for Spoken Language Understanding via Pretrained Models
  
  Baolin Peng, Chenguang Zhu, Michael Zeng, Jianfeng Gao
  
  INTERSPEECH | September 2021
  
  Publication
- XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation
  
  Subhabrata (Subho) Mukherjee, Ahmed Awadallah, Jianfeng Gao
  
  ArXiv | June 2021
  
  arXiv:2106.04563
  
  Publication Github Project Project
- Compositional Processing Emerges in Neural Networks Solving Math Problems
  
  Jacob Russin, Roland Fernandez, Hamid Palangi, Eric Rosen, N. Jojic, Paul Smolensky, Jianfeng Gao
  
  CogSci ... Annual Conference of the Cognitive Science Society. Cognitive Science Society (U.S.). Conference | May 2021, Vol 2021: pp. 1767-1773
  
  Publication Publication Project
- MiniVLM: A Smaller and Faster Vision-Language Model
  
  Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
  
  arXiv preprint arXiv:2012.06946 | December 2020
  
  Publication Project
- Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language
  
  Hassan Akbari, Hamid Palangi, Jianwei Yang, Sudha Rao, Asli Celikyilmaz, Roland Fernandez, Paul Smolensky, Jianfeng Gao, Shih-Fu Chang
  
  ArXiv | November 2020, Vol abs/2011.09530
  
  Publication
- Few-shot Natural Language Generation for Task-Oriented Dialog
  
  Baolin Peng, Chenguang Zhu, Chunyuan Li, Xiujun Li, Jinchao Li, Michael Zeng, Jianfeng Gao
  
  Empirical Methods in Natural Language Processing (EMNLP) | November 2020
  
  Publication Project
- Vision-Language Navigation Policy Learning and Adaptation
  
  Xin Wang, Qiuyuan Huang, Asli Celikyilmaz, Jianfeng Gao, Dinghan Shen, Yuan-fang Wang, William Wang, Lei Zhang
  
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 | February 2020
  
  Publication Publication Project Project
- HUBERT Untangles BERT to Improve Transfer across NLP Tasks
  
  Mehrad Moradshahi, Hamid Palangi, Monica S. Lam, Paul Smolensky, Jianfeng Gao
  
  arxiv | October 2019
  
  https://arxiv.org/abs/1910.12647
  
  Publication
- Neural Approaches to Conversational AI
  
  Jianfeng Gao, Michel Galley, Lihong Li
  
  Foundations and Trends in Information Retrieval | February 2019
  
  Publication Project Project Project Project Project
- Link Prediction using Embedded Knowledge Graphs
  
  Yelong Shen, Po-Sen Huang, Ming-Wei Chang, Jianfeng Gao
  
  arXiv | April 2018
  
  Publication Publication Project
- The MSR-NLP System at Dialog System Technology Challenges 6
  
  Michel Galley, Chris Brockett, Bill Dolan, Jianfeng Gao
  
  Dialog System Technology Challenges (DSTC) | November 2017
  
  Publication Project
- Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning
  
  Baolin Peng, Xiujun Li, Lihong Li, Jianfeng Gao, Asli Celikyilmaz, Sungjin Lee, Kam-Fai Wong
  
  Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP) | September 2017
  
  Publication Publication Project
- Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems
  
  Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, Asli Celikyilmaz
  
  March 2017
  
  Publication Project
- A User Simulator for Task-Completion Dialogues
  
  Xiujun Li, Zachary C. Lipton, Bhuwan Dhingra, Lihong Li, Jianfeng Gao, Yun-Nung Chen
  
  December 2016, pp. 14
  
  Publication Project
- MS MARCO: A Human Generated MAchine Reading COmprehension Dataset
  
  Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, Li Deng
  
  November 2016
  
  Publication Publication Access Project Project Project
- TopicRNN: A Recurrent Neural Network with Long-Range Semantic Dependency
  
  Adji Dieng, Chong Wang, Jianfeng Gao, John Paisley
  
  November 2016
  
  Publication Publication
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | March 2016
  
  Publication Publication
- Deep Sentence Embedding Using Long Short-Term Memory Networks: Analysis and Application to Information Retrieval [IEEE Signal Processing Society 2018 Best Paper award]
  
  Hamid Palangi, Li Deng, Yelong Shen, Jianfeng Gao, Xiaodong He, Jianshu Chen, Xinying Song, Rabab Ward
  
  IEEE/ACM Transactions on Audio, Speech, and Language Processing | January 2016, Vol 24: pp. 694
  
  Publication Publication Project
- Adapting Bboosting for Information Retrieval Measures
  
  Qiang Wu, Chris J.C. Burges, Krysta M. Svore, Jianfeng Gao
  
  Information Retrieval | June 2010, Vol 13: pp. 254-270
  
  Publication
- Using Statistical Techniques and Web Search to Correct ESL Errors
  
  Michael Gamon, Claudia Leacock, Chris Brockett, Bill Dolan, Dmitriy Belenko, Alexandre Klementiev, Jianfeng Gao
  
  Calico Journal | June 2009, Vol 26(3)
  
  Publication
- Improved Monolingual Hypothesis Alignment for Machine Translation System Combination
  
  Xiaodong He, Mei Yang, Jianfeng Gao, Patrick Nguyen, Robert Moore
  
  ACM Transactions on Asian Language Information Processing -- special issue on Machine Translation of Asian Languages | January 2009
  
  Publication
- Statistical Query Translation Models for Cross- Language Information Retrieval
  
  Jianfeng Gao, Jian-Yun Nie, Ming Zhou
  
  ACM Trans on Asian Language Information Processing | February 2006, pp. 323-359
  
  Publication
- Chinese Word Segmentation and Named Entity Recognition: A Pragmatic Approach
  
  Jianfeng Gao, Mu Li, Andi Wu, Chang-Ning Huang
  
  Computational Linguistics | June 2005, Vol 31(4): pp. 44
  
  Publication
- Introduction to the Special Issue on Statistical Language Modeling
  
  Jianfeng Gao, Chin-Yew Lin
  
  ACM Transactions on Asian Language Information Processing | June 2004, Vol 3(2): pp. 87-93
  
  Publication Publication
- Improving Encarta Search Engine Performance by Mining User Logs
  
  Charles X. Ling, Jianfeng Gao, Huajie Zhang, Weining Qian, Hongjiang Zhang
  
  International Journal of Pattern Recognition and Artificial Intelligence | April 2002, Vol 16(8)
  
  Publication
- Multimodal Foundation Models: From Specialists to General-Purpose Assistants
  
  Chunyuan Li, Zhe Gan, Zhengyuan Yang, Jianwei Yang, Linjie Li, Lijuan Wang, Jianfeng Gao
  
  September 2023
  
  118-page book/survey on the literature review, evolution, trends and our position on multimodal foundation models. CVPR 2023 Tutorial: https://vlp-tutorial.github.io/2023/
  
  Publication Project
- Neural Approaches to Conversational Information Retrieval
  
  Jianfeng Gao, Chenyan Xiong, Paul Bennett, Nick Craswell
  
  Published by Springer | March 2023, Vol 44
  
  ISBN: 978-3-031-23079-0
  
  The Information Retrieval Series.
  
  Preprint
- Case and Constraint: Research on Intelligent CAD Systems (In Chinese)
  
  Joshua Goodman, Jianfeng Gao
  
  April 1999
  
  PhD Thesis: Shanghai Jiaotong University | April 1999
  
  Publication
- Mining Web Logs for Actionable Knowledge
  
  Qiang Yang, Charles X. Ling, Jianfeng Gao
  
  Intelligent Technologies for Information Analysis | Published by Springer | 2004
  
  Publication

Jianfeng Gao

Publications

Multimodal Reinforcement Learning with Agentic Verifier for AI Agents

Adapting Web Agents with Synthetic Supervision

Interpretable Next-token Prediction via the Generalized Induction Head

Dyna-Mind: Learning to Simulate from Experience for Better AI Agents

MMInference: Accelerating Pre-filling for Long-Context VLMs via Modality-Aware Permutation Sparse Attention

SAS: Simulated Attention Score

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation

CollabLLM: From Passive Responders to Active Collaborators

GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents

Training Language Models to Generate Quality Code with Program Analysis Feedback

Text Generation Beyond Discrete Token Sampling

Data Formulator 2: Iterative Creation of Data Visualizations, with AI Transforming Data Along the Way

Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities

Reinforcement Learning for Reasoning in Large Language Models with One Training Example

SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents

Magma: A Foundation Model for Multimodal AI Agents

Simplifying DINO via Coding Rate Regularization

LLaVA-Rad MIMIC-CXR Annotations

Attribute Structuring Improves LLM-Based Evaluation of Clinical Text Summaries

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation

Compositional Generalization Across Distributional Shifts with Sparse Tree Operations

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMs

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at once

Crafting Interpretable Embeddings by Asking LLMs Questions

A whole-slide foundation model for digital pathology from real-world data

Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

LLM Agent – Retrieve What You Need: A Mutual Learning Framework for Open-domain Question Answering

Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation

Agent AI Towards a Holistic Intelligence

An Interactive Agent Foundation Model

BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

MindAgent: Emergent Gaming Interaction

TrustLLM: Trustworthiness in Large Language Models

Agent AI: Surveying the Horizons of Multimodal Interaction

Bridging Discrete and Backpropagation: Straight-Through and Beyond

Visual In-Context Prompting

Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys

Fast-ELECTRA for Efficient Pre-training

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Augmenting Language Models with Long-Term Memory

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Multimodal Agent — Localized Symbolic Knowledge Distillation for Visual Commonsense Models

Multimodal Foundation Models: From Specialists to General-Purpose Assistants

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Is Self-Repair a Silver Bullet for Code Generation?

Fine-tuning large neural language models for biomedical natural language processing

Self-Verification Improves Few-Shot Clinical Information Extraction

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

ArK: Augmented Reality with Knowledge Emergent Infrastructure

Instruction Tuning with GPT-4

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Neural Approaches to Conversational Information Retrieval

Efficient Long Sequence Modeling via State Space Augmented Transformer

AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models

Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone

Fault-Aware Neural Code Rankers

Explaining Patterns in Data with Language Models via Interpretable Autoprompting

Emb-GAM: an Interpretable and Efficient Predictor using Pre-trained Language Models

Interactive Code Generation via Test-Driven User-Intent Formalization

Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

RegionCLIP: Region-based Language-Image Pretraining

GLIPv2: Unifying Localization and Vision-Language Understanding

Grounded Language-Image Pre-training

OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience

Unified Contrastive Learning in Image-Text-Label Space

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

GODEL: Large-Scale Pre-Training for Goal-Directed Dialog

VLC: Training Vision-Language Transformers from Captions

Neurocompositional computing in human and machine intelligence: A tutorial

Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems