Hao Cheng

Principal Researcher

Publications

Afficher par:

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Projet
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Accès
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Publié par Microsoft
  
  Publication Preprint Accès
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Publié par Microsoft
  
  Publication Projet
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Projet
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Vidéo Accès
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Projet
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Publié par Microsoft
  
  Publication Preprint Accès
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Publié par Microsoft
  
  Publication Projet
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Projet
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Projet
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Publié par Microsoft
  
  Publication Preprint Accès
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Publié par Microsoft
  
  Publication Projet
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Publié par Microsoft
  
  Publication Preprint Accès
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Publié par Microsoft
  
  Publication Projet
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Projet
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Accès
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Accès
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Vidéo Accès
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication

- Multimodal Reinforcement Learning with Agentic Verifier for AI Agents
  
  Reuben Tan, Baolin Peng, Zhengyuan Yang, Hao Cheng, Oier Mees, Theodore Zhao, Andrea Tupini, Isar Meijer, Qianhui Wu, Yuncong Yang, Lars Liden, Yu Gu, Sheng Zhang, Xiaodong Liu, Lijuan Wang, Marc Pollefeys, Yong Jae Lee, Jianfeng Gao
  
  December 2025
  
  PDF
- Dyna-Mind: Learning to Simulate from Experience for Better AI Agents
  
  Xiao Yu, Baolin Peng, Michel Galley, Hao Cheng, Qianhui Wu, Janardhan Kulkarni, Suman Nath, Zhou Yu, Jianfeng Gao
  
  October 2025
  
  Under review as a conference paper at ICLR 2026
  
  Publication
- Self-Verification Improves Few-Shot Clinical Information Extraction
  
  Zelalem Gero, Chandan Singh, Hao Cheng, Tristan Naumann, Michel Galley, Jianfeng Gao, Hoifung Poon
  
  May 2023
  
  Publication
- Posterior Differential Regularization with f-divergence for Improving Model Robustness
  
  Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao
  
  October 2020
  
  Publication
- Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing
  
  Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  August 2020
  
  PDF Vidéo Accès
- SAS: Simulated Attention Score
  
  Chuanyang Zheng, Jiankai Sun, Yihang Gao, Yuehao Wang, Peihao Wang, Jing Xiong, Liliang Ren, Hao Cheng, Janardhan (Jana) Kulkarni, Yelong Shen, Atlas Wang, Mac Schwager, Anderson Schneider, Xiaodong Liu, Jianfeng Gao
  
  NeurIPS 2025 | July 2025
  
  DOI Publication
- Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation
  
  Liliang Ren, Congcong Chen, Haoran Xu, Young Jin Kim, Adam Atkinson, Zheng Zhan, Jiankai Sun, Baolin Peng, Liyuan Liu, Shuohang Wang, Hao Cheng, Jianfeng Gao, Weizhu Chen, Yelong Shen
  
  NeurIPS 2025 | July 2025
  
  DOI
- CollabLLM: From Passive Responders to Active Collaborators
  
  Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, J. Leskovec, Jianfeng Gao
  
  ICML 2025 | July 2025
  
  PDF Publication Github
- Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities
  
  Chung-En Sun, Xiaodong Liu, Weiwei Yang, Tsui-Wei Weng, Hao Cheng, Aidan San, Michel Galley, Jianfeng Gao
  
  NAACL 2025 | April 2025
  
  Selected for oral presentation
  
  Publication
- Reinforcement Learning for Reasoning in Large Language Models with One Training Example
  
  Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, S. Du, Yelong Shen
  
  NeurIPS 2025 | April 2025
  
  DOI Publication Publication
- SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents
  
  Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H. Vicky Zhao, Lili Qiu, Jianfeng Gao
  
  ICLR 2025 | April 2025
  
  Publication Github Projet
- PEACE: Empowering Geologic Map Holistic Understanding with MLLMs
  
  Yangyu Huang, Tianyi Gao, Haoran Xu, Qihao Zhao, Yang Song, Zhipeng Gui, Tengchao Lv, Hao Cheng, Lei Cui, Scarlett Li, Furu Wei
  
  January 2025
  
  Publication Accès
- Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass
  
  Tong Chen, Hao Fang, Patrick Xia, Xiaodong Liu, Ben Van Durme, Luke Zettlemoyer, Jianfeng Gao, Hao Cheng
  
  ICLR 2025 | November 2024
  
  DOI Publication Publication
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- Augmenting Language Models with Long-Term Memory
  
  Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
  
  NeurIPS 2023 | October 2023
  
  Publication
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models
  
  Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao
  
  NeurIPS 2023 | October 2023
  
  Publication
- Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering
  
  Hao Cheng, Hao Fang, Xiaodong Liu, Jianfeng Gao
  
  ACL 2023 | July 2023
  
  Publication
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention
  
  Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang
  
  IJCAI 2022 | July 2022
  
  human parity result on CommonsenseQA
  
  Publication
- Knowledge-Rich Self-Supervision for Biomedical Entity Linking
  
  Sheng Zhang, Hao Cheng, Shikhar Vashishth, Cliff Wong, Jinfeng Xiao, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  EMNLP 2022 | May 2022
  
  Publication
- Open Domain Question Answering with A Unified Knowledge Interface
  
  Kaixin Ma, Hao Cheng, Xiaodong Liu, Eric Nyberg, Jianfeng Gao
  
  ACL 2022 | May 2022
  
  Publication
- CLUES: Few-Shot Learning Evaluation in Natural Language Understanding
  
  Subhabrata (Subho) Mukherjee, Xiaodong Liu, Guoqing Zheng, Saghar Hosseini, Hao Cheng, Greg Yang, Chris Meek, Ahmed Awadallah, Jianfeng Gao
  
  NeurIPS 2021 | December 2021
  
  Publication Github Projet
- Dialogue State Tracking with a Language Model using Schema-Driven Prompting
  
  Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf
  
  2021 Empirical Methods in Natural Language Processing | September 2021
  
  Publication
- Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature
  
  Yu Wang, Jinchao Li, Tristan Naumann, Chenyan Xiong, Hao Cheng, Rob Tinn, Cliff Wong, Naoto Usuyama, Rick Rogahn, Zhihong Shen, Yang Qin, Eric Horvitz, Paul Bennett, Jianfeng Gao, Hoifung Poon
  
  KDD 2021 | August 2021
  
  Publication Publication Projet
- UnitedQA: A Hybrid Approach for Open Domain Question Answering
  
  Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Wei Chen, Jianfeng Gao
  
  ACL-IJCNLP 2021 | December 2020
  
  Publication
- Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.
  
  Hao Cheng, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
  
  Meeting of the Association for Computational Linguistics | June 2020
  
  DOI PDF Publication Publication
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding
  
  Xiaodong Liu, Yu Wang, Jianshu Ji, Hao Cheng, Xueyun Zhu, Emmanuel Awa, Pengcheng He, Weizhu Chen, Hoifung Poon, Guihong Cao, Jianfeng Gao
  
  Meeting of the Association for Computational Linguistics | February 2020
  
  DOI PDF PDF Publication Publication Publication Publication Publication
- ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning
  
  Xiao Yu, Baolin Peng, Vineeth Vajipey, Hao Cheng, Michel Galley, Jianfeng Gao, Zhou Yu
  
  MSR-TR-2024-63 | October 2024
  
  Publié par Microsoft
  
  Publication Preprint Accès
- Check your facts and try again: Improving large language models with external knowledge and automated feedback
  
  Baoling Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Yu Hu, Qiuyuan Huang, Lars Liden, Zhou Yu, Weizhu Chen, Jianfeng Gao
  
  MSR-TR-2023-46 | March 2023
  
  Publié par Microsoft
  
  Publication Projet
- Fine-tuning large neural language models for biomedical natural language processing
  
  Rob Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon
  
  Patterns | June 2023, Vol 4(4)
  
  Publication Publication

Hao Cheng

Publications

Multimodal Reinforcement Learning with Agentic Verifier for AI Agents

Dyna-Mind: Learning to Simulate from Experience for Better AI Agents

SAS: Simulated Attention Score

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation

CollabLLM: From Passive Responders to Active Collaborators

Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities

Reinforcement Learning for Reasoning in Large Language Models with One Training Example

SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents

PEACE: Empowering Geologic Map Holistic Understanding with MLLMs

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

Fast-ELECTRA for Efficient Pre-training

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Augmenting Language Models with Long-Term Memory

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Fine-tuning large neural language models for biomedical natural language processing

Self-Verification Improves Few-Shot Clinical Information Extraction

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

Open Domain Question Answering with A Unified Knowledge Interface

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Dialogue State Tracking with a Language Model using Schema-Driven Prompting

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

UnitedQA: A Hybrid Approach for Open Domain Question Answering

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

Multimodal Reinforcement Learning with Agentic Verifier for AI Agents

Dyna-Mind: Learning to Simulate from Experience for Better AI Agents

SAS: Simulated Attention Score

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation

CollabLLM: From Passive Responders to Active Collaborators

Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities

Reinforcement Learning for Reasoning in Large Language Models with One Training Example

SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

Fast-ELECTRA for Efficient Pre-training

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

Augmenting Language Models with Long-Term Memory

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Fine-tuning large neural language models for biomedical natural language processing

Self-Verification Improves Few-Shot Clinical Information Extraction

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

UnitedQA: A Hybrid Approach for Open Domain Question Answering

Posterior Differential Regularization with f-divergence for Improving Model Robustness

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities

CollabLLM: From Passive Responders to Active Collaborators

SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

Check your facts and try again: Improving large language models with external knowledge and automated feedback

CollabLLM: From Passive Responders to Active Collaborators

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

Check your facts and try again: Improving large language models with external knowledge and automated feedback

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention

Knowledge-Rich Self-Supervision for Biomedical Entity Linking

Open Domain Question Answering with A Unified Knowledge Interface

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding

Dialogue State Tracking with a Language Model using Schema-Driven Prompting

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering.

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding

PEACE: Empowering Geologic Map Holistic Understanding with MLLMs

PEACE: Empowering Geologic Map Holistic Understanding with MLLMs

Fine-tuning large neural language models for biomedical natural language processing

Self-Verification Improves Few-Shot Clinical Information Extraction

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature