Xiao Liu

Senior Researcher

Publications

Afficher par:

- Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
  
  Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
  
  ACL | August 2025
  
  DOI Publication Publication
- Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
  
  Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
  
  AAAI Conference on Artificial Intelligence, 2025 | April 2025
  
  Oral Presentation
  
  DOI Publication
- Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
  
  Haebin Shin, Lei Ji, Xiao Liu, Yeyun Gong
  
  ICML 2025 | March 2025
  
  DOI Publication Publication
- Optimizing Large Language Model Training Using FP4 Quantization
  
  Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- EpiCoder: Encompassing Diversity and Complexity in Code Generation
  
  Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- Not All Tokens Are What You Need for Pretraining
  
  Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Jian Jiao, Nan Duan, Weizhu Chen
  
  2024 Neural Information Processing Systems | October 2024
  
  Best Paper Runner Up
  
  Publication
- Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning
  
  Yiming Huang, Xiao Liu, Yeyun Gong, Zhibin Gou, Yelong Shen, Nan Duan, Weizhu Chen
  
  March 2024
  
  Publication
- Using Left and Right Brains Together: Towards Vision and Language Planning
  
  Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
  
  ICML 2024 | February 2024
  
  DOI Publication Publication
- AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
  
  Tong Wu, Zhihao Fan, Xiao Liu, Yeyun Gong, Yelong Shen, Jian Jiao, Hai-Tao Zheng, Juntao Li, zhongyu wei, Jian Guo, Nan Duan, Weizhu Chen
  
  NeurIPS 2023 | December 2023
  
  Publication
- SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
  
  Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen
  
  EMNLP 2022 | October 2022
  
  Publication

- Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
  
  Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
  
  ACL | August 2025
  
  DOI Publication Publication
- Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
  
  Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
  
  AAAI Conference on Artificial Intelligence, 2025 | April 2025
  
  Oral Presentation
  
  DOI Publication
- Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
  
  Haebin Shin, Lei Ji, Xiao Liu, Yeyun Gong
  
  ICML 2025 | March 2025
  
  DOI Publication Publication
- Optimizing Large Language Model Training Using FP4 Quantization
  
  Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- EpiCoder: Encompassing Diversity and Complexity in Code Generation
  
  Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- Not All Tokens Are What You Need for Pretraining
  
  Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Jian Jiao, Nan Duan, Weizhu Chen
  
  2024 Neural Information Processing Systems | October 2024
  
  Best Paper Runner Up
  
  Publication
- Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning
  
  Yiming Huang, Xiao Liu, Yeyun Gong, Zhibin Gou, Yelong Shen, Nan Duan, Weizhu Chen
  
  March 2024
  
  Publication
- Using Left and Right Brains Together: Towards Vision and Language Planning
  
  Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
  
  ICML 2024 | February 2024
  
  DOI Publication Publication
- AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
  
  Tong Wu, Zhihao Fan, Xiao Liu, Yeyun Gong, Yelong Shen, Jian Jiao, Hai-Tao Zheng, Juntao Li, zhongyu wei, Jian Guo, Nan Duan, Weizhu Chen
  
  NeurIPS 2023 | December 2023
  
  Publication
- SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
  
  Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen
  
  EMNLP 2022 | October 2022
  
  Publication
- SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
  
  Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen
  
  EMNLP 2022 | October 2022
  
  Publication

- Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training
  
  Zheheng Luo, Xin Zhang, Xiao Liu, Haoling Li, Yeyun Gong, Qi Chen, Peng Cheng
  
  ACL | August 2025
  
  DOI Publication Publication
- Enhancing Large Language Model Performance with Gradient-Based Parameter Selection
  
  Haoling Li, Xin Zhang, Xiao Liu, Yeyun Gong, Yifan Wang, Qi Chen, Peng Cheng
  
  AAAI Conference on Artificial Intelligence, 2025 | April 2025
  
  Oral Presentation
  
  DOI Publication
- Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling
  
  Haebin Shin, Lei Ji, Xiao Liu, Yeyun Gong
  
  ICML 2025 | March 2025
  
  DOI Publication Publication
- Optimizing Large Language Model Training Using FP4 Quantization
  
  Ruizhe Wang, Yeyun Gong, Xiao Liu, Guoshuai Zhao, Ziyue Yang, Baining Guo, Zhengjun Zha, Peng Cheng
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- EpiCoder: Encompassing Diversity and Complexity in Code Generation
  
  Yaoxiang Wang, Haoling Li, Xin Zhang, Jie Wu, Xiao Liu, Wenxiang Hu, Zhongxin Guo, Yangyu Huang, Ying Xin, Yujiu Yang, Jinsong Su, Qi Chen, Scarlett Li
  
  ICML 2025 | January 2025
  
  DOI Publication Publication
- Not All Tokens Are What You Need for Pretraining
  
  Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Jian Jiao, Nan Duan, Weizhu Chen
  
  2024 Neural Information Processing Systems | October 2024
  
  Best Paper Runner Up
  
  Publication
- Using Left and Right Brains Together: Towards Vision and Language Planning
  
  Jun Cen, Chenfei Wu, Xiao Liu, Sheng-Siang Yin, Yixuan Pei, Jinglong Yang, Qifeng Chen, Nan Duan, Jianguo Zhang
  
  ICML 2024 | February 2024
  
  DOI Publication Publication
- AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation
  
  Tong Wu, Zhihao Fan, Xiao Liu, Yeyun Gong, Yelong Shen, Jian Jiao, Hai-Tao Zheng, Juntao Li, zhongyu wei, Jian Guo, Nan Duan, Weizhu Chen
  
  NeurIPS 2023 | December 2023
  
  Publication
- SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval
  
  Kun Zhou, Yeyun Gong, Xiao Liu, Wayne Xin Zhao, Yelong Shen, Anlei Dong, Jingwen Lu, Rangan Majumder, Ji-Rong Wen, Nan Duan, Weizhu Chen
  
  EMNLP 2022 | October 2022
  
  Publication
- Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning
  
  Yiming Huang, Xiao Liu, Yeyun Gong, Zhibin Gou, Yelong Shen, Nan Duan, Weizhu Chen
  
  March 2024
  
  Publication

Xiao Liu

Publications

Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection

Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling

Optimizing Large Language Model Training Using FP4 Quantization

EpiCoder: Encompassing Diversity and Complexity in Code Generation

Not All Tokens Are What You Need for Pretraining

Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning

Using Left and Right Brains Together: Towards Vision and Language Planning

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval

Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection

Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling

Optimizing Large Language Model Training Using FP4 Quantization

EpiCoder: Encompassing Diversity and Complexity in Code Generation

Not All Tokens Are What You Need for Pretraining

Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning

Using Left and Right Brains Together: Towards Vision and Language Planning

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval

Velocitune: A Velocity-based Dynamic Domain Reweighting Method for Continual Pre-training

Enhancing Large Language Model Performance with Gradient-Based Parameter Selection

Overcoming Vocabulary Mismatch: Vocabulary-agnostic Teacher Guided Language Modeling

Optimizing Large Language Model Training Using FP4 Quantization

EpiCoder: Encompassing Diversity and Complexity in Code Generation

Not All Tokens Are What You Need for Pretraining

Using Left and Right Brains Together: Towards Vision and Language Planning

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrieval

Key-Point-Driven Data Synthesis with its Enhancement on Mathematical Reasoning

Contact Xiao Liu

Microsoft Research Lab – Asia