Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
Zhihe Yang, Xufang Luo, Zilong Wang, Dongqi Han, Zhiyuan He, Dongsheng Li, Yunjian Xu
2026 International Conference on Learning Representations | April 2026
Zhiyuan He
Research Software Development Engineer II
Publications
-
-
-
-
$\Delta L$ Normalization: Rethink Loss Aggregation in RLVR
Zhiyuan He, Xufang Luo, Yike Zhang, Yuqing Yang, Lili Qiu
September 2025
-
-
-
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
Siyun Zhao, Yuqing Yang, Zilong Wang, Zhiyuan He, Luna K. Qiu, Lili Qiu
September 2024
-
-
-
Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
Zhihe Yang, Xufang Luo, Zilong Wang, Dongqi Han, Zhiyuan He, Dongsheng Li, Yunjian Xu
2026 International Conference on Learning Representations | April 2026
-
-
-
Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
Zhihe Yang, Xufang Luo, Zilong Wang, Dongqi Han, Zhiyuan He, Dongsheng Li, Yunjian Xu
2026 International Conference on Learning Representations | April 2026
-
$\Delta L$ Normalization: Rethink Loss Aggregation in RLVR
Zhiyuan He, Xufang Luo, Yike Zhang, Yuqing Yang, Lili Qiu
September 2025
-
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
Siyun Zhao, Yuqing Yang, Zilong Wang, Zhiyuan He, Luna K. Qiu, Lili Qiu
September 2024
-
-
-
Do Not Let Low-Probability Tokens Over-Dominate in RL for LLMs
Zhihe Yang, Xufang Luo, Zilong Wang, Dongqi Han, Zhiyuan He, Dongsheng Li, Yunjian Xu
2026 International Conference on Learning Representations | April 2026
-
-
-
$\Delta L$ Normalization: Rethink Loss Aggregation in RLVR
Zhiyuan He, Xufang Luo, Yike Zhang, Yuqing Yang, Lili Qiu
September 2025
-
Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
Siyun Zhao, Yuqing Yang, Zilong Wang, Zhiyuan He, Luna K. Qiu, Lili Qiu
September 2024
-