Fan Yang

Partner Research Manager

Publications

View by:

- MeshRT: Compile-Time Governed Wafer-Scale Runtime for Low-Latency High-Throughput Inference
  
  Congjie He, Le Xu, Zhan Lu, Yeqi Huang, Haocheng Xiao, Cheng Deng, Lingxiao Ma, Ziming Miao, Fan Yang, Luo Mai
- Wavel: A Fast and Efficient Compilation System for Wafer-Scale Accelerators
  
  Yeqi Huang, Congjie He, Haocheng Xiao, Yanwei Ye, Yi-Chieh Wang, Boyao Song, Yangshen Deng, Ziming Miao, Lingxiao Ma, Fan Yang, Luo Mai
- Diagnosing with Insights: Structured Analysis of Agent Failures via Behavioral Abstractions
  
  Jiayi Bi, Yanjie Gao, Yuanmin Xie, Liqun Li, Tianyin Xu, Fan Yang, Mao Yang
  
  September 2026
  
  September 2026
  
  Preprint
- AgentSpec: Speculative Decoding for Batch Inference of LLM Agents
  
  Xin Wang, Ziming Miao, Yi Zhu, Hui Shen, Zhongwei Wan, Fan Yang, Mi Zhang
  
  EMNLP 2026 | August 2026
  
  Publication
- Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
  
  Gen Dong, Yanjie Gao, Liqun Li, Tianyin Xu, Yu Hua, Fan Yang
  
  August 2026
  
  August 2026
  
  Publication
- Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
  
  Hui Xue, Fan Yang
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning
  
  Boxiu Li, Zimo Wen, Yijia Fan, Junxiang Lei, Sufeng Guo, Jiaao Wu, Ruize Tang, Mukai Li, Yifei Shen, Xiaoyu Chen, Wanbo Zhang, Runjing Gu, Yifei Gao, Yuheng Wu, Xuyao Huang, Zelong Zhao, Jiachen Zhang, Shibo Hu, Hangxi Guo, Yilin Chen, Yuzhe Zhang, Fan Yang, Chuan Wen, Xian Zhang, Xuanhe Zhou, Zhijie Deng
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters
  
  Zhiwen Mo, Yu Cheng, Lei Wang, Zhengju Tang, Lei Xu, Guoyu Li, Yuqiu Dong, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Luo Mai, Zhi Yang, Wayne Luk, Hongxiang Fan
  
  July 2026
  
  arXiv | July 2026
  
  Publication
- Euclean: Automated Geometry Problem Formalization with Unified Verification in Lean
  
  Linbin Tang, Jingyan You, Zilin Kang, Hanzhang Liu, Sophia Zhang, Zenan Li, Chenrui Cao, Liangcheng Song, Jiaao Wu, Xian Zhang, Fan Yang
  
  2026 ICML 2026 | July 2026
  
  PDF
- STAR-P’olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
  
  Jiaao Wu, Xian Zhang, Han Liu, Sophia Zhang, Fan Yang, Yinpeng Dong
  
  May 2026
  
  arXiv | May 2026
  
  Publication
- Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
  
  Zihan Zhao, Baotong Lu, Shengjie Lin, Yizou Chen, Jing Liu, Yanqi Zhang, Ziming Miao, Ming-Chang Yang, Haiying Shen, Qi Chen, Fan Yang
  
  April 2026
  
  arXiv | April 2026
  
  Publication
- SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
  
  Yizhao Gao, Shuming Guo, Shijie Cao, Yuqing Xia, Yu Cheng, Lei Wang, Lingxiao Ma, Yutao Sun, Tianzhu Ye, Li Dong, Hayden Kwok-Hay So, Yu Hua, Ting Cao, Fan Yang, Mao Yang
  
  ICLR 2026 | February 2026
  
  Publication
- Neuro-Symbolic Verification on Instruction Following of LLMs
  
  Yiming Su, Kunzhao Xu, Yanjie Gao, Fan Yang, Cheng Li, Mao Yang, Tianyin Xu
  
  January 2026
  
  January 2026
  
  Preprint
- Vibe Reasoning: Eliciting Frontier AI Mathematical Capabilities — A Case Study on IMO 2025 Problem 6
  
  Jiaao Wu, Xian Zhang, Fan Yang, Yinpeng Dong
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- Scalable Distributed Vector Search via Accuracy Preserving Index Construction
  
  Yuming Xu, Qianxi Zhang, Qi Chen, Baotong Lu, Menghao Li, Philip Adams, Mingqin Li, Zengzhong Li, Jing Liu, Cheng Li, Fan Yang
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models
  
  Chenrui Cao, Liangcheng Song, Zenan Li, Xinyi Le, Xian Zhang, Hui Xue, Fan Yang
  
  NeurIPS 2025 | December 2025
  
  DOI Publication Publication
- LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
  
  Siyuan Wang, Gaokai Zhang, L. Zhang, Ning Shang, Fan Yang, Dongyao Chen, Mao Yang
  
  ICLR 2026 | October 2025
  
  DOI Publication
- AutoVerus: Automated Proof Generation for Rust Code
  
  Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu
  
  Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2025
  
  Distinguished Artifact Award
  
  Publication Github Project
- Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, DaYou Du, Shijie Cao, Peiyuan Zhou, Jiaxing Qi, Junjie Lai, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | October 2025
  
  Publication
- TrainVerify: Equivalence-Based Verification for Distributed LLM Training
  
  Yunchi Lu, Youshan Miao, Cheng Tan, Peng Huang, Yi Zhu, Xian Zhang, Fan Yang
  
  Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles (SOSP'25) | October 2025
  
  Publication Github
- WaferLLM: Large Language Model Inference at Wafer Scale
  
  Congjie He, Yeqi Huang, Pei Mu, Ziming Miao, Jilong Xue, Lingxiao Ma, Fan Yang, Luo Mai
  
  OSDI 2025 | July 2025
  
  Publication
- LongRoPE2: Near-Lossless LLM Context Window Scaling
  
  Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
  
  ICML 2025 | July 2025
  
  Publication
- PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
  
  Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
  
  OSDI | July 2025
  
  Publication
- RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
  
  June 2025
  
  DOI Github
- Autoformalizing Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  June 2025
  
  June 2025
  
  Publication
- rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset
  
  Yifei Liu, Li Lyna Zhang, Yi Zhu, Bingcheng Dong, Xudong Zhou, Ning Shang, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jin-Kang Zhang, Baotong Lu, Qianxi Zhang, Cheng Zhang, Jing Liu, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Cheng Li, Yuqing Yang, Fan Yang, Mao Yang
  
  VLDB Endowment | May 2025, Vol 19(5)
  
  DOI Publication
- SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Peiyuan Zhou, Ji Qi, Junjie Lai, Hayden Kwok-Hay, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  PDF
- TileLang: A Composable Tiled Programming Model for AI Systems
  
  Lei Wang, Yu Cheng, Yining Shi, Zhengju Tang, Zhiwen Mo, Wenhao Xie, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Zhi Yang
  
  April 2025
  
  arXiv | April 2025
  
  DOI Publication Publication
- Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
  
  Zenan Li, Zhaoyu Li, Wen Tang, Xian Zhang, Yuan Yao, Xujie Si, Fan Yang, Kaiyu Yang, Xiaoxing Ma
  
  ICLR | April 2025
  
  DOI Publication Publication
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  
  Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
  
  ICML 2025 (oral) | January 2025
  
  Publication DOI Github
- Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Neuro-Symbolic Data Generation for Math Reasoning
  
  Zenan Li, Zhi Zhou, Yuan Yao, Yu-Feng Li, Chun Cao, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
  
  SOSP | November 2024
  
  Publication
- Automated Proof Generation for Rust Code via Self-Evolution
  
  Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng Cheng, Fan Yang, Shuvendu Lahiri, Tao Xie, Lidong Zhou
  
  ICLR 2025 | October 2024
  
  Publication Project
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  October 2024
  
  ArXiv | October 2024
  
  DOI
- IRGen: Generative Modeling for Image Retrieval
  
  Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
  
  ECCV'24 | October 2024
  
  DOI Publication Publication Publication
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
  
  Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
  
  NeurIPS 2025 | September 2024
  
  Best Paper Award | ENLSP NeurIPS Workshop 2024
  
  Publication
- Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Ying Cao, Fan Yang, Mao Yang
  
  September 2024
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
  
  Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
  
  MSR-TR-2024-12 | August 2024
  
  Published by Microsoft
  
  Publication Video Access Project
- Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
  
  Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
  
  SIGKDD'24 | August 2024
  
  DOI Publication Publication
- Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
  
  Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
  
  ICLR 2025 | August 2024
  
  Publication
- LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
  
  Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
  
  August 2024
  
  arXiv | August 2024
  
  DOI Publication Publication Project
- Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
  
  Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
  
  OSDI 2024 | July 2024
  
  Publication
- nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
  
  Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
  
  OSDI | July 2024
  
  Publication Github
- Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
  
  Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu
  
  OSDI 2024 | May 2024
  
  Publication Github
- MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
  
  Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
  
  The Web Conference | May 2024
  
  Publication PDF Access
- OneSparse: A Unified System for Multi-index Vector Search
  
  Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
  
  The Web Conference | May 2024
  
  Publication
- Amanda: Unified Instrumentation Framework for Deep Neural Networks
  
  Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo
  
  ASPLOS | April 2024
  
  Publication
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
  
  Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
  
  ICML 2024 | February 2024
  
  Publication DOI Github
- Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
  
  Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
  
  EMNLP | February 2024
  
  Publication
- PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
  
  Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
  
  The 29th ACM Symposium on Operating Systems Principles | October 2023
  
  Publication
- SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
  
  Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
  
  SOSP'23 | October 2023
  
  Microsoft Research Blog
  
  https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
  
  Publication
- BitNet: Scaling 1-bit Transformers for Large Language Models
  
  Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
  
  October 2023
  
  arXiv | October 2023
  
  DOI Publication
- Model-enhanced Vector Index
  
  Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
  
  NeurIPS 2023 | October 2023
  
  Publication
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
  
  Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
  
  ACL 2023 | July 2023
  
  Publication
- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Optimizing Dynamic Neural Networks with Brainstorm
  
  Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
  
  OSDI'23 | July 2023
  
  Publication
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
  
  Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  OSDI'23 | July 2023
  
  Publication
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication Project
- OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization
  
  Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  ISCA | June 2023
  
  PDF Project
- SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou
  
  EuroSys 2023 | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning
  
  Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu
  
  ASPLOS 2023 | March 2023
  
  Publication
- ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization
  
  Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  MICRO | October 2022
  
  IEEE Micro Top Picks 2023 Honorable Mention
  
  PDF
- PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training
  
  Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo
  
  USENIX Annual Technical Conference | July 2022
  
  PDF
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication Project
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project Project
- Tutel: Adaptive Mixture-of-Experts at Scale
  
  Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
  
  July 2022
  
  Publication
- Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
  
  Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
  
  SIGIR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
  
  Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan
  
  November 2021
  
  arXiv | November 2021
  
  DOI PDF
- A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  MSR-TR-2021-20 | August 2021
  
  Published by Microsoft
  
  Publication
- HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Project
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication Project
- Retiarii: A Deep Learning Exploratory-Training Framework
  
  Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Video
- XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
  
  Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou
  
  EMNLP 2020 | April 2020
  
  Publication PDF Github Github Github Project
- Capuchin: Tensor-based GPU Memory Management for Deep Learning
  
  Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian
  
  ASPLOS | March 2020
  
  Publication Project
- Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  2019 USENIX Annual Technical Conference | May 2019
  
  PDF Publication Github Project Project
- Gandiva: Introspective Cluster Scheduling for Deep Learning
  
  Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou
  
  13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018
  
  Publication Project Project Project
- Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  MSR-TR-2018-13 | May 2018
  
  Published by Microsoft
  
  Publication Github Project
- GraM: Scaling Graph Computation to the Trillions
  
  Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou
  
  SoCC 2015 | August 2015
  
  The 6th ACM Symposium on Cloud Computing
  
  Publication DOI Project
- ImmortalGraph: A System for Storage and Analysis of Temporal Graphs
  
  Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou
  
  ACM Transactions on Storage (TOS) | July 2015
  
  Publication Publication Project
- Arming Cloud Services with Task Aspects
  
  Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
  
  MSR-TR-2014-150 | November 2014
  
  Published by Microsoft
  
  Publication
- Chronos: A Graph Engine for Temporal Graph Analysis
  
  Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou
  
  EuroSys | April 2014
  
  PDF Publication Publication Project
- Kineograph: taking the pulse of a fast-changing and connected world
  
  Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen
  
  ACM Eurosys | April 2012
  
  PDF Publication Publication Project
- Sonora: A Platform for Continuous Mobile-Cloud Computing
  
  Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen
  
  MSR-TR-2012-34 | March 2012
  
  PDF PDF
- Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services
  
  Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu
  
  IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749
  
  DOI Publication Publication Publication Publication Publication
- Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks
  
  Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang
  
  MSR-TR-2006-165 | November 2006
  
  PDF
- AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks
  
  K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu
  
  May 2005
  
  Publication Publication
- LION: Layered Overlay Multicast with Network Coding
  
  J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang
  
  IEEE Transactions on Multimedia | May 2004
- End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet
  
  Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang
  
  IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)
  
  Publication

- AgentSpec: Speculative Decoding for Batch Inference of LLM Agents
  
  Xin Wang, Ziming Miao, Yi Zhu, Hui Shen, Zhongwei Wan, Fan Yang, Mi Zhang
  
  EMNLP 2026 | August 2026
  
  Publication
- STAR-P’olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
  
  Jiaao Wu, Xian Zhang, Han Liu, Sophia Zhang, Fan Yang, Yinpeng Dong
  
  May 2026
  
  arXiv | May 2026
  
  Publication
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
  
  Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
  
  NeurIPS 2025 | September 2024
  
  Best Paper Award | ENLSP NeurIPS Workshop 2024
  
  Publication
- XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
  
  Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou
  
  EMNLP 2020 | April 2020
  
  Publication PDF Github Github Github Project
- Wavel: A Fast and Efficient Compilation System for Wafer-Scale Accelerators
  
  Yeqi Huang, Congjie He, Haocheng Xiao, Yanwei Ye, Yi-Chieh Wang, Boyao Song, Yangshen Deng, Ziming Miao, Lingxiao Ma, Fan Yang, Luo Mai
- MeshRT: Compile-Time Governed Wafer-Scale Runtime for Low-Latency High-Throughput Inference
  
  Congjie He, Le Xu, Zhan Lu, Yeqi Huang, Haocheng Xiao, Cheng Deng, Lingxiao Ma, Ziming Miao, Fan Yang, Luo Mai
- AutoVerus: Automated Proof Generation for Rust Code
  
  Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu
  
  Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2025
  
  Distinguished Artifact Award
  
  Publication Github Project
- TrainVerify: Equivalence-Based Verification for Distributed LLM Training
  
  Yunchi Lu, Youshan Miao, Cheng Tan, Peng Huang, Yi Zhu, Xian Zhang, Fan Yang
  
  Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles (SOSP'25) | October 2025
  
  Publication Github
- WaferLLM: Large Language Model Inference at Wafer Scale
  
  Congjie He, Yeqi Huang, Pei Mu, Ziming Miao, Jilong Xue, Lingxiao Ma, Fan Yang, Luo Mai
  
  OSDI 2025 | July 2025
  
  Publication
- PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
  
  Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
  
  OSDI | July 2025
  
  Publication
- LongRoPE2: Near-Lossless LLM Context Window Scaling
  
  Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
  
  ICML 2025 | July 2025
  
  Publication
- Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
  
  Zenan Li, Zhaoyu Li, Wen Tang, Xian Zhang, Yuan Yao, Xujie Si, Fan Yang, Kaiyu Yang, Xiaoxing Ma
  
  ICLR | April 2025
  
  DOI Publication Publication
- Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
  
  SOSP | November 2024
  
  Publication
- Automated Proof Generation for Rust Code via Self-Evolution
  
  Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng Cheng, Fan Yang, Shuvendu Lahiri, Tao Xie, Lidong Zhou
  
  ICLR 2025 | October 2024
  
  Publication Project
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  October 2024
  
  ArXiv | October 2024
  
  DOI
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
  
  Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
  
  NeurIPS 2025 | September 2024
  
  Best Paper Award | ENLSP NeurIPS Workshop 2024
  
  Publication
- Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Ying Cao, Fan Yang, Mao Yang
  
  September 2024
- nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
  
  Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
  
  OSDI | July 2024
  
  Publication Github
- Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
  
  Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
  
  OSDI 2024 | July 2024
  
  Publication
- MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
  
  Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
  
  The Web Conference | May 2024
  
  Publication PDF Access
- Amanda: Unified Instrumentation Framework for Deep Neural Networks
  
  Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo
  
  ASPLOS | April 2024
  
  Publication
- SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
  
  Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
  
  SOSP'23 | October 2023
  
  Microsoft Research Blog
  
  https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
  
  Publication
- PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
  
  Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
  
  The 29th ACM Symposium on Operating Systems Principles | October 2023
  
  Publication
- Optimizing Dynamic Neural Networks with Brainstorm
  
  Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
  
  OSDI'23 | July 2023
  
  Publication
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
  
  Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  OSDI'23 | July 2023
  
  Publication
- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication Project
- OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization
  
  Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  ISCA | June 2023
  
  PDF Project
- SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou
  
  EuroSys 2023 | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning
  
  Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu
  
  ASPLOS 2023 | March 2023
  
  Publication
- ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization
  
  Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  MICRO | October 2022
  
  IEEE Micro Top Picks 2023 Honorable Mention
  
  PDF
- PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training
  
  Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo
  
  USENIX Annual Technical Conference | July 2022
  
  PDF
- Tutel: Adaptive Mixture-of-Experts at Scale
  
  Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
  
  July 2022
  
  Publication
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project Project
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication Project
- A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  MSR-TR-2021-20 | August 2021
  
  Published by Microsoft
  
  Publication
- HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Project
- Retiarii: A Deep Learning Exploratory-Training Framework
  
  Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Video
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication Project
- Capuchin: Tensor-based GPU Memory Management for Deep Learning
  
  Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian
  
  ASPLOS | March 2020
  
  Publication Project
- Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  2019 USENIX Annual Technical Conference | May 2019
  
  PDF Publication Github Project Project
- Gandiva: Introspective Cluster Scheduling for Deep Learning
  
  Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou
  
  13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018
  
  Publication Project Project Project
- Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  MSR-TR-2018-13 | May 2018
  
  Published by Microsoft
  
  Publication Github Project
- GraM: Scaling Graph Computation to the Trillions
  
  Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou
  
  SoCC 2015 | August 2015
  
  The 6th ACM Symposium on Cloud Computing
  
  Publication DOI Project
- ImmortalGraph: A System for Storage and Analysis of Temporal Graphs
  
  Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou
  
  ACM Transactions on Storage (TOS) | July 2015
  
  Publication Publication Project
- Arming Cloud Services with Task Aspects
  
  Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
  
  MSR-TR-2014-150 | November 2014
  
  Published by Microsoft
  
  Publication
- Chronos: A Graph Engine for Temporal Graph Analysis
  
  Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou
  
  EuroSys | April 2014
  
  PDF Publication Publication Project
- Kineograph: taking the pulse of a fast-changing and connected world
  
  Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen
  
  ACM Eurosys | April 2012
  
  PDF Publication Publication Project
- Sonora: A Platform for Continuous Mobile-Cloud Computing
  
  Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen
  
  MSR-TR-2012-34 | March 2012
  
  PDF PDF
- Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks
  
  Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang
  
  MSR-TR-2006-165 | November 2006
  
  PDF
- End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet
  
  Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang
  
  IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)
  
  Publication
- Diagnosing with Insights: Structured Analysis of Agent Failures via Behavioral Abstractions
  
  Jiayi Bi, Yanjie Gao, Yuanmin Xie, Liqun Li, Tianyin Xu, Fan Yang, Mao Yang
  
  September 2026
  
  September 2026
  
  Preprint
- Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
  
  Gen Dong, Yanjie Gao, Liqun Li, Tianyin Xu, Yu Hua, Fan Yang
  
  August 2026
  
  August 2026
  
  Publication
- Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
  
  Hui Xue, Fan Yang
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning
  
  Boxiu Li, Zimo Wen, Yijia Fan, Junxiang Lei, Sufeng Guo, Jiaao Wu, Ruize Tang, Mukai Li, Yifei Shen, Xiaoyu Chen, Wanbo Zhang, Runjing Gu, Yifei Gao, Yuheng Wu, Xuyao Huang, Zelong Zhao, Jiachen Zhang, Shibo Hu, Hangxi Guo, Yilin Chen, Yuzhe Zhang, Fan Yang, Chuan Wen, Xian Zhang, Xuanhe Zhou, Zhijie Deng
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- Euclean: Automated Geometry Problem Formalization with Unified Verification in Lean
  
  Linbin Tang, Jingyan You, Zilin Kang, Hanzhang Liu, Sophia Zhang, Zenan Li, Chenrui Cao, Liangcheng Song, Jiaao Wu, Xian Zhang, Fan Yang
  
  2026 ICML 2026 | July 2026
  
  PDF
- STAR-P’olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
  
  Jiaao Wu, Xian Zhang, Han Liu, Sophia Zhang, Fan Yang, Yinpeng Dong
  
  May 2026
  
  arXiv | May 2026
  
  Publication
- Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
  
  Zihan Zhao, Baotong Lu, Shengjie Lin, Yizou Chen, Jing Liu, Yanqi Zhang, Ziming Miao, Ming-Chang Yang, Haiying Shen, Qi Chen, Fan Yang
  
  April 2026
  
  arXiv | April 2026
  
  Publication
- SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
  
  Yizhao Gao, Shuming Guo, Shijie Cao, Yuqing Xia, Yu Cheng, Lei Wang, Lingxiao Ma, Yutao Sun, Tianzhu Ye, Li Dong, Hayden Kwok-Hay So, Yu Hua, Ting Cao, Fan Yang, Mao Yang
  
  ICLR 2026 | February 2026
  
  Publication
- Neuro-Symbolic Verification on Instruction Following of LLMs
  
  Yiming Su, Kunzhao Xu, Yanjie Gao, Fan Yang, Cheng Li, Mao Yang, Tianyin Xu
  
  January 2026
  
  January 2026
  
  Preprint
- Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models
  
  Chenrui Cao, Liangcheng Song, Zenan Li, Xinyi Le, Xian Zhang, Hui Xue, Fan Yang
  
  NeurIPS 2025 | December 2025
  
  DOI Publication Publication
- LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
  
  Siyuan Wang, Gaokai Zhang, L. Zhang, Ning Shang, Fan Yang, Dongyao Chen, Mao Yang
  
  ICLR 2026 | October 2025
  
  DOI Publication
- AutoVerus: Automated Proof Generation for Rust Code
  
  Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu
  
  Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2025
  
  Distinguished Artifact Award
  
  Publication Github Project
- Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, DaYou Du, Shijie Cao, Peiyuan Zhou, Jiaxing Qi, Junjie Lai, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | October 2025
  
  Publication
- LongRoPE2: Near-Lossless LLM Context Window Scaling
  
  Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
  
  ICML 2025 | July 2025
  
  Publication
- RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
  
  June 2025
  
  DOI Github
- Autoformalizing Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  June 2025
  
  June 2025
  
  Publication
- rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset
  
  Yifei Liu, Li Lyna Zhang, Yi Zhu, Bingcheng Dong, Xudong Zhou, Ning Shang, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jin-Kang Zhang, Baotong Lu, Qianxi Zhang, Cheng Zhang, Jing Liu, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Cheng Li, Yuqing Yang, Fan Yang, Mao Yang
  
  VLDB Endowment | May 2025, Vol 19(5)
  
  DOI Publication
- SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Peiyuan Zhou, Ji Qi, Junjie Lai, Hayden Kwok-Hay, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  PDF
- TileLang: A Composable Tiled Programming Model for AI Systems
  
  Lei Wang, Yu Cheng, Yining Shi, Zhengju Tang, Zhiwen Mo, Wenhao Xie, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Zhi Yang
  
  April 2025
  
  arXiv | April 2025
  
  DOI Publication Publication
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  
  Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
  
  ICML 2025 (oral) | January 2025
  
  Publication DOI Github
- Neuro-Symbolic Data Generation for Math Reasoning
  
  Zenan Li, Zhi Zhou, Yuan Yao, Yu-Feng Li, Chun Cao, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Automated Proof Generation for Rust Code via Self-Evolution
  
  Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng Cheng, Fan Yang, Shuvendu Lahiri, Tao Xie, Lidong Zhou
  
  ICLR 2025 | October 2024
  
  Publication Project
- IRGen: Generative Modeling for Image Retrieval
  
  Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
  
  ECCV'24 | October 2024
  
  DOI Publication Publication Publication
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
  
  Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
  
  NeurIPS 2025 | September 2024
  
  Best Paper Award | ENLSP NeurIPS Workshop 2024
  
  Publication
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
  
  Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
  
  MSR-TR-2024-12 | August 2024
  
  Published by Microsoft
  
  Publication Video Access Project
- Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
  
  Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
  
  SIGKDD'24 | August 2024
  
  DOI Publication Publication
- Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
  
  Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
  
  ICLR 2025 | August 2024
  
  Publication
- LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
  
  Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
  
  August 2024
  
  arXiv | August 2024
  
  DOI Publication Publication Project
- nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
  
  Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
  
  OSDI | July 2024
  
  Publication Github
- Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
  
  Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu
  
  OSDI 2024 | May 2024
  
  Publication Github
- OneSparse: A Unified System for Multi-index Vector Search
  
  Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
  
  The Web Conference | May 2024
  
  Publication
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
  
  Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
  
  ICML 2024 | February 2024
  
  Publication DOI Github
- Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
  
  Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
  
  EMNLP | February 2024
  
  Publication
- PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
  
  Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
  
  The 29th ACM Symposium on Operating Systems Principles | October 2023
  
  Publication
- BitNet: Scaling 1-bit Transformers for Large Language Models
  
  Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
  
  October 2023
  
  arXiv | October 2023
  
  DOI Publication
- Model-enhanced Vector Index
  
  Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
  
  NeurIPS 2023 | October 2023
  
  Publication
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
  
  Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
  
  ACL 2023 | July 2023
  
  Publication
- Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
  
  Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
  
  SIGIR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
  
  Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan
  
  November 2021
  
  arXiv | November 2021
  
  DOI PDF
- A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  MSR-TR-2021-20 | August 2021
  
  Published by Microsoft
  
  Publication
- XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
  
  Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou
  
  EMNLP 2020 | April 2020
  
  Publication PDF Github Github Github Project
- TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters
  
  Zhiwen Mo, Yu Cheng, Lei Wang, Zhengju Tang, Lei Xu, Guoyu Li, Yuqiu Dong, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Luo Mai, Zhi Yang, Wayne Luk, Hongxiang Fan
  
  July 2026
  
  arXiv | July 2026
  
  Publication
- AutoVerus: Automated Proof Generation for Rust Code
  
  Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu
  
  Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2025
  
  Distinguished Artifact Award
  
  Publication Github Project
- TrainVerify: Equivalence-Based Verification for Distributed LLM Training
  
  Yunchi Lu, Youshan Miao, Cheng Tan, Peng Huang, Yi Zhu, Xian Zhang, Fan Yang
  
  Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles (SOSP'25) | October 2025
  
  Publication Github
- Automated Proof Generation for Rust Code via Self-Evolution
  
  Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng Cheng, Fan Yang, Shuvendu Lahiri, Tao Xie, Lidong Zhou
  
  ICLR 2025 | October 2024
  
  Publication Project
- Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Ying Cao, Fan Yang, Mao Yang
  
  September 2024
- Arming Cloud Services with Task Aspects
  
  Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
  
  MSR-TR-2014-150 | November 2014
  
  Published by Microsoft
  
  Publication
- Vibe Reasoning: Eliciting Frontier AI Mathematical Capabilities — A Case Study on IMO 2025 Problem 6
  
  Jiaao Wu, Xian Zhang, Fan Yang, Yinpeng Dong
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  
  Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
  
  ICML 2025 (oral) | January 2025
  
  Publication DOI Github
- Scalable Distributed Vector Search via Accuracy Preserving Index Construction
  
  Yuming Xu, Qianxi Zhang, Qi Chen, Baotong Lu, Menghao Li, Philip Adams, Mingqin Li, Zengzhong Li, Jing Liu, Cheng Li, Fan Yang
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
  
  Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
  
  The Web Conference | May 2024
  
  Publication PDF Access
- Model-enhanced Vector Index
  
  Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
  
  NeurIPS 2023 | October 2023
  
  Publication
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
  
  Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
  
  ACL 2023 | July 2023
  
  Publication
- NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
  
  Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan
  
  November 2021
  
  arXiv | November 2021
  
  DOI PDF
- Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services
  
  Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu
  
  IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749
  
  DOI Publication Publication Publication Publication Publication
- AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks
  
  K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu
  
  May 2005
  
  Publication Publication
- LION: Layered Overlay Multicast with Network Coding
  
  J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang
  
  IEEE Transactions on Multimedia | May 2004

- AgentSpec: Speculative Decoding for Batch Inference of LLM Agents
  
  Xin Wang, Ziming Miao, Yi Zhu, Hui Shen, Zhongwei Wan, Fan Yang, Mi Zhang
  
  EMNLP 2026 | August 2026
  
  Publication
- Euclean: Automated Geometry Problem Formalization with Unified Verification in Lean
  
  Linbin Tang, Jingyan You, Zilin Kang, Hanzhang Liu, Sophia Zhang, Zenan Li, Chenrui Cao, Liangcheng Song, Jiaao Wu, Xian Zhang, Fan Yang
  
  2026 ICML 2026 | July 2026
  
  PDF
- SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
  
  Yizhao Gao, Shuming Guo, Shijie Cao, Yuqing Xia, Yu Cheng, Lei Wang, Lingxiao Ma, Yutao Sun, Tianzhu Ye, Li Dong, Hayden Kwok-Hay So, Yu Hua, Ting Cao, Fan Yang, Mao Yang
  
  ICLR 2026 | February 2026
  
  Publication
- Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models
  
  Chenrui Cao, Liangcheng Song, Zenan Li, Xinyi Le, Xian Zhang, Hui Xue, Fan Yang
  
  NeurIPS 2025 | December 2025
  
  DOI Publication Publication
- LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts
  
  Siyuan Wang, Gaokai Zhang, L. Zhang, Ning Shang, Fan Yang, Dongyao Chen, Mao Yang
  
  ICLR 2026 | October 2025
  
  DOI Publication
- AutoVerus: Automated Proof Generation for Rust Code
  
  Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Jianan Yao, Weidong Cui, Yeyun Gong, Chris Hawblitzel, Shuvendu Lahiri, Jay Lorch, Shuai Lu, Fan Yang, Ziqiao Zhou, Shan Lu
  
  Object-Oriented Programming, Systems, Languages & Applications (OOPSLA) | October 2025
  
  Distinguished Artifact Award
  
  Publication Github Project
- Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, DaYou Du, Shijie Cao, Peiyuan Zhou, Jiaxing Qi, Junjie Lai, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | October 2025
  
  Publication
- TrainVerify: Equivalence-Based Verification for Distributed LLM Training
  
  Yunchi Lu, Youshan Miao, Cheng Tan, Peng Huang, Yi Zhu, Xian Zhang, Fan Yang
  
  Proceedings of the ACM SIGOPS 31st Symposium on Operating Systems Principles (SOSP'25) | October 2025
  
  Publication Github
- WaferLLM: Large Language Model Inference at Wafer Scale
  
  Congjie He, Yeqi Huang, Pei Mu, Ziming Miao, Jilong Xue, Lingxiao Ma, Fan Yang, Luo Mai
  
  OSDI 2025 | July 2025
  
  Publication
- PipeThreader: Software-Defined Pipelining for Efficient DNN Execution
  
  Yu Cheng, Lei Wang, Yining Shi, Yuqing Xia, Lingxiao Ma, Jilong Xue, Yang Wang, Zhiwen Mo, Feiyang Chen, Fan Yang, Mao Yang, Zhi Yang
  
  OSDI | July 2025
  
  Publication
- LongRoPE2: Near-Lossless LLM Context Window Scaling
  
  Ning Shang , Li Lyna Zhang, Siyuan Wang, Gaokai Zhang, Gilsinia Lopez, Fan Yang, Weizhu Chen, Mao Yang
  
  ICML 2025 | July 2025
  
  Publication
- rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset
  
  Yifei Liu, Li Lyna Zhang, Yi Zhu, Bingcheng Dong, Xudong Zhou, Ning Shang, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  DOI Publication Publication
- SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Peiyuan Zhou, Ji Qi, Junjie Lai, Hayden Kwok-Hay, Ting Cao, Fan Yang, Mao Yang
  
  NeurIPS 2025 | May 2025
  
  PDF
- Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
  
  Zenan Li, Zhaoyu Li, Wen Tang, Xian Zhang, Yuan Yao, Xujie Si, Fan Yang, Kaiyu Yang, Xiaoxing Ma
  
  ICLR | April 2025
  
  DOI Publication Publication
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  
  Xinyu Guan, Li Lyna Zhang, Yifei Liu, Ning Shang, Youran Sun, Yi Zhu, Fan Yang, Mao Yang
  
  ICML 2025 (oral) | January 2025
  
  Publication DOI Github
- Neuro-Symbolic Data Generation for Math Reasoning
  
  Zenan Li, Zhi Zhou, Yuan Yao, Yu-Feng Li, Chun Cao, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  Neural Information Processing Systems | December 2024
  
  Publication
- Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Siran Liu, Chengxiang Qi, Ying Cao, Chao Yang, Weifang Hu, Xuanhua Shi, Fan Yang, Mao Yang
  
  SOSP | November 2024
  
  Publication
- Automated Proof Generation for Rust Code via Self-Evolution
  
  Tianyu Chen, Shuai Lu, Shan Lu, Yeyun Gong, Chenyuan Yang, Xuheng Li, Md Rakib Hossain Misu, Hao Yu, Nan Duan, Peng Cheng, Fan Yang, Shuvendu Lahiri, Tao Xie, Lidong Zhou
  
  ICLR 2025 | October 2024
  
  Publication Project
- IRGen: Generative Modeling for Image Retrieval
  
  Yidan Zhang, Ting Zhang, Dong Chen, Yujing Wang, Qi Chen, Xing Xie, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Mao Yang, Qingmin Liao, Jingdong Wang, Baining Guo
  
  ECCV'24 | October 2024
  
  DOI Publication Publication Publication
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
  
  Di Liu, Meng Chen, Baotong Lu, Huiqiang Jiang, Qianxi Zhang, Qi Chen, Chengruidong Zhang, Bailu Ding, Kai Zhang, Chen Chen, Fan Yang, Yuqing Yang, Lili Qiu
  
  NeurIPS 2025 | September 2024
  
  Best Paper Award | ENLSP NeurIPS Workshop 2024
  
  Publication
- Understanding the Weakness of Large Language Model Agents within a Complex Android Environment
  
  Mingzhe Xing, Rongkai Zhang, Hui Xue, Qi Chen, Fan Yang, Zhen Xiao
  
  SIGKDD'24 | August 2024
  
  DOI Publication Publication
- Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers
  
  Zhenting Qi, Mingyuan Ma, Jiahang Xu, Li Lyna Zhang, Fan Yang, Mao Yang
  
  ICLR 2025 | August 2024
  
  Publication
- nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training
  
  Zhiqi Lin, Youshan Miao, Quanlu Zhang, Fan Yang, Yi Zhu, Cheng Li, Saeed Maleki, Xu Cao, Ning Shang, Yilei Yang, Weijiang Xu, Mao Yang, Lintao Zhang, Lidong Zhou
  
  OSDI | July 2024
  
  Publication Github
- Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation
  
  Lei Wang, Lingxiao Ma, Shijie Cao, Quanlu Zhang, Jilong Xue, Yining Shi, Ningxin Zheng, Ziming Miao, Fan Yang, Ting Cao, Yuqing Yang, Mao Yang
  
  OSDI 2024 | July 2024
  
  Publication
- Parrot: Efficient Serving of LLM-based Applications with Semantic Variable
  
  Chaofan Lin, Zhenhua Han, Chengruidong Zhang, Yuqing Yang, Fan Yang, Chen Chen, Lili Qiu
  
  OSDI 2024 | May 2024
  
  Publication Github
- MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels
  
  Qi Chen, Xiubo Geng, Corby Rosset, Carolyn Buractaon, Jingwen Lu, Tao Shen, Kun Zhou, Chenyan Xiong, Yeyun Gong, Paul Bennett, Nick Craswell, Xing Xie, Fan Yang, Bryan Tower, Zheng Liu, Mingqin Li, Chuanjie Liu, Jason (Zengzhong) Li, Rangan Majumder, Jennifer Neville, Harsha Simhadri, Manik Varma, Yujing Wang, Linjun Yang, Mao Yang, Ce Zhang
  
  The Web Conference | May 2024
  
  Publication PDF Access
- OneSparse: A Unified System for Multi-index Vector Search
  
  Yaoqi Chen, Ruicheng Zheng, Qi Chen, Shuotao Xu, Qianxi Zhang, Xue Wu, Weihao Han, Hua Yuan, Mingqin Li, Yujing Wang, Jason Li, Fan Yang, Hao Sun, Weiwei Deng, Feng Sun, Qi Zhang, Mao Yang
  
  The Web Conference | May 2024
  
  Publication
- Amanda: Unified Instrumentation Framework for Deep Neural Networks
  
  Yue Guan, Yuxian Qiu, Jingwen Leng, Fan Yang, Shuo Yu, Yunxin Liu, Yu Feng, Yuhao Zhu, Lidong Zhou, Yun Liang, Chen Zhang, Chao Li, Minyi Guo
  
  ASPLOS | April 2024
  
  Publication
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
  
  Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, Yuanyuan Xu, Ning Shang, Jiahang Xu, Fan Yang, Mao Yang
  
  ICML 2024 | February 2024
  
  Publication DOI Github
- Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning
  
  Xijie Huang, Li Lyna Zhang, Kwang-Ting Cheng, Fan Yang, Mao Yang
  
  EMNLP | February 2024
  
  Publication
- SPFresh: Incremental In-Place Update for Billion-Scale Vector Search
  
  Yuming Xu, Hengyu Liang, Jin Li, Shuotao Xu, Qi Chen, Qianxi Zhang, Cheng Li , Ziyue Yang, Fan Yang, Yuqing Yang, Peng Cheng, Mao Yang
  
  SOSP'23 | October 2023
  
  Microsoft Research Blog
  
  https://www.microsoft.com/en-us/research/blog/unified-database-laying-the-foundation-for-large-language-model-vertical-applications/
  
  Publication
- PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation
  
  Ningxin Zheng, Huiqiang Jiang, Quanlu Zhang, Zhenhua Han, Lingxiao Ma, Yuqing Yang, Fan Yang, Chengruidong Zhang, Lili Qiu, Mao Yang, Lidong Zhou
  
  The 29th ACM Symposium on Operating Systems Principles | October 2023
  
  Publication
- Model-enhanced Vector Index
  
  Hailin Zhang, Yujing Wang, Qi Chen, Ruiheng Chang, Ting Zhang, Ziming Miao, Yingyan Hou, Yang Ding, Xupeng Miao, Haonan Wang, Bochen Pang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Qi Zhang, Fan Yang, Xing Xie, Mao Yang, Bin Cui
  
  NeurIPS 2023 | October 2023
  
  Publication
- NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation
  
  Shengming Yin, Chenfei Wu, Huan Yang, Jianfeng Wang, Xiaodong Wang, Minheng Ni, Zhengyuan Yang, Linjie Li, Shuguang Liu, Fan Yang, Jianlong Fu, Ming Gong (YIMING), Lijuan Wang, Zicheng Liu, Houqiang Li, Nan Duan
  
  ACL 2023 | July 2023
  
  Publication
- Optimizing Dynamic Neural Networks with Brainstorm
  
  Weihao Cui, Zhenhua Han, Lingji Ouyang, Yichuan Wang, Ningxin Zheng, Lingxiao Ma, Yuqing Yang, Fan Yang, Jilong Xue, Lili Qiu, Lidong Zhou, Quan Chen, Haisheng Tan, Minyi Guo
  
  OSDI'23 | July 2023
  
  Publication
- VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity
  
  Qianxi Zhang, Shuotao Xu, Qi Chen, Guoxin Sui, Jiadong Xie, Zhizhen Cai, Yaoqi Chen, Yinxuan He, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  OSDI'23 | July 2023
  
  Publication
- Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning
  
  Chen Zhang, Lingxiao Ma, Jilong Xue, Yining Shi, Ziming Miao, Fan Yang, Jidong Zhai, Zhi Yang, Mao Yang
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Welder: Scheduling Deep Learning Memory Access via Tile-graph
  
  Yining Shi, Zhi Yang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Ziming Miao, Yuxiao Guo, Fan Yang, Lidong Zhou
  
  17th USENIX Symposium on Operating Systems Design and Implementation (OSDI'23) | July 2023
  
  Publication Project
- Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning
  
  Bin Lin, Ningxin Zheng, Lei Wang, Shijie Cao, Lingxiao Ma, Quanlu Zhang, Yi Zhu, Ting Cao, Jilong Xue, Yuqing Yang, Fan Yang
  
  Sixth Conference on Machine Learning and Systems (MLSys'23) | June 2023
  
  Publication Project
- OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization
  
  Cong Guo, Jiaming Tang, Jingwen Leng, Weiming Hu, Chen Zhang, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  ISCA | June 2023
  
  PDF Project
- SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Mingxia Li, Fan Yang, Qianxi Zhang, Binyang Li, Yuqing Yang, Lili Qiu, Lintao Zhang, Lidong Zhou
  
  EuroSys 2023 | May 2023
  
  Publication
- On Modular Learning of Distributed Systems for Predicting End-to-End Latency
  
  Chieh-Jan Mike Liang, Zilin Fang, Yuqing Xie, Fan Yang, Zhao Lucis Li, Li Lyna Zhang, Mao Yang, Lidong Zhou
  
  NSDI (USENIX Symposium on Networked Systems Design and Implementation) | April 2023
  
  Publication
- ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning
  
  Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu
  
  ASPLOS 2023 | March 2023
  
  Publication
- ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization
  
  Cong Guo, Chen Zhang, Jingwen Leng, Zihan Liu, Fan Yang, Yunxin Liu, Minyi Guo, Yuhao Zhu
  
  MICRO | October 2022
  
  IEEE Micro Top Picks 2023 Honorable Mention
  
  PDF
- PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training
  
  Wei Zhang , Binghao Chen, Zhenhua Han, Quan Chen, Peng Cheng, Fan Yang, Ran Shu, Yuqing Yang, Minyi Guo
  
  USENIX Annual Technical Conference | July 2022
  
  PDF
- Tutel: Adaptive Mixture-of-Experts at Scale
  
  Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prabhat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, Yongqiang Xiong
  
  July 2022
  
  Publication
- SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Yang Wang, Mao Yang, Lidong Zhou
  
  OSDI 2022 | July 2022
  
  Publication Project Project
- Roller: Fast and Efficient Tensor Compilation for Deep Learning
  
  Hongyu Zhu , Ruofan Wu , Yijia Diao , Shanbin Ke , Haoyu Li , Chen Zhang , Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon , Gennady Pekhimenko
  
  The 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI'22) | July 2022
  
  Publication Project
- Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings
  
  Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
  
  SIGIR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees
  
  Hanyu Zhao, Zhenhua Han, Zhi Yang, Quanlu Zhang, Fan Yang, Lidong Zhou, Mao Yang, Yuqi Wang, Yifan Xiong, Bin Wang
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Project
- Retiarii: A Deep Learning Exploratory-Training Framework
  
  Quanlu Zhang, Zhenhua Han, Fan Yang, Yuge Zhang, Zhe Liu, Mao Yang, Lidong Zhou
  
  Operating Systems Design and Implementation | November 2020
  
  Publication Video
- Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
  
  Lingxiao Ma, Zhiqiang Xie, Zhi Yang, Jilong Xue, Youshan Miao, Wei Cui, Wenxiang Hu, Fan Yang, Lintao Zhang, Lidong Zhou
  
  14th USENIX Symposium on Operating Systems Design and Implementation (OSDI'20) | November 2020
  
  Publication Project
- XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
  
  Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong (YIMING), Linjun Shou (寿林钧), Daxin Jiang (姜大昕), Guihong Cao, Xiaodong Fan, Bruce Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Ming Zhou
  
  EMNLP 2020 | April 2020
  
  Publication PDF Github Github Github Project
- Capuchin: Tensor-based GPU Memory Management for Deep Learning
  
  Quan Peng, Xuanhua Shi, Hulin Dai, Hai Jin, Weiliang Ma, Qian Xiong, Fan Yang, Xuehai Qian
  
  ASPLOS | March 2020
  
  Publication Project
- Analysis of Large-Scale Multi-Tenant {GPU} Clusters for {DNN} Training Workloads
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  2019 USENIX Annual Technical Conference | May 2019
  
  PDF Publication Github Project Project
- Gandiva: Introspective Cluster Scheduling for Deep Learning
  
  Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou
  
  13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2018) | October 2018
  
  Publication Project Project Project
- GraM: Scaling Graph Computation to the Trillions
  
  Ming Wu, Fan Yang, Jilong Xue, Wencong Xiao, Youshan Miao, Lan Wei, Haoxiang Lin, Yafei Dai, Lidong Zhou
  
  SoCC 2015 | August 2015
  
  The 6th ACM Symposium on Cloud Computing
  
  Publication DOI Project
- Chronos: A Graph Engine for Temporal Graph Analysis
  
  Wentao Han, Youshan Miao, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Wenguang Chen, Enhong Chen, Fan Yang, Lidong Zhou
  
  EuroSys | April 2014
  
  PDF Publication Publication Project
- Kineograph: taking the pulse of a fast-changing and connected world
  
  Raymond Cheng, Ji Hong, Aapo Kyrola, Youshan Miao, Xuetian Weng, Ming Wu, Fan Yang, Lidong Zhou, Feng Zhao, Enhong Chen
  
  ACM Eurosys | April 2012
  
  PDF Publication Publication Project
- AMTP: a multipath multimedia streaming protocol for mobile ad hoc networks
  
  K. Rojviboonchai, Fan Yang, Q. Zhang, H. Aida, W. Zhu
  
  May 2005
  
  Publication Publication
- Wavel: A Fast and Efficient Compilation System for Wafer-Scale Accelerators
  
  Yeqi Huang, Congjie He, Haocheng Xiao, Yanwei Ye, Yi-Chieh Wang, Boyao Song, Yangshen Deng, Ziming Miao, Lingxiao Ma, Fan Yang, Luo Mai
- MeshRT: Compile-Time Governed Wafer-Scale Runtime for Low-Latency High-Throughput Inference
  
  Congjie He, Le Xu, Zhan Lu, Yeqi Huang, Haocheng Xiao, Cheng Deng, Lingxiao Ma, Ziming Miao, Fan Yang, Luo Mai
- RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jinkai Zhang, Baotong Lu, Qianxi Zhang, Chengruidong Zhang, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Jing Liu, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Yuqing Yang, Fan Yang, Mao Yang
  
  June 2025
  
  DOI Github
- Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor
  
  Ying Cao, Fan Yang, Mao Yang
  
  September 2024
- Diagnosing with Insights: Structured Analysis of Agent Failures via Behavioral Abstractions
  
  Jiayi Bi, Yanjie Gao, Yuanmin Xie, Liqun Li, Tianyin Xu, Fan Yang, Mao Yang
  
  September 2026
  
  September 2026
  
  Preprint
- Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
  
  Gen Dong, Yanjie Gao, Liqun Li, Tianyin Xu, Yu Hua, Fan Yang
  
  August 2026
  
  August 2026
  
  Publication
- Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
  
  Hui Xue, Fan Yang
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning
  
  Boxiu Li, Zimo Wen, Yijia Fan, Junxiang Lei, Sufeng Guo, Jiaao Wu, Ruize Tang, Mukai Li, Yifei Shen, Xiaoyu Chen, Wanbo Zhang, Runjing Gu, Yifei Gao, Yuheng Wu, Xuyao Huang, Zelong Zhao, Jiachen Zhang, Shibo Hu, Hangxi Guo, Yilin Chen, Yuzhe Zhang, Fan Yang, Chuan Wen, Xian Zhang, Xuanhe Zhou, Zhijie Deng
  
  August 2026
  
  arXiv | August 2026
  
  Publication
- TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters
  
  Zhiwen Mo, Yu Cheng, Lei Wang, Zhengju Tang, Lei Xu, Guoyu Li, Yuqiu Dong, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Luo Mai, Zhi Yang, Wayne Luk, Hongxiang Fan
  
  July 2026
  
  arXiv | July 2026
  
  Publication
- STAR-P’olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision
  
  Jiaao Wu, Xian Zhang, Han Liu, Sophia Zhang, Fan Yang, Yinpeng Dong
  
  May 2026
  
  arXiv | May 2026
  
  Publication
- Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving
  
  Zihan Zhao, Baotong Lu, Shengjie Lin, Yizou Chen, Jing Liu, Yanqi Zhang, Ziming Miao, Ming-Chang Yang, Haiying Shen, Qi Chen, Fan Yang
  
  April 2026
  
  arXiv | April 2026
  
  Publication
- Neuro-Symbolic Verification on Instruction Following of LLMs
  
  Yiming Su, Kunzhao Xu, Yanjie Gao, Fan Yang, Cheng Li, Mao Yang, Tianyin Xu
  
  January 2026
  
  January 2026
  
  Preprint
- Vibe Reasoning: Eliciting Frontier AI Mathematical Capabilities — A Case Study on IMO 2025 Problem 6
  
  Jiaao Wu, Xian Zhang, Fan Yang, Yinpeng Dong
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- Scalable Distributed Vector Search via Accuracy Preserving Index Construction
  
  Yuming Xu, Qianxi Zhang, Qi Chen, Baotong Lu, Menghao Li, Philip Adams, Mingqin Li, Zengzhong Li, Jing Liu, Cheng Li, Fan Yang
  
  December 2025
  
  arXiv | December 2025
  
  Publication
- TileLang: A Composable Tiled Programming Model for AI Systems
  
  Lei Wang, Yu Cheng, Yining Shi, Zhengju Tang, Zhiwen Mo, Wenhao Xie, Lingxiao Ma, Yuqing Xia, Jilong Xue, Fan Yang, Zhi Yang
  
  April 2025
  
  arXiv | April 2025
  
  DOI Publication Publication
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  
  Yizhao Gao, Zhichen Zeng, Dayou Du, Shijie Cao, Hayden Kwok-Hay So, Ting Cao, Fan Yang, Mao Yang
  
  October 2024
  
  ArXiv | October 2024
  
  DOI
- LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration
  
  Zhiwen Mo, Lei Wang, Jianyu Wei, Zhichen Zeng, Shijie Cao, Lingxiao Ma, Naifeng Jing, Ting Cao, Jilong Xue, Fan Yang, Mao Yang
  
  August 2024
  
  arXiv | August 2024
  
  DOI Publication Publication Project
- BitNet: Scaling 1-bit Transformers for Large Language Models
  
  Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
  
  October 2023
  
  arXiv | October 2023
  
  DOI Publication
- NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion
  
  Chenfei Wu, Jian Liang, Lei Ji, Fan Yang, Yuejian Fang, Daxin Jiang (姜大昕), Nan Duan
  
  November 2021
  
  arXiv | November 2021
  
  DOI PDF
- RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference
  
  Yaoqi Chen, Jin-Kang Zhang, Baotong Lu, Qianxi Zhang, Cheng Zhang, Jing Liu, Jingjia Luo, Di Liu, Huiqiang Jiang, Qi Chen, Bailu Ding, Xiao Yan, Jiawei Jiang, Chen Chen, Mingxing Zhang, Cheng Li, Yuqing Yang, Fan Yang, Mao Yang
  
  VLDB Endowment | May 2025, Vol 19(5)
  
  DOI Publication
- ImmortalGraph: A System for Storage and Analysis of Temporal Graphs
  
  Youshan Miao, Wentao Han, Kaiwei Li, Ming Wu, Vijayan Prabhakaran, Enhong Chen, Wenguang Chen, Fan Yang, Lidong Zhou
  
  ACM Transactions on Storage (TOS) | July 2015
  
  Publication Publication Project
- Modeling path capacity in multi-hop IEEE 802.11 networks for QoS services
  
  Kun Wang, Fan Yang, Qian Zhang, Yinlong Xu
  
  IEEE Transactions on Wireless Communications | February 2007, Vol 6(2): pp. 738-749
  
  DOI Publication Publication Publication Publication Publication
- LION: Layered Overlay Multicast with Network Coding
  
  J. Zhao, Fan Yang, Q. Zhang, Zhensheng Zhang, Fuyan Zhang
  
  IEEE Transactions on Multimedia | May 2004
- End-to-End TCP-Friendly Streaming Protocol and Bit Allocation for Scalable Video over Wireless Internet
  
  Q. Zhang, F. Yang, W. Zhu, Y.-Q. Zhang, Fan Yang
  
  IEEE Journal on Selected Areas in Communications | February 2004, Vol 22(6)
  
  Publication
- Autoformalizing Mathematical Statements by Symbolic Equivalence and Semantic Consistency
  
  Zenan Li, Yifan Wu, Zhaoyu Li, Xinming Wei, Fan Yang, Xian Zhang, Xiaoxing Ma
  
  June 2025
  
  June 2025
  
  Publication
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
  
  Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Hassan Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Weijian Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou
  
  MSR-TR-2024-12 | August 2024
  
  Published by Microsoft
  
  Publication Video Access Project
- A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute
  
  Ningxin Zheng, Bin Lin, Quanlu Zhang, Lingxiao Ma, Yuqing Yang, Fan Yang, Mao Yang, Lidong Zhou
  
  MSR-TR-2021-20 | August 2021
  
  Published by Microsoft
  
  Publication
- Multi-tenant GPU Clusters for Deep Learning Workloads: Analysis and Implications (TR)
  
  Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang
  
  MSR-TR-2018-13 | May 2018
  
  Published by Microsoft
  
  Publication Github Project
- Arming Cloud Services with Task Aspects
  
  Zhenyu Guo, Cheng Chen, Haoxiang Lin, Sean McDirmid, Fan Yang, Xueying Guo, Mao Yang, Lidong Zhou
  
  MSR-TR-2014-150 | November 2014
  
  Published by Microsoft
  
  Publication
- Sonora: A Platform for Continuous Mobile-Cloud Computing
  
  Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Fan Yang, Zhengping Qian, Lidong Zhou, Guobin Shen, Jacky Shen
  
  MSR-TR-2012-34 | March 2012
  
  PDF PDF
- Distributed Channel Assignment and Routing in Multi-radio Multi-channel Multi-hop Wireless Networks
  
  Haitao Wu, Fan Yang, Kun Tan, Jie Chen, Qian Zhang, Zhensheng Zhang
  
  MSR-TR-2006-165 | November 2006
  
  PDF

Fan Yang

Publications

MeshRT: Compile-Time Governed Wafer-Scale Runtime for Low-Latency High-Throughput Inference

Wavel: A Fast and Efficient Compilation System for Wafer-Scale Accelerators

Diagnosing with Insights: Structured Analysis of Agent Failures via Behavioral Abstractions

AgentSpec: Speculative Decoding for Batch Inference of LLM Agents

Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents

Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?

Argus: A General-Purpose Agentic Runtime for Long-Horizon Reasoning

TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters

Euclean: Automated Geometry Problem Formalization with Unified Verification in Lean

STAR-P’olyaMath: Multi-Agent Reasoning under Persistent Meta-Strategic Supervision

Unifying Sparse Attention with Hierarchical Memory for Scalable Long-Context LLM Serving

SeerAttention-R: Sparse Attention Adaptation for Long Reasoning

Neuro-Symbolic Verification on Instruction Following of LLMs

Vibe Reasoning: Eliciting Frontier AI Mathematical Capabilities — A Case Study on IMO 2025 Problem 6

Scalable Distributed Vector Search via Accuracy Preserving Index Construction

Reviving DSP for Advanced Theorem Proving in the Era of Reasoning Models

LoongRL: Reinforcement Learning for Advanced Reasoning over Long Contexts

AutoVerus: Automated Proof Generation for Rust Code

Self-distilled Attention Gating for Efficient Long-context Prefilling

TrainVerify: Equivalence-Based Verification for Distributed LLM Training

WaferLLM: Large Language Model Inference at Wafer Scale

LongRoPE2: Near-Lossless LLM Context Window Scaling

PipeThreader: Software-Defined Pipelining for Efficient DNN Execution

RetroInfer: A Vector-Storage Approach for Scalable Long-Context LLM Inference

Autoformalizing Mathematical Statements by Symbolic Equivalence and Semantic Consistency

rStar-Coder: Scaling Competitive Code Reasoning with a Large-Scale Verified Dataset

RetroInfer: A Vector Storage Engine for Scalable Long-Context LLM Inference

SeerAttention: Self-distilled Attention Gating for Efficient Long-context Prefilling

TileLang: A Composable Tiled Programming Model for AI Systems

Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning

rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking

Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency

Neuro-Symbolic Data Generation for Math Reasoning

Uncovering Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor

Automated Proof Generation for Rust Code via Self-Evolution

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs

IRGen: Generative Modeling for Image Retrieval

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Uncover Nested Data Parallelism and Data Reuse in DNN Computation with FractalTensor

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Understanding the Weakness of Large Language Model Agents within a Complex Android Environment

Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers

LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation

nnScaler: Constraint-Guided Parallelization Plan Generation for Deep Learning Training

Parrot: Efficient Serving of LLM-based Applications with Semantic Variable

MS MARCO Web Search: A Large-scale Information-rich Web Dataset with Millions of Real Click Labels

OneSparse: A Unified System for Multi-index Vector Search

Amanda: Unified Instrumentation Framework for Deep Neural Networks

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Fewer is More: Boosting LLM Reasoning with Reinforced Context Pruning

PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformation

SPFresh: Incremental In-Place Update for Billion-Scale Vector Search

BitNet: Scaling 1-bit Transformers for Large Language Models

Model-enhanced Vector Index

NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generation

Cocktailer: Analyzing and Optimizing Dynamic Control Flow in Deep Learning

Optimizing Dynamic Neural Networks with Brainstorm

VBASE: Unifying Online Vector Similarity Search and Relational Queries via Relaxed Monotonicity

Welder: Scheduling Deep Learning Memory Access via Tile-graph

Efficient GPU Kernels for N:M-SPARSE Weights in Deep Learning

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

SiloD: A Co-design of Caching and Scheduling for Deep Learning Clusters

On Modular Learning of Distributed Systems for Predicting End-to-End Latency

ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning

ANT: Exploiting Adaptive Numerical Data Type for Low-Bit Deep Neural Network Quantization

PilotFish: Harvesting Free Cycles of Cloud Gaming with Deep Learning Training

Roller: Fast and Efficient Tensor Compilation for Deep Learning

SparTA: Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

Tutel: Adaptive Mixture-of-Experts at Scale

Distill-VQ: Learning Retrieval Oriented Vector Quantization by Distilling Knowledge from Dense Embeddings

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

NÜWA: Visual Synthesis Pre-training for Neural visUal World creAtion

A New Approach to Deep-Learning Model Sparsity via Tensor-with-Sparsity-Attribute

HiveD: Sharing a GPU Cluster for Deep Learning with Guarantees

Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks

Retiarii: A Deep Learning Exploratory-Training Framework

XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation