ICLR conference banner - abstract shapes

May 7, 2024 – May 11, 2024

Microsoft at ICLR 2024

Central European Time (UTC +1)

Location: Vienna, Austria

Publications

View by:

- ZeRO++: Extremely Efficient Collective Communication for Large Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | March 2024
  
  Publication Publication Project
- Designing Skill-Compatible AI: Methodologies and Frameworks in Chess
  
  Karim Hamade, Reid McIlroy-Young, Siddhartha Sen, Jon Kleinberg, Ashton Anderson
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  
  Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
  
  ICLR 2024 | May 2024
  
  DOI Publication PDF
- Coco-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery
  
  Anne Harrington, Vasha Dutell, Mark Hamilton, Ayush Tewari, Simon Stent, William T. Freeman, Ruth Rosenholtz
  
  ICLR 2024 | April 2024
  
  Publication Project
- Mixture of LoRA Experts
  
  Shaohan Huang, Furu Wei
  
  ICLR 2024 | April 2024
  
  Publication
- Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency
  
  Bowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu, Qing Qu, Liyue Shen
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing
  
  Xinyu Hu, Pengfei Tang, Simiao Zuo, Zihan Wang, Qiang Lou, Jian Jiao, Denis Charles
  
  ICLR 2024 | May 2024
  
  Publication
- Combinatorial Bandits for Maximum Value Reward Function under Value-index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules
  
  Yanqi Bao, Tianyu Ding, Jing Huo, Wenbin Li, Yuxin Li, Yang Gao
  
  ICLR 2024 | January 2024
  
  Publication
- Unifying Feature and Cost Aggregation with Transformers for Dense Correspondence
  
  Sunghwan Hong, Seokju Cho, Seungryong Kim, Stephen Lin
  
  International Conference on Learning Representations (ICLR) | May 2024
  
  Preprint
- CNN Kernels Can Be the Best Shapelets
  
  Eric Qu, Yansen Wang, Xufang Luo, Wenqiang He, Kan Ren, Dongsheng Li
  
  The Twelfth International Conference on Learning Representations | May 2024
  
  PDF
- PTaRL: Prototype-based Tabular Representation Learning via Space Calibration
  
  Hangting Ye, Wei Fan, Xiaozhuang Song, Shun Zheng, He Zhao, Dandan Guo, Yi Chang
  
  2024 International Conference on Learning Representations | January 2024
  
  Publication
- Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction
  
  Anirudh Buvanesh, Rahul Chand, Jatin Prakash, Bhawna Paliwal, Mudit Dhawan, Neelabh Madan, Deepesh Hada, Vidit Jain, Sonu Mehta, Yashoteja Prabhu, Manish Gupta, Ramachandran Ramjee, Manik Varma (manik)
  
  ICLR 2024 | April 2024
  
  Publication Project
- Addressing Signal Delay in Deep Reinforcement Learning
  
  Wei Wang, Dongqi Han, Xufang Luo, Dongsheng Li
  
  ICLR 2024 | May 2024
  
  PDF Publication Github
- Training-free Multi-objective Diffusion Model for 3D Molecule Generation
  
  Xu Han, Caihua Shan, Yifei Shen, Can Xu, Han Yang, Xiang Li, Dongsheng Li
  
  ICLR 2024 | April 2024
  
  Publication
- Weakly-supervised Audio Separation via Bi-modal Semantic Similarity
  
  Saeed Amizadeh, Kazuhito Koishida
  
  2024 International Conference on Learning Representations | May 2024
  
  Preprint
- Efficiently Computing Similarities to Private Datasets
  
  Arturs Backurs, Zinan Lin, Sepideh Mahabadi, Sandeep Silwal, Jakub Tarnawski
  
  ICLR 2024 | May 2024
  
  Publication Project
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication Project
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
  
  Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari do Nascimento, Torsten Hoefler, James Hensman
  
  ICLR 2024 | January 2024
  
  DOI Publication
- Privately Aligning Language Models with Reinforcement Learning
  
  Fan Wu, Huseyin Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  DOI Project
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process
  
  Xinyao Fan, Yueying Wu, Chang Xu, Yuhao Huang, Weiqing Liu, Jiang Bian
  
  ICLR 2024 | March 2024
  
  Publication
- Whittle Index with Multiple Actions and State Constraint for Inventory Management
  
  Chuheng Zhang, Xiangsen Wang, Wei Jiang, Xianliang Yang, Siwei Wang, Lei Song, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- FeatUp: A Model-Agnostic Framework for Features at Any Resolution
  
  Mark Hamilton
  
  ICLR 2024 | March 2024
  
  Publication Project
- Harnessing Density Ratios for Online Reinforcement Learning
  
  P. Amortila, Dylan Foster, Nan Jiang, Ayush Sekhari, Tengyang Xie
  
  ICLR 2024 | January 2024
  
  DOI Publication
- GAIA: Zero-shot Talking Avatar Generation
  
  Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, HsiangTao Wu, Sheng Zhao, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  DOI Publication
- Exploring Diffusion Time-steps for Unsupervised Representation Learning
  
  Zhongqi Yue, Jiankun Wang, Qianru Sun, Lei Ji, E. Chang, Hanwang Zhang
  
  ICLR 2024 | January 2024
  
  DOI Publication
- Cascading Reinforcement Learning
  
  Yihan Du, R. Srikant, Wei Chen
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- Inverse Approximation Theory for Nonlinear Recurrent Neural Networks
  
  Shida Wang, Zhong Li, Qianxiao Li
  
  ICLR 2024 | January 2024
  
  Spotlight
  
  Publication
- Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
  
  Xinyu Tang, Richard Shin, Huseyin Inan, Andre Manoel, Fatemehsadat Mireshghallah, Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
  
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
  
  COLM 2024 | August 2024
  
  Best Paper, LLM Agents Workshop ICLR'24
  
  Publication Video Video Video Project
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  
  Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, Yu Wang
  
  ICLR 2024 | May 2024
  
  Publication Publication Publication
- ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- WizardLM: Empowering Large Language Models to Follow Complex Instructions
  
  Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Daxin Jiang (姜大昕)
  
  ICLR 2024 | April 2023
  
  DOI PDF
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
  
  Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun, Xiubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma, Qingwei Lin 林庆维, Daxin Jiang (姜大昕)
  
  ICLR 2024 | June 2023
  
  DOI PDF
- V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection
  
  Yichao Shen, Zigang Geng, Yuhui Yuan, Yutong Lin, Ze Liu, Chunyu Wang, Han Hu, Nanning Zheng, Baining Guo
  
  ICLR 2024 | August 2023
  
  DOI PDF
- Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
  
  Hao Chen, Jindong Wang, Ankit Shah, Ran Tao, Hongxin Wei, Xing Xie, Masashi Sugiyama, Bhiksha Raj
  
  ICLR 2024 | September 2023
  
  DOI PDF
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  
  Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Sai Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, H. Shum, Jian Guo
  
  ICLR 2024 | July 2023
  
  Publication
- The Generative AI Paradox: “What It Can Create, It May Not Understand”
  
  Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian R. Fisher, Abhilasha Ravichander, Khyathi Raghavi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Teaching Language Models to Hallucinate Less with Synthetic Tasks
  
  Erik Jones, Hamid Palangi, Clarisse Simoes Ribeiro, Varun Chandrasekaran, Subhabrata (Subho) Mukherjee, Arindam Mitra, Ahmed Awadallah, Ece Kamar
  
  ICLR 2024 | October 2023
  
  DOI PDF
- Supervised Knowledge Makes Large Language Models Better In-context Learners
  
  Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Weirong Ye, Xing Xie, Weizhu Chen, Yue Zhang
  
  ICLR 2024 | December 2023
  
  DOI Publication
- Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
  
  Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
  
  ArXiv | May 2023, Vol abs/2305.15357
  
  DOI PDF
- Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
  
  Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
  
  ICLR 2024 | October 2023
  
  DOI Publication Github
- Retro-fallback: retrosynthetic planning in an uncertain world
  
  Austin Tripp, Krzysztof Maziarz, Sarah Lewis, Jose Miguel Hernandez-Lobato, Marwin Segler
  
  ICLR 2024 | October 2023
  
  DOI PDF
- ResFields: Residual Neural Fields for Spatiotemporal Signals
  
  Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- RAIN: Your Language Models Can Align Themselves without Finetuning
  
  Yuhui Li, Fangyun Wei, Jinjing Zhao, Chao Zhang, Hongyang Zhang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation
  
  Yu Chen, Yihan Du, Pihe Hu, Siwei Wang, Desheng Wu, Longbo Huang
  
  ICLR 2024 | July 2023
  
  DOI PDF
- PromptTTS 2: Describing and Generating Voices with Text Prompt
  
  Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian
  
  ICLR 2024 | September 2023
  
  DOI PDF
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization
  
  Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization
  
  Yidong Wang, Zhuohao Yu, Zhengran Zeng, Linyi Yang, Cunxiang Wang, Hao Chen, Chaoya Jiang, Rui Xie, Jindong Wang, Xing Xie, Wei Ye, Shi-Bo Zhang, Yue Zhang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- Neural Structure Learning with Stochastic Differential Equations
  
  Benjie Wang, Joel Jennings, Wenbo Gong
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation
  
  Tuan Le, Julian Cremer, Frank Noé, Djork-Arné Clevert, Kristof Schütt
  
  ICLR 2024 | September 2023
  
  DOI PDF
- NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
  
  Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  
  Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Y. Yacoob, Lijuan Wang
  
  ICLR 2024 | June 2023
  
  Publication
- Knowledge Distillation of Large Language Models
  
  Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- MRVM-NeRF: Mask-Based Pretraining for Neural Radiance Fields
  
  Ganlin Yang, Guoqiang Wei, Zhizheng Zhang, Yan Lu, Dong Liu
  
  ICLR 2024 | April 2023
  
  DOI PDF
- LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
  
  Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
  
  ICLR 2024 | October 2023
  
  DOI PDF
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models
  
  Zecheng Tang, Chenfei Wu, Juntao Li, Nan Duan
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
  
  Marco Federici, Patrick Forr'e, Ryota Tomioka, Bastiaan S. Veeling
  
  ICLR 2024 | September 2023
  
  DOI Publication
- Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning
  
  Murong Yue, Jie Zhao, Min Zhang, Liang Du, Ziyu Yao
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- In-Context Learning through the Bayesian Prism
  
  Kabir Ahuja, Madhur Panwar, Navin Goyal
  
  ICLR 2024 | June 2023
  
  Publication PDF DOI
- In-context Autoencoder for Context Compression in a Large Language Model
  
  Tao Ge, Jing Hu, Haixun Wang, Si-Qing Chen, Furu Wei
  
  ICLR 2024 | July 2023
  
  DOI Publication
- Improving Offline RL by Blending Heuristics
  
  Sinong Geng, Aldo Pacchiano, Aldo Pacchiano, A. Kolobov, Ching-An Cheng
  
  ICLR 2024 | May 2023
  
  DOI Publication
- Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
  
  Peiyan Zhang, Hao Liu, Chaozhuo Li, Xing Xie, Sunghun Kim, Haohan Wang
  
  ICLR 2024 | August 2023
  
  DOI Publication PDF
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals
  
  Y. Gat, Nitay Calderon, Amir Feder, Alexander Chapanin, Amit Sharma, Roi Reichart
  
  ICLR 2024 | September 2023
  
  DOI PDF
- DyVal: Graph-informed Dynamic Evaluation of Large Language Models
  
  Kaijie Zhu, Jiaao Chen, Jindong Wang, Neil Zhenqiang Gong, Diyi Yang, Xing Xie
  
  ICLR 2024 | September 2023
  
  DOI Publication
- DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
  
  Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
  
  Aliyah R. Hsu, Yeshwanth Cherapanamjeri, Briton Park, Tristan Naumann, A. Odisho, Bin Yu
  
  ICLR 2024 | May 2023
  
  Publication
- Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning
  
  Shitong Duan, Xiaoyuan Yi, Peng Zhang, T. Lu, Xing Xie, Ning Gu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | May 2023
  
  DOI Publication
- Combinatorial Bandits for Maximum Value Reward Function under Max Value-Index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  ICLR 2024 | May 2023
  
  DOI Publication PDF
- Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression
  
  Adam Block, Dylan Foster, Akshay Krishnamurthy, Max Simchowitz, Cyril Zhang
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Better Neural PDE Solvers Through Data-Free Mesh Movers
  
  Peiyan Hu, Yue Wang, Zhi-Ming Ma
  
  ICLR 2024 | December 2023
  
  DOI Publication
- BatteryML: An Open-source platform for Machine Learning on Battery Degradation
  
  Han Zhang, Xiaofan Gui, Shun Zheng, Ziheng Lu, Yuqi Li, Jiang Bian
  
  ICLR 2024 | October 2023
  
  DOI Video Github
- BatchPrompt: Accomplish more with less
  
  Jianzhe Lin, Maurice Diesendruck, Liang Du, Robin Abraham
  
  ICLR 2024 | August 2023
  
  DOI
- Augmenting transformers with recursively composed multi-grained representations
  
  Xiang Hu, Qingyang Zhu, Kewei Tu, Wei Wu
  
  ICLR 2024 | September 2023
  
  DOI
- Adaptive Instrument Design for Indirect Experiments
  
  Yash Chandak, Shiv Shankar, Vasilis Syrgkanis, Emma Brunskill
  
  ICLR 2024 | December 2023
  
  DOI Publication
- Adapting Large Language Models via Reading Comprehension
  
  Daixuan Cheng, Shaohan Huang, Furu Wei
  
  ICLR 2024 | September 2023
  
  DOI
- 3D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining
  
  Siming Yan, Yu-Qi Yang, Yu-Xiao Guo, Hao Pan, Peng-Shuai Wang, Xin Tong, Yang Liu, Qi-Xing Huang
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers
  
  Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang
  
  ICLR 2024 | September 2023
  
  Publication Publication
- A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
  
  Haoran Xu, Young Jin Kim, Amr Sharaf, Hany Hassan Awadalla
  
  Accepted to ICLR 2024 | September 2023
  
  Preprint
- Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks
  
  M. Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, Devis Tuia
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models
  
  Mert Yuksekgonul, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
  
  September 2023
  
  DOI Publication Video
- KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
  
  Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
  
  October 2023
  
  DOI Publication Video
- The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  
  Pratyusha Sharma, Jordan Ash, Dipendra Misra
  
  ICLR 2024 | December 2023
  
  DOI
- MOFDiff: Coarse-grained Diffusion for Metal-Organic Framework Design
  
  Xiang Fu, Tian Xie, Andrew S. Rosen, Tommi Jaakkola, Jake Smith
  
  ICLR 2024 | October 2023
  
  Publication Github
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
  
  Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
  
  ICLR 2024 | October 2023
  
  Publication
- UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
  
  Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon
  
  ICLR 2024 | September 2023
  
  Publication
- Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
  
  Yunyang Li, Yusong Wang, Lin Huang, Han Yang, Xinran wei, Jia Zhang, Tong Wang, Zun Wang, Bin Shao, Tie-Yan Liu
  
  April 2023
  
  Preprint
- How to Fine-Tune Vision Models with SGD
  
  Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
  
  ICLR 2024 | November 2022
  
  DOI Publication

- Combinatorial Bandits for Maximum Value Reward Function under Value-index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction
  
  Anirudh Buvanesh, Rahul Chand, Jatin Prakash, Bhawna Paliwal, Mudit Dhawan, Neelabh Madan, Deepesh Hada, Vidit Jain, Sonu Mehta, Yashoteja Prabhu, Manish Gupta, Ramachandran Ramjee, Manik Varma (manik)
  
  ICLR 2024 | April 2024
  
  Publication Project
- Efficiently Computing Similarities to Private Datasets
  
  Arturs Backurs, Zinan Lin, Sepideh Mahabadi, Sandeep Silwal, Jakub Tarnawski
  
  ICLR 2024 | May 2024
  
  Publication Project
- Privately Aligning Language Models with Reinforcement Learning
  
  Fan Wu, Huseyin Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  DOI Project
- FeatUp: A Model-Agnostic Framework for Features at Any Resolution
  
  Mark Hamilton
  
  ICLR 2024 | March 2024
  
  Publication Project
- Cascading Reinforcement Learning
  
  Yihan Du, R. Srikant, Wei Chen
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
  
  Yunyang Li, Yusong Wang, Lin Huang, Han Yang, Xinran wei, Jia Zhang, Tong Wang, Zun Wang, Bin Shao, Tie-Yan Liu
  
  April 2023
  
  Preprint
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- ZeRO++: Extremely Efficient Collective Communication for Large Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | March 2024
  
  Publication Publication Project
- Designing Skill-Compatible AI: Methodologies and Frameworks in Chess
  
  Karim Hamade, Reid McIlroy-Young, Siddhartha Sen, Jon Kleinberg, Ashton Anderson
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  
  Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
  
  ICLR 2024 | May 2024
  
  DOI Publication PDF
- Coco-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery
  
  Anne Harrington, Vasha Dutell, Mark Hamilton, Ayush Tewari, Simon Stent, William T. Freeman, Ruth Rosenholtz
  
  ICLR 2024 | April 2024
  
  Publication Project
- Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency
  
  Bowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu, Qing Qu, Liyue Shen
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing
  
  Xinyu Hu, Pengfei Tang, Simiao Zuo, Zihan Wang, Qiang Lou, Jian Jiao, Denis Charles
  
  ICLR 2024 | May 2024
  
  Publication
- Combinatorial Bandits for Maximum Value Reward Function under Value-index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules
  
  Yanqi Bao, Tianyu Ding, Jing Huo, Wenbin Li, Yuxin Li, Yang Gao
  
  ICLR 2024 | January 2024
  
  Publication
- Unifying Feature and Cost Aggregation with Transformers for Dense Correspondence
  
  Sunghwan Hong, Seokju Cho, Seungryong Kim, Stephen Lin
  
  International Conference on Learning Representations (ICLR) | May 2024
  
  Preprint
- CNN Kernels Can Be the Best Shapelets
  
  Eric Qu, Yansen Wang, Xufang Luo, Wenqiang He, Kan Ren, Dongsheng Li
  
  The Twelfth International Conference on Learning Representations | May 2024
  
  PDF
- PTaRL: Prototype-based Tabular Representation Learning via Space Calibration
  
  Hangting Ye, Wei Fan, Xiaozhuang Song, Shun Zheng, He Zhao, Dandan Guo, Yi Chang
  
  2024 International Conference on Learning Representations | January 2024
  
  Publication
- Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction
  
  Anirudh Buvanesh, Rahul Chand, Jatin Prakash, Bhawna Paliwal, Mudit Dhawan, Neelabh Madan, Deepesh Hada, Vidit Jain, Sonu Mehta, Yashoteja Prabhu, Manish Gupta, Ramachandran Ramjee, Manik Varma (manik)
  
  ICLR 2024 | April 2024
  
  Publication Project
- Addressing Signal Delay in Deep Reinforcement Learning
  
  Wei Wang, Dongqi Han, Xufang Luo, Dongsheng Li
  
  ICLR 2024 | May 2024
  
  PDF Publication Github
- Training-free Multi-objective Diffusion Model for 3D Molecule Generation
  
  Xu Han, Caihua Shan, Yifei Shen, Can Xu, Han Yang, Xiang Li, Dongsheng Li
  
  ICLR 2024 | April 2024
  
  Publication
- Weakly-supervised Audio Separation via Bi-modal Semantic Similarity
  
  Saeed Amizadeh, Kazuhito Koishida
  
  2024 International Conference on Learning Representations | May 2024
  
  Preprint
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication Project
- WizardLM: Empowering Large Language Models to Follow Complex Instructions
  
  Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Daxin Jiang (姜大昕)
  
  ICLR 2024 | April 2023
  
  DOI PDF
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
  
  Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun, Xiubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma, Qingwei Lin 林庆维, Daxin Jiang (姜大昕)
  
  ICLR 2024 | June 2023
  
  DOI PDF
- V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection
  
  Yichao Shen, Zigang Geng, Yuhui Yuan, Yutong Lin, Ze Liu, Chunyu Wang, Han Hu, Nanning Zheng, Baining Guo
  
  ICLR 2024 | August 2023
  
  DOI PDF
- Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
  
  Hao Chen, Jindong Wang, Ankit Shah, Ran Tao, Hongxin Wei, Xing Xie, Masashi Sugiyama, Bhiksha Raj
  
  ICLR 2024 | September 2023
  
  DOI PDF
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  
  Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Sai Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, H. Shum, Jian Guo
  
  ICLR 2024 | July 2023
  
  Publication
- The Generative AI Paradox: “What It Can Create, It May Not Understand”
  
  Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian R. Fisher, Abhilasha Ravichander, Khyathi Raghavi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Teaching Language Models to Hallucinate Less with Synthetic Tasks
  
  Erik Jones, Hamid Palangi, Clarisse Simoes Ribeiro, Varun Chandrasekaran, Subhabrata (Subho) Mukherjee, Arindam Mitra, Ahmed Awadallah, Ece Kamar
  
  ICLR 2024 | October 2023
  
  DOI PDF
- Supervised Knowledge Makes Large Language Models Better In-context Learners
  
  Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Weirong Ye, Xing Xie, Weizhu Chen, Yue Zhang
  
  ICLR 2024 | December 2023
  
  DOI Publication
- Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
  
  Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
  
  ArXiv | May 2023, Vol abs/2305.15357
  
  DOI PDF
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
  
  Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari do Nascimento, Torsten Hoefler, James Hensman
  
  ICLR 2024 | January 2024
  
  DOI Publication
- Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
  
  Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
  
  ICLR 2024 | October 2023
  
  DOI Publication Github
- Retro-fallback: retrosynthetic planning in an uncertain world
  
  Austin Tripp, Krzysztof Maziarz, Sarah Lewis, Jose Miguel Hernandez-Lobato, Marwin Segler
  
  ICLR 2024 | October 2023
  
  DOI PDF
- ResFields: Residual Neural Fields for Spatiotemporal Signals
  
  Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- RAIN: Your Language Models Can Align Themselves without Finetuning
  
  Yuhui Li, Fangyun Wei, Jinjing Zhao, Chao Zhang, Hongyang Zhang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation
  
  Yu Chen, Yihan Du, Pihe Hu, Siwei Wang, Desheng Wu, Longbo Huang
  
  ICLR 2024 | July 2023
  
  DOI PDF
- PromptTTS 2: Describing and Generating Voices with Text Prompt
  
  Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian
  
  ICLR 2024 | September 2023
  
  DOI PDF
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization
  
  Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Privately Aligning Language Models with Reinforcement Learning
  
  Fan Wu, Huseyin Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  DOI Project
- PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization
  
  Yidong Wang, Zhuohao Yu, Zhengran Zeng, Linyi Yang, Cunxiang Wang, Hao Chen, Chaoya Jiang, Rui Xie, Jindong Wang, Xing Xie, Wei Ye, Shi-Bo Zhang, Yue Zhang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- Neural Structure Learning with Stochastic Differential Equations
  
  Benjie Wang, Joel Jennings, Wenbo Gong
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation
  
  Tuan Le, Julian Cremer, Frank Noé, Djork-Arné Clevert, Kristof Schütt
  
  ICLR 2024 | September 2023
  
  DOI PDF
- NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
  
  Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  
  Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Y. Yacoob, Lijuan Wang
  
  ICLR 2024 | June 2023
  
  Publication
- Knowledge Distillation of Large Language Models
  
  Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process
  
  Xinyao Fan, Yueying Wu, Chang Xu, Yuhao Huang, Weiqing Liu, Jiang Bian
  
  ICLR 2024 | March 2024
  
  Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- MRVM-NeRF: Mask-Based Pretraining for Neural Radiance Fields
  
  Ganlin Yang, Guoqiang Wei, Zhizheng Zhang, Yan Lu, Dong Liu
  
  ICLR 2024 | April 2023
  
  DOI PDF
- LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
  
  Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
  
  ICLR 2024 | October 2023
  
  DOI PDF
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models
  
  Zecheng Tang, Chenfei Wu, Juntao Li, Nan Duan
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Whittle Index with Multiple Actions and State Constraint for Inventory Management
  
  Chuheng Zhang, Xiangsen Wang, Wei Jiang, Xianliang Yang, Siwei Wang, Lei Song, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- FeatUp: A Model-Agnostic Framework for Features at Any Resolution
  
  Mark Hamilton
  
  ICLR 2024 | March 2024
  
  Publication Project
- Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
  
  Marco Federici, Patrick Forr'e, Ryota Tomioka, Bastiaan S. Veeling
  
  ICLR 2024 | September 2023
  
  DOI Publication
- Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning
  
  Murong Yue, Jie Zhao, Min Zhang, Liang Du, Ziyu Yao
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- In-Context Learning through the Bayesian Prism
  
  Kabir Ahuja, Madhur Panwar, Navin Goyal
  
  ICLR 2024 | June 2023
  
  Publication PDF DOI
- In-context Autoencoder for Context Compression in a Large Language Model
  
  Tao Ge, Jing Hu, Haixun Wang, Si-Qing Chen, Furu Wei
  
  ICLR 2024 | July 2023
  
  DOI Publication
- Improving Offline RL by Blending Heuristics
  
  Sinong Geng, Aldo Pacchiano, Aldo Pacchiano, A. Kolobov, Ching-An Cheng
  
  ICLR 2024 | May 2023
  
  DOI Publication
- How to Fine-Tune Vision Models with SGD
  
  Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
  
  ICLR 2024 | November 2022
  
  DOI Publication
- Harnessing Density Ratios for Online Reinforcement Learning
  
  P. Amortila, Dylan Foster, Nan Jiang, Ayush Sekhari, Tengyang Xie
  
  ICLR 2024 | January 2024
  
  DOI Publication
- GAIA: Zero-shot Talking Avatar Generation
  
  Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, HsiangTao Wu, Sheng Zhao, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  DOI Publication
- Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
  
  Peiyan Zhang, Hao Liu, Chaozhuo Li, Xing Xie, Sunghun Kim, Haohan Wang
  
  ICLR 2024 | August 2023
  
  DOI Publication PDF
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals
  
  Y. Gat, Nitay Calderon, Amir Feder, Alexander Chapanin, Amit Sharma, Roi Reichart
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Exploring Diffusion Time-steps for Unsupervised Representation Learning
  
  Zhongqi Yue, Jiankun Wang, Qianru Sun, Lei Ji, E. Chang, Hanwang Zhang
  
  ICLR 2024 | January 2024
  
  DOI Publication
- DyVal: Graph-informed Dynamic Evaluation of Large Language Models
  
  Kaijie Zhu, Jiaao Chen, Jindong Wang, Neil Zhenqiang Gong, Diyi Yang, Xing Xie
  
  ICLR 2024 | September 2023
  
  DOI Publication
- DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
  
  Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
  
  Aliyah R. Hsu, Yeshwanth Cherapanamjeri, Briton Park, Tristan Naumann, A. Odisho, Bin Yu
  
  ICLR 2024 | May 2023
  
  Publication
- Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning
  
  Shitong Duan, Xiaoyuan Yi, Peng Zhang, T. Lu, Xing Xie, Ning Gu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | May 2023
  
  DOI Publication
- Combinatorial Bandits for Maximum Value Reward Function under Max Value-Index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  ICLR 2024 | May 2023
  
  DOI Publication PDF
- Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression
  
  Adam Block, Dylan Foster, Akshay Krishnamurthy, Max Simchowitz, Cyril Zhang
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Better Neural PDE Solvers Through Data-Free Mesh Movers
  
  Peiyan Hu, Yue Wang, Zhi-Ming Ma
  
  ICLR 2024 | December 2023
  
  DOI Publication
- BatteryML: An Open-source platform for Machine Learning on Battery Degradation
  
  Han Zhang, Xiaofan Gui, Shun Zheng, Ziheng Lu, Yuqi Li, Jiang Bian
  
  ICLR 2024 | October 2023
  
  DOI Video Github
- BatchPrompt: Accomplish more with less
  
  Jianzhe Lin, Maurice Diesendruck, Liang Du, Robin Abraham
  
  ICLR 2024 | August 2023
  
  DOI
- Augmenting transformers with recursively composed multi-grained representations
  
  Xiang Hu, Qingyang Zhu, Kewei Tu, Wei Wu
  
  ICLR 2024 | September 2023
  
  DOI
- Adaptive Instrument Design for Indirect Experiments
  
  Yash Chandak, Shiv Shankar, Vasilis Syrgkanis, Emma Brunskill
  
  ICLR 2024 | December 2023
  
  DOI Publication
- Adapting Large Language Models via Reading Comprehension
  
  Daixuan Cheng, Shaohan Huang, Furu Wei
  
  ICLR 2024 | September 2023
  
  DOI
- 3D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining
  
  Siming Yan, Yu-Qi Yang, Yu-Xiao Guo, Hao Pan, Peng-Shuai Wang, Xin Tong, Yang Liu, Qi-Xing Huang
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Cascading Reinforcement Learning
  
  Yihan Du, R. Srikant, Wei Chen
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- Inverse Approximation Theory for Nonlinear Recurrent Neural Networks
  
  Shida Wang, Zhong Li, Qianxiao Li
  
  ICLR 2024 | January 2024
  
  Spotlight
  
  Publication
- Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers
  
  Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang
  
  ICLR 2024 | September 2023
  
  Publication Publication
- A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
  
  Haoran Xu, Young Jin Kim, Amr Sharaf, Hany Hassan Awadalla
  
  Accepted to ICLR 2024 | September 2023
  
  Preprint
- Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks
  
  M. Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, Devis Tuia
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models
  
  Mert Yuksekgonul, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
  
  September 2023
  
  DOI Publication Video
- KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
  
  Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
  
  October 2023
  
  DOI Publication Video
- The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  
  Pratyusha Sharma, Jordan Ash, Dipendra Misra
  
  ICLR 2024 | December 2023
  
  DOI
- MOFDiff: Coarse-grained Diffusion for Metal-Organic Framework Design
  
  Xiang Fu, Tian Xie, Andrew S. Rosen, Tommi Jaakkola, Jake Smith
  
  ICLR 2024 | October 2023
  
  Publication Github
- Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
  
  Xinyu Tang, Richard Shin, Huseyin Inan, Andre Manoel, Fatemehsadat Mireshghallah, Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
  
  Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon
  
  ICLR 2024 | September 2023
  
  Publication
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
  
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
  
  COLM 2024 | August 2024
  
  Best Paper, LLM Agents Workshop ICLR'24
  
  Publication Video Video Video Project
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  
  Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, Yu Wang
  
  ICLR 2024 | May 2024
  
  Publication Publication Publication
- Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
  
  Yunyang Li, Yusong Wang, Lin Huang, Han Yang, Xinran wei, Jia Zhang, Tong Wang, Zun Wang, Bin Shao, Tie-Yan Liu
  
  April 2023
  
  Preprint
- ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency
  
  Bowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu, Qing Qu, Liyue Shen
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules
  
  Yanqi Bao, Tianyu Ding, Jing Huo, Wenbin Li, Yuxin Li, Yang Gao
  
  ICLR 2024 | January 2024
  
  Publication
- Unifying Feature and Cost Aggregation with Transformers for Dense Correspondence
  
  Sunghwan Hong, Seokju Cho, Seungryong Kim, Stephen Lin
  
  International Conference on Learning Representations (ICLR) | May 2024
  
  Preprint
- FeatUp: A Model-Agnostic Framework for Features at Any Resolution
  
  Mark Hamilton
  
  ICLR 2024 | March 2024
  
  Publication Project
- Mixture of LoRA Experts
  
  Shaohan Huang, Furu Wei
  
  ICLR 2024 | April 2024
  
  Publication
- Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing
  
  Xinyu Hu, Pengfei Tang, Simiao Zuo, Zihan Wang, Qiang Lou, Jian Jiao, Denis Charles
  
  ICLR 2024 | May 2024
  
  Publication
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
  
  Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari do Nascimento, Torsten Hoefler, James Hensman
  
  ICLR 2024 | January 2024
  
  DOI Publication
- PromptTTS 2: Describing and Generating Voices with Text Prompt
  
  Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian
  
  ICLR 2024 | September 2023
  
  DOI PDF
- NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
  
  Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
  
  ICLR 2024 | April 2023
  
  DOI PDF
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
  
  Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
  
  ICLR 2024 | October 2023
  
  Publication
- UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
  
  Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon
  
  ICLR 2024 | September 2023
  
  Publication
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  
  Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, Yu Wang
  
  ICLR 2024 | May 2024
  
  Publication Publication Publication
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
  
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
  
  COLM 2024 | August 2024
  
  Best Paper, LLM Agents Workshop ICLR'24
  
  Publication Video Video Video Project
- Inverse Approximation Theory for Nonlinear Recurrent Neural Networks
  
  Shida Wang, Zhong Li, Qianxiao Li
  
  ICLR 2024 | January 2024
  
  Spotlight
  
  Publication
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
  
  Aliyah R. Hsu, Yeshwanth Cherapanamjeri, Briton Park, Tristan Naumann, A. Odisho, Bin Yu
  
  ICLR 2024 | May 2023
  
  Publication
- Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
  
  Yunyang Li, Yusong Wang, Lin Huang, Han Yang, Xinran wei, Jia Zhang, Tong Wang, Zun Wang, Bin Shao, Tie-Yan Liu
  
  April 2023
  
  Preprint
- KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
  
  Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
  
  October 2023
  
  DOI Publication Video
- Efficiently Computing Similarities to Private Datasets
  
  Arturs Backurs, Zinan Lin, Sepideh Mahabadi, Sandeep Silwal, Jakub Tarnawski
  
  ICLR 2024 | May 2024
  
  Publication Project
- Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
  
  Xinyu Tang, Richard Shin, Huseyin Inan, Andre Manoel, Fatemehsadat Mireshghallah, Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project

- Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
  
  Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
  
  ArXiv | May 2023, Vol abs/2305.15357
  
  DOI PDF
- Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
  
  Yunyang Li, Yusong Wang, Lin Huang, Han Yang, Xinran wei, Jia Zhang, Tong Wang, Zun Wang, Bin Shao, Tie-Yan Liu
  
  April 2023
  
  Preprint
- ZeRO++: Extremely Efficient Collective Communication for Large Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Xiaoxia Wu, Connor Holmes, Zhewei Yao, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | March 2024
  
  Publication Publication Project
- Designing Skill-Compatible AI: Methodologies and Frameworks in Chess
  
  Karim Hamade, Reid McIlroy-Young, Siddhartha Sen, Jon Kleinberg, Ashton Anderson
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  
  Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
  
  ICLR 2024 | May 2024
  
  DOI Publication PDF
- Coco-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery
  
  Anne Harrington, Vasha Dutell, Mark Hamilton, Ayush Tewari, Simon Stent, William T. Freeman, Ruth Rosenholtz
  
  ICLR 2024 | April 2024
  
  Publication Project
- Mixture of LoRA Experts
  
  Shaohan Huang, Furu Wei
  
  ICLR 2024 | April 2024
  
  Publication
- Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency
  
  Bowen Song, Soo Min Kwon, Zecheng Zhang, Xinyu Hu, Qing Qu, Liyue Shen
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing
  
  Xinyu Hu, Pengfei Tang, Simiao Zuo, Zihan Wang, Qiang Lou, Jian Jiao, Denis Charles
  
  ICLR 2024 | May 2024
  
  Publication
- Combinatorial Bandits for Maximum Value Reward Function under Value-index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules
  
  Yanqi Bao, Tianyu Ding, Jing Huo, Wenbin Li, Yuxin Li, Yang Gao
  
  ICLR 2024 | January 2024
  
  Publication
- Unifying Feature and Cost Aggregation with Transformers for Dense Correspondence
  
  Sunghwan Hong, Seokju Cho, Seungryong Kim, Stephen Lin
  
  International Conference on Learning Representations (ICLR) | May 2024
  
  Preprint
- CNN Kernels Can Be the Best Shapelets
  
  Eric Qu, Yansen Wang, Xufang Luo, Wenqiang He, Kan Ren, Dongsheng Li
  
  The Twelfth International Conference on Learning Representations | May 2024
  
  PDF
- PTaRL: Prototype-based Tabular Representation Learning via Space Calibration
  
  Hangting Ye, Wei Fan, Xiaozhuang Song, Shun Zheng, He Zhao, Dandan Guo, Yi Chang
  
  2024 International Conference on Learning Representations | January 2024
  
  Publication
- Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction
  
  Anirudh Buvanesh, Rahul Chand, Jatin Prakash, Bhawna Paliwal, Mudit Dhawan, Neelabh Madan, Deepesh Hada, Vidit Jain, Sonu Mehta, Yashoteja Prabhu, Manish Gupta, Ramachandran Ramjee, Manik Varma (manik)
  
  ICLR 2024 | April 2024
  
  Publication Project
- Addressing Signal Delay in Deep Reinforcement Learning
  
  Wei Wang, Dongqi Han, Xufang Luo, Dongsheng Li
  
  ICLR 2024 | May 2024
  
  PDF Publication Github
- Training-free Multi-objective Diffusion Model for 3D Molecule Generation
  
  Xu Han, Caihua Shan, Yifei Shen, Can Xu, Han Yang, Xiang Li, Dongsheng Li
  
  ICLR 2024 | April 2024
  
  Publication
- Weakly-supervised Audio Separation via Bi-modal Semantic Similarity
  
  Saeed Amizadeh, Kazuhito Koishida
  
  2024 International Conference on Learning Representations | May 2024
  
  Preprint
- Efficiently Computing Similarities to Private Datasets
  
  Arturs Backurs, Zinan Lin, Sepideh Mahabadi, Sandeep Silwal, Jakub Tarnawski
  
  ICLR 2024 | May 2024
  
  Publication Project
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication Project
- WizardLM: Empowering Large Language Models to Follow Complex Instructions
  
  Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, Daxin Jiang (姜大昕)
  
  ICLR 2024 | April 2023
  
  DOI PDF
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
  
  Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun, Xiubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma, Qingwei Lin 林庆维, Daxin Jiang (姜大昕)
  
  ICLR 2024 | June 2023
  
  DOI PDF
- V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection
  
  Yichao Shen, Zigang Geng, Yuhui Yuan, Yutong Lin, Ze Liu, Chunyu Wang, Han Hu, Nanning Zheng, Baining Guo
  
  ICLR 2024 | August 2023
  
  DOI PDF
- Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks
  
  Hao Chen, Jindong Wang, Ankit Shah, Ran Tao, Hongxin Wei, Xing Xie, Masashi Sugiyama, Bhiksha Raj
  
  ICLR 2024 | September 2023
  
  DOI PDF
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Minlie Huang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
  
  Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Sai Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, H. Shum, Jian Guo
  
  ICLR 2024 | July 2023
  
  Publication
- The Generative AI Paradox: “What It Can Create, It May Not Understand”
  
  Peter West, Ximing Lu, Nouha Dziri, Faeze Brahman, Linjie Li, Jena D. Hwang, Liwei Jiang, Jillian R. Fisher, Abhilasha Ravichander, Khyathi Raghavi Chandu, Benjamin Newman, Pang Wei Koh, Allyson Ettinger, Yejin Choi
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs
  
  Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Teaching Language Models to Hallucinate Less with Synthetic Tasks
  
  Erik Jones, Hamid Palangi, Clarisse Simoes Ribeiro, Varun Chandrasekaran, Subhabrata (Subho) Mukherjee, Arindam Mitra, Ahmed Awadallah, Ece Kamar
  
  ICLR 2024 | October 2023
  
  DOI PDF
- Supervised Knowledge Makes Large Language Models Better In-context Learners
  
  Linyi Yang, Shuibai Zhang, Zhuohao Yu, Guangsheng Bao, Yidong Wang, Jindong Wang, Ruochen Xu, Weirong Ye, Xing Xie, Weizhu Chen, Yue Zhang
  
  ICLR 2024 | December 2023
  
  DOI Publication
- SliceGPT: Compress Large Language Models by Deleting Rows and Columns
  
  Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari do Nascimento, Torsten Hoefler, James Hensman
  
  ICLR 2024 | January 2024
  
  DOI Publication
- Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective
  
  Ming Zhong, Chenxin An, Weizhu Chen, Jiawei Han, Pengcheng He
  
  ICLR 2024 | October 2023
  
  DOI Publication Github
- Retro-fallback: retrosynthetic planning in an uncertain world
  
  Austin Tripp, Krzysztof Maziarz, Sarah Lewis, Jose Miguel Hernandez-Lobato, Marwin Segler
  
  ICLR 2024 | October 2023
  
  DOI PDF
- ResFields: Residual Neural Fields for Spatiotemporal Signals
  
  Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- RAIN: Your Language Models Can Align Themselves without Finetuning
  
  Yuhui Li, Fangyun Wei, Jinjing Zhao, Chao Zhang, Hongyang Zhang
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation
  
  Yu Chen, Yihan Du, Pihe Hu, Siwei Wang, Desheng Wu, Longbo Huang
  
  ICLR 2024 | July 2023
  
  DOI PDF
- PromptTTS 2: Describing and Generating Voices with Text Prompt
  
  Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian
  
  ICLR 2024 | September 2023
  
  DOI PDF
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization
  
  Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Privately Aligning Language Models with Reinforcement Learning
  
  Fan Wu, Huseyin Inan, Arturs Backurs, Varun Chandrasekaran, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  DOI Project
- PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization
  
  Yidong Wang, Zhuohao Yu, Zhengran Zeng, Linyi Yang, Cunxiang Wang, Hao Chen, Chaoya Jiang, Rui Xie, Jindong Wang, Xing Xie, Wei Ye, Shi-Bo Zhang, Yue Zhang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- Neural Structure Learning with Stochastic Differential Equations
  
  Benjie Wang, Joel Jennings, Wenbo Gong
  
  ICLR 2024 | November 2023
  
  DOI Publication
- Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation
  
  Tuan Le, Julian Cremer, Frank Noé, Djork-Arné Clevert, Kristof Schütt
  
  ICLR 2024 | September 2023
  
  DOI PDF
- NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers
  
  Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  
  Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, Jianfeng Gao
  
  ICLR 2024 (Oral) | May 2024
  
  DOI Publication PDF
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  
  Fuxiao Liu, Kevin Lin, Linjie Li, Jianfeng Wang, Y. Yacoob, Lijuan Wang
  
  ICLR 2024 | June 2023
  
  Publication
- Knowledge Distillation of Large Language Models
  
  Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
  
  ICLR 2024 | June 2023
  
  DOI PDF
- MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process
  
  Xinyao Fan, Yueying Wu, Chang Xu, Yuhao Huang, Weiqing Liu, Jiang Bian
  
  ICLR 2024 | March 2024
  
  Publication
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts
  
  Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chun-yue Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, Jianfeng Gao
  
  ICLR 2024 | October 2023
  
  Publication
- MRVM-NeRF: Mask-Based Pretraining for Neural Radiance Fields
  
  Ganlin Yang, Guoqiang Wei, Zhizheng Zhang, Yan Lu, Dong Liu
  
  ICLR 2024 | April 2023
  
  DOI PDF
- LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
  
  Yixiao Li, Yifan Yu, Chen Liang, Pengcheng He, Nikos Karampatziakis, Weizhu Chen, Tuo Zhao
  
  ICLR 2024 | October 2023
  
  DOI PDF
- LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models
  
  Zecheng Tang, Chenfei Wu, Juntao Li, Nan Duan
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Whittle Index with Multiple Actions and State Constraint for Inventory Management
  
  Chuheng Zhang, Xiangsen Wang, Wei Jiang, Xianliang Yang, Siwei Wang, Lei Song, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  Publication
- FeatUp: A Model-Agnostic Framework for Features at Any Resolution
  
  Mark Hamilton
  
  ICLR 2024 | March 2024
  
  Publication Project
- Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
  
  Marco Federici, Patrick Forr'e, Ryota Tomioka, Bastiaan S. Veeling
  
  ICLR 2024 | September 2023
  
  DOI Publication
- Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning
  
  Murong Yue, Jie Zhao, Min Zhang, Liang Du, Ziyu Yao
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Is Self-Repair a Silver Bullet for Code Generation?
  
  Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, Armando Solar-Lezama
  
  ICLR 2024 | June 2023
  
  Publication
- In-Context Learning through the Bayesian Prism
  
  Kabir Ahuja, Madhur Panwar, Navin Goyal
  
  ICLR 2024 | June 2023
  
  Publication PDF DOI
- In-context Autoencoder for Context Compression in a Large Language Model
  
  Tao Ge, Jing Hu, Haixun Wang, Si-Qing Chen, Furu Wei
  
  ICLR 2024 | July 2023
  
  DOI Publication
- Improving Offline RL by Blending Heuristics
  
  Sinong Geng, Aldo Pacchiano, Aldo Pacchiano, A. Kolobov, Ching-An Cheng
  
  ICLR 2024 | May 2023
  
  DOI Publication
- How to Fine-Tune Vision Models with SGD
  
  Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar
  
  ICLR 2024 | November 2022
  
  DOI Publication
- Harnessing Density Ratios for Online Reinforcement Learning
  
  P. Amortila, Dylan Foster, Nan Jiang, Ayush Sekhari, Tengyang Xie
  
  ICLR 2024 | January 2024
  
  DOI Publication
- GAIA: Zero-shot Talking Avatar Generation
  
  Tianyu He, Junliang Guo, Runyi Yu, Yuchi Wang, Jialiang Zhu, Kaikai An, Leyi Li, Xu Tan, Chunyu Wang, HsiangTao Wu, Sheng Zhao, Jiang Bian
  
  2024 International Conference on Learning Representations | May 2024
  
  DOI Publication
- Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models
  
  Peiyan Zhang, Hao Liu, Chaozhuo Li, Xing Xie, Sunghun Kim, Haohan Wang
  
  ICLR 2024 | August 2023
  
  DOI Publication PDF
- Fast-ELECTRA for Efficient Pre-training
  
  Chengyu Dong, Liyuan Liu, Hao Cheng, Jingbo Shang, Jianfeng Gao, Xiaodong Liu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals
  
  Y. Gat, Nitay Calderon, Amir Feder, Alexander Chapanin, Amit Sharma, Roi Reichart
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Exploring Diffusion Time-steps for Unsupervised Representation Learning
  
  Zhongqi Yue, Jiankun Wang, Qianru Sun, Lei Ji, E. Chang, Hanwang Zhang
  
  ICLR 2024 | January 2024
  
  DOI Publication
- DyVal: Graph-informed Dynamic Evaluation of Large Language Models
  
  Kaijie Zhu, Jiaao Chen, Jindong Wang, Neil Zhenqiang Gong, Diyi Yang, Xing Xie
  
  ICLR 2024 | September 2023
  
  DOI Publication
- DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models
  
  Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, Pengcheng He
  
  ICLR 2024 | September 2023
  
  DOI PDF
- Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making
  
  Aliyah R. Hsu, Yeshwanth Cherapanamjeri, Briton Park, Tristan Naumann, A. Odisho, Bin Yu
  
  ICLR 2024 | May 2023
  
  Publication
- Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning
  
  Shitong Duan, Xiaoyuan Yi, Peng Zhang, T. Lu, Xing Xie, Ning Gu
  
  ICLR 2024 | October 2023
  
  DOI Publication
- CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing
  
  Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, Weizhu Chen
  
  ICLR 2024 | May 2023
  
  DOI Publication
- Combinatorial Bandits for Maximum Value Reward Function under Max Value-Index Feedback
  
  Yiliu Wang, Wei Chen, Milan Vojnovic
  
  ICLR 2024 | May 2023
  
  DOI Publication PDF
- Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression
  
  Adam Block, Dylan Foster, Akshay Krishnamurthy, Max Simchowitz, Cyril Zhang
  
  ICLR 2024 | October 2023
  
  DOI Publication
- Better Neural PDE Solvers Through Data-Free Mesh Movers
  
  Peiyan Hu, Yue Wang, Zhi-Ming Ma
  
  ICLR 2024 | December 2023
  
  DOI Publication
- BatteryML: An Open-source platform for Machine Learning on Battery Degradation
  
  Han Zhang, Xiaofan Gui, Shun Zheng, Ziheng Lu, Yuqi Li, Jiang Bian
  
  ICLR 2024 | October 2023
  
  DOI Video Github
- BatchPrompt: Accomplish more with less
  
  Jianzhe Lin, Maurice Diesendruck, Liang Du, Robin Abraham
  
  ICLR 2024 | August 2023
  
  DOI
- Augmenting transformers with recursively composed multi-grained representations
  
  Xiang Hu, Qingyang Zhu, Kewei Tu, Wei Wu
  
  ICLR 2024 | September 2023
  
  DOI
- Adaptive Instrument Design for Indirect Experiments
  
  Yash Chandak, Shiv Shankar, Vasilis Syrgkanis, Emma Brunskill
  
  ICLR 2024 | December 2023
  
  DOI Publication
- Adapting Large Language Models via Reading Comprehension
  
  Daixuan Cheng, Shaohan Huang, Furu Wei
  
  ICLR 2024 | September 2023
  
  DOI
- 3D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining
  
  Siming Yan, Yu-Qi Yang, Yu-Xiao Guo, Hao Pan, Peng-Shuai Wang, Xin Tong, Yang Liu, Qi-Xing Huang
  
  ICLR 2024 | April 2023
  
  DOI PDF
- Cascading Reinforcement Learning
  
  Yihan Du, R. Srikant, Wei Chen
  
  Proceedings of the 12th International Conference on Learning Representations (ICLR) | May 2024
  
  PDF
- Inverse Approximation Theory for Nonlinear Recurrent Neural Networks
  
  Shida Wang, Zhong Li, Qianxiao Li
  
  ICLR 2024 | January 2024
  
  Spotlight
  
  Publication
- Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers
  
  Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, Yuqing Yang
  
  ICLR 2024 | September 2023
  
  Publication Publication
- A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models
  
  Haoran Xu, Young Jin Kim, Amr Sharaf, Hany Hassan Awadalla
  
  Accepted to ICLR 2024 | September 2023
  
  Preprint
- Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks
  
  M. Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, Devis Tuia
  
  ICLR 2024 | October 2023
  
  DOI Publication
- The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction
  
  Pratyusha Sharma, Jordan Ash, Dipendra Misra
  
  ICLR 2024 | December 2023
  
  DOI
- MOFDiff: Coarse-grained Diffusion for Metal-Organic Framework Design
  
  Xiang Fu, Tian Xie, Andrew S. Rosen, Tommi Jaakkola, Jake Smith
  
  ICLR 2024 | October 2023
  
  Publication Github
- Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation
  
  Xinyu Tang, Richard Shin, Huseyin Inan, Andre Manoel, Fatemehsadat Mireshghallah, Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Robert Sim
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training
  
  Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
  
  ICLR 2024 | October 2023
  
  Publication
- UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
  
  Wenxuan Zhou, Sheng Zhang, Yu Gu, Muhao Chen, Hoifung Poon
  
  ICLR 2024 | September 2023
  
  Publication
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
  
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang (Eric) Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Ahmed Awadallah, Ryen W. White, Doug Burger, Chi Wang
  
  COLM 2024 | August 2024
  
  Best Paper, LLM Agents Workshop ICLR'24
  
  Publication Video Video Video Project
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation
  
  Xuefei Ning, Zinan Lin, Zixuan Zhou, Zifu Wang, Huazhong Yang, Yu Wang
  
  ICLR 2024 | May 2024
  
  Publication Publication Publication
- ZeRO++: Extremely Efficient Collective Communication for Giant Model Training
  
  Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yang, Lei Yang, Yuxiong He
  
  ICLR 2024 | May 2024
  
  Publication PDF Project
- Differentially Private Synthetic Data via Foundation Model APIs 1: Images
  
  Zinan Lin, Sivakanth Gopi, Janardhan (Jana) Kulkarni, Harsha Nori, Sergey Yekhanin
  
  ICLR 2024 | May 2024
  
  Publication Publication Github Project
- Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models
  
  Mert Yuksekgonul, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi
  
  September 2023
  
  DOI Publication Video
- KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
  
  Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
  
  October 2023
  
  DOI Publication Video

Microsoft at ICLR 2024

Publications

ZeRO++: Extremely Efficient Collective Communication for Large Model Training

Designing Skill-Compatible AI: Methodologies and Frameworks in Chess

Kosmos-G: Generating Images in Context with Multimodal Large Language Models

Coco-Periph: Bridging the Gap Between Human and Machine Perception in the Periphery

Mixture of LoRA Experts

Solving Inverse Problems with Latent Diffusion Models via Hard Data Consistency

Evoke: Evoking Critical Thinking Abilities in LLMs via Reviewer-Author Prompt Editing

Combinatorial Bandits for Maximum Value Reward Function under Value-index Feedback

InsertNeRF: Instilling Generalizability into NeRF with HyperNet Modules

Unifying Feature and Cost Aggregation with Transformers for Dense Correspondence

CNN Kernels Can Be the Best Shapelets

PTaRL: Prototype-based Tabular Representation Learning via Space Calibration

Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction

Addressing Signal Delay in Deep Reinforcement Learning

Training-free Multi-objective Diffusion Model for 3D Molecule Generation

Weakly-supervised Audio Separation via Bi-modal Semantic Similarity

Efficiently Computing Similarities to Private Datasets

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

SliceGPT: Compress Large Language Models by Deleting Rows and Columns

Privately Aligning Language Models with Reinforcement Learning

Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs

MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process

Whittle Index with Multiple Actions and State Constraint for Inventory Management

FeatUp: A Model-Agnostic Framework for Features at Any Resolution

Harnessing Density Ratios for Online Reinforcement Learning

GAIA: Zero-shot Talking Avatar Generation

Exploring Diffusion Time-steps for Unsupervised Representation Learning

Cascading Reinforcement Learning

Inverse Approximation Theory for Nonlinear Recurrent Neural Networks

Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Skeleton-of-Thought: Prompting LLMs for Efficient Parallel Generation

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training

Differentially Private Synthetic Data via Foundation Model APIs 1: Images

WizardLM: Empowering Large Language Models to Follow Complex Instructions

WizardCoder: Empowering Code Large Language Models with Evol-Instruct

V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detection

Understanding and Mitigating the Label Noise in Pre-training on Downstream Tasks

ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving

Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

The Generative AI Paradox: “What It Can Create, It May Not Understand”

Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs

Teaching Language Models to Hallucinate Less with Synthetic Tasks

Supervised Knowledge Makes Large Language Models Better In-context Learners

Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution

Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective

Retro-fallback: retrosynthetic planning in an uncertain world

ResFields: Residual Neural Fields for Spatiotemporal Signals

RAIN: Your Language Models Can Align Themselves without Finetuning

Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation

PromptTTS 2: Describing and Generating Voices with Text Prompt

PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization

Neural Structure Learning with Stochastic Differential Equations

Navigating the Design Space of Equivariant Diffusion-Based Generative Models for De Novo 3D Molecule Generation

NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers

Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

Knowledge Distillation of Large Language Models

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

MRVM-NeRF: Mask-Based Pretraining for Neural Radiance Fields

LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models

LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models

Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck

Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning

Is Self-Repair a Silver Bullet for Code Generation?

In-Context Learning through the Bayesian Prism

In-context Autoencoder for Context Compression in a Large Language Model

Improving Offline RL by Blending Heuristics

Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Models

Fast-ELECTRA for Efficient Pre-training

Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals

DyVal: Graph-informed Dynamic Evaluation of Large Language Models

DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models

Diagnosing Transformers: Illuminating Feature Spaces for Clinical Decision-Making

Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning

CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing

Combinatorial Bandits for Maximum Value Reward Function under Max Value-Index Feedback

Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression