abstract multi-colored bubbles on a purple background

April 25, 2022 – April 29, 2022

Microsoft at ICLR 2022

Location: Virtual

Publications

View by:

- Message Passing Neural PDE Solvers
  
  Johannes Brandstetter, Daniel Worrall, Max Welling
  
  ICLR 2022 | April 2022
  
  Publication
- A Piece-wise Polynomial Filtering Approach for Graph Neural Networks
  
  Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam
  
  ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022
  
  Publication Publication Github
- Variational oracle guiding for reinforcement learning
  
  Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Semantic Segmentation by Distilling Feature Correspondences
  
  Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
  
  Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin
  
  ICLR 2022 | April 2022
  
  Publication
- Triangle and Four Cycle Counting with Predictions in Graph Streams
  
  Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang
  
  ICLR 2022 | April 2022
  
  Publication
- Transformer Embeddings of Irregularly Spaced Events and Their Participants
  
  Hongyuan Mei, Chenghao Yang, Jason Eisner
  
  ICLR 2022 | April 2022
  
  Publication
- Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality
  
  Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu
  
  Tenth International Conference on Learning Representations(ICLR) | April 2022
  
  Publication
- Towards Building A Group-based Unsupervised Representation Disentanglement Framework
  
  Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng
  
  ICLR 2022 | April 2022
  
  Publication
- Target-Side Input Augmentation for Sequence to Sequence Generation
  
  Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan
  
  ICLR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond
  
  Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia
  
  ICLR 2022 | April 2022
  
  Publication
- Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph
  
  Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Representational Continuity for Unsupervised Continual Learning
  
  Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang
  
  ICLR 2022 | April 2022
  
  Publication
- Recursive Disentanglement Network
  
  Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang
  
  ICLR 2022 | April 2022
  
  Publication
- Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | April 2022
  
  Publication
- PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior
  
  Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  
  Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
  
  ICLR 2022 | April 2022
  
  Publication Github
- On the Connection between Local Attention and Dynamic Depth-wise Convolution
  
  Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang
  
  ICLR 2022 | April 2022
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Modular Lifelong Reinforcement Learning via Neural Composition
  
  Jorge A. Mendez, Harm van Seijen, Eric Eaton
  
  ICLR 2022 | April 2022
  
  Publication
- Missingness Bias in Model Debugging
  
  Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
  
  ICLR 2022 | April 2022
  
  Publication
- Mirror Descent Policy Optimization
  
  Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh
  
  ICLR 2022 | April 2022
  
  Publication
- Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
  
  Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Downsample for Segmentation of Ultra-High Resolution Images
  
  Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Dequantise with Truncated Flows
  
  Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Object-Oriented Dynamics for Planning from Text
  
  Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View
  
  Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Gradient Information Matters in Policy Optimization by Back-propagating through Model
  
  Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- GNN is a Counter? Revisiting GNN for Question Answering
  
  Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin
  
  ICLR 2022 | April 2022
  
  Publication
- Generalized Kernel Thinning
  
  Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication Github
- Exploiting Class Activation Value for Partial-Label Learning
  
  Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama
  
  ICLR 2022 | April 2022
  
  Publication
- Explaining Point Processes by Learning Interpretable Temporal Logic Rules
  
  Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song
  
  ICLR 2022 | April 2022
  
  Publication
- Evaluating Distributional Distortion in Neural Language Modeling
  
  Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell
  
  ICLR 2022 | April 2022
  
  Publication
- Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features
  
  Greg Yang, Michael Santacroce, Edward J. Hu
  
  ICLR 2022 | April 2022
  
  Publication
- Distribution Compression in Near-Linear Time
  
  Abhishek Shetty, Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting
  
  Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Creating Training Sets via Weak Indirect Supervision
  
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner
  
  ICLR 2022 | April 2022
  
  Publication
- Boosting the Certified Robustness of L-infinity Distance Nets
  
  Bohang Zhang, Du Jiang, Di He, Liwei Wang
  
  ICLR 2022 | March 2022
  
  Publication
- BEiT: BERT Pre-Training of Image Transformers
  
  Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
  
  ICLR 2022 | April 2022
  
  Publication
- Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning
  
  Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Anti-Concentrated Confidence Bonuses for Scalable Exploration
  
  Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Adversarial Retriever-Ranker for dense text retrieval
  
  Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Learning to Complete Code with Sketches
  
  Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis
  
  ICLR 2022 | April 2022
  
  Publication Project Project
- Learning to Extend Molecular Scaffolds with Structural Motifs
  
  Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt
  
  ICLR 2022 | April 2022
  
  Publication Github Project
- Sampling with Mirrored Stein Operators
  
  Jiaxin Shi, Chang Liu, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
  
  Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维
  
  ICLR 2022 | April 2022
  
  Publication Project
- Synchromesh: Reliable code generation from pre-trained language models
  
  Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
  
  ICLR 2022 | April 2022
  
  Publication PDF Project
- Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning
  
  Chun-Hao Chang, Rich Caruana, Anna Goldenberg
  
  ICLR 2022 | April 2022
  
  Publication
- Knowledge Infused Decoding
  
  Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah
  
  ICLR 2022 | April 2022
  
  Publication Github
- Optimal Transport for Causal Discovery
  
  Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- Differentially private fine-tuning of language models
  
  Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- LoRA: Low-Rank Adaptation of Large Language Models
  
  Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Video Github Project
- Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
  
  Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov
  
  ICLR 2022 | April 2022
  
  Publication
- Provable RL with Exogenous Distractors via Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | October 2021
  
  Publication Publication

- Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
  
  Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维
  
  ICLR 2022 | April 2022
  
  Publication Project
- Differentially private fine-tuning of language models
  
  Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- Message Passing Neural PDE Solvers
  
  Johannes Brandstetter, Daniel Worrall, Max Welling
  
  ICLR 2022 | April 2022
  
  Publication
- Provable RL with Exogenous Distractors via Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | October 2021
  
  Publication Publication
- A Piece-wise Polynomial Filtering Approach for Graph Neural Networks
  
  Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam
  
  ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022
  
  Publication Publication Github
- Variational oracle guiding for reinforcement learning
  
  Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Semantic Segmentation by Distilling Feature Correspondences
  
  Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
  
  Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin
  
  ICLR 2022 | April 2022
  
  Publication
- Triangle and Four Cycle Counting with Predictions in Graph Streams
  
  Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang
  
  ICLR 2022 | April 2022
  
  Publication
- Transformer Embeddings of Irregularly Spaced Events and Their Participants
  
  Hongyuan Mei, Chenghao Yang, Jason Eisner
  
  ICLR 2022 | April 2022
  
  Publication
- Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality
  
  Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu
  
  Tenth International Conference on Learning Representations(ICLR) | April 2022
  
  Publication
- Towards Building A Group-based Unsupervised Representation Disentanglement Framework
  
  Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng
  
  ICLR 2022 | April 2022
  
  Publication
- Target-Side Input Augmentation for Sequence to Sequence Generation
  
  Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan
  
  ICLR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond
  
  Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia
  
  ICLR 2022 | April 2022
  
  Publication
- Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph
  
  Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Representational Continuity for Unsupervised Continual Learning
  
  Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang
  
  ICLR 2022 | April 2022
  
  Publication
- Recursive Disentanglement Network
  
  Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang
  
  ICLR 2022 | April 2022
  
  Publication
- Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | April 2022
  
  Publication
- PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior
  
  Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  
  Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
  
  ICLR 2022 | April 2022
  
  Publication Github
- On the Connection between Local Attention and Dynamic Depth-wise Convolution
  
  Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang
  
  ICLR 2022 | April 2022
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Modular Lifelong Reinforcement Learning via Neural Composition
  
  Jorge A. Mendez, Harm van Seijen, Eric Eaton
  
  ICLR 2022 | April 2022
  
  Publication
- Missingness Bias in Model Debugging
  
  Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
  
  ICLR 2022 | April 2022
  
  Publication
- Mirror Descent Policy Optimization
  
  Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh
  
  ICLR 2022 | April 2022
  
  Publication
- Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
  
  Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Downsample for Segmentation of Ultra-High Resolution Images
  
  Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Dequantise with Truncated Flows
  
  Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Object-Oriented Dynamics for Planning from Text
  
  Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View
  
  Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Gradient Information Matters in Policy Optimization by Back-propagating through Model
  
  Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- GNN is a Counter? Revisiting GNN for Question Answering
  
  Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin
  
  ICLR 2022 | April 2022
  
  Publication
- Generalized Kernel Thinning
  
  Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication Github
- Exploiting Class Activation Value for Partial-Label Learning
  
  Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama
  
  ICLR 2022 | April 2022
  
  Publication
- Explaining Point Processes by Learning Interpretable Temporal Logic Rules
  
  Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song
  
  ICLR 2022 | April 2022
  
  Publication
- Evaluating Distributional Distortion in Neural Language Modeling
  
  Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell
  
  ICLR 2022 | April 2022
  
  Publication
- Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features
  
  Greg Yang, Michael Santacroce, Edward J. Hu
  
  ICLR 2022 | April 2022
  
  Publication
- Distribution Compression in Near-Linear Time
  
  Abhishek Shetty, Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting
  
  Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Creating Training Sets via Weak Indirect Supervision
  
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner
  
  ICLR 2022 | April 2022
  
  Publication
- Boosting the Certified Robustness of L-infinity Distance Nets
  
  Bohang Zhang, Du Jiang, Di He, Liwei Wang
  
  ICLR 2022 | March 2022
  
  Publication
- BEiT: BERT Pre-Training of Image Transformers
  
  Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
  
  ICLR 2022 | April 2022
  
  Publication
- Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning
  
  Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Anti-Concentrated Confidence Bonuses for Scalable Exploration
  
  Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Adversarial Retriever-Ranker for dense text retrieval
  
  Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Learning to Complete Code with Sketches
  
  Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis
  
  ICLR 2022 | April 2022
  
  Publication Project Project
- Learning to Extend Molecular Scaffolds with Structural Motifs
  
  Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt
  
  ICLR 2022 | April 2022
  
  Publication Github Project
- Sampling with Mirrored Stein Operators
  
  Jiaxin Shi, Chang Liu, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
  
  Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维
  
  ICLR 2022 | April 2022
  
  Publication Project
- Synchromesh: Reliable code generation from pre-trained language models
  
  Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
  
  ICLR 2022 | April 2022
  
  Publication PDF Project
- Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning
  
  Chun-Hao Chang, Rich Caruana, Anna Goldenberg
  
  ICLR 2022 | April 2022
  
  Publication
- Knowledge Infused Decoding
  
  Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah
  
  ICLR 2022 | April 2022
  
  Publication Github
- Optimal Transport for Causal Discovery
  
  Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- LoRA: Low-Rank Adaptation of Large Language Models
  
  Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Video Github Project
- Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
  
  Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov
  
  ICLR 2022 | April 2022
  
  Publication
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
  
  Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维
  
  ICLR 2022 | April 2022
  
  Publication Project
- Adversarial Retriever-Ranker for dense text retrieval
  
  Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Knowledge Infused Decoding
  
  Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah
  
  ICLR 2022 | April 2022
  
  Publication Github
- LoRA: Low-Rank Adaptation of Large Language Models
  
  Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Video Github Project
- Learning to Complete Code with Sketches
  
  Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis
  
  ICLR 2022 | April 2022
  
  Publication Project Project
- Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
  
  Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
  
  ICLR 2022 | April 2022
  
  Publication
- Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond
  
  Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia
  
  ICLR 2022 | April 2022
  
  Publication

- Message Passing Neural PDE Solvers
  
  Johannes Brandstetter, Daniel Worrall, Max Welling
  
  ICLR 2022 | April 2022
  
  Publication
- Provable RL with Exogenous Distractors via Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | October 2021
  
  Publication Publication
- A Piece-wise Polynomial Filtering Approach for Graph Neural Networks
  
  Vijay Lingam, Chanakya Ekbote, Manan Sharma, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam
  
  ICLR 2022 Workshop on Geometrical and Topological Representation Learning (GTRL-ICLR) | May 2022
  
  Publication Publication Github
- Variational oracle guiding for reinforcement learning
  
  Dongqi Han, Tadashi Kozuno, Xufang Luo, Zhao-Yun Chen, Kenji Doya, Yuqing Yang, Dongsheng Li
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Semantic Segmentation by Distilling Feature Correspondences
  
  Mark Hamilton, Zhoutong Zhang, Bharath Hariharan, Noah Snavely, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop
  
  Peng Jin, Xitong Zhang, Yinpeng Chen, Sharon X. Huang, Zicheng Liu, Youzuo Lin
  
  ICLR 2022 | April 2022
  
  Publication
- Triangle and Four Cycle Counting with Predictions in Graph Streams
  
  Justin Y. Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang
  
  ICLR 2022 | April 2022
  
  Publication
- Transformer Embeddings of Irregularly Spaced Events and Their Participants
  
  Hongyuan Mei, Chenghao Yang, Jason Eisner
  
  ICLR 2022 | April 2022
  
  Publication
- Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality
  
  Jiawei Huang, Jinglin Chen, Li Zhao, Tao Qin, Nan Jiang, Tie-Yan Liu
  
  Tenth International Conference on Learning Representations(ICLR) | April 2022
  
  Publication
- Towards Building A Group-based Unsupervised Representation Disentanglement Framework
  
  Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng
  
  ICLR 2022 | April 2022
  
  Publication
- Target-Side Input Augmentation for Sequence to Sequence Generation
  
  Shufang Xie, Ang Lv, Yingce Xia, Lijun Wu, Tao Qin, Tie-Yan Liu, Rui Yan
  
  ICLR 2022 | April 2022
  
  Publication
- SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation
  
  Cong Guo, Yuxian Qiu, Jingwen Leng, Xiaotian Gao, Chen Zhang, Yunxin Liu, Fan Yang, Yuhao Zhu, Minyi Guo
  
  ICLR 2022 | April 2022
  
  Publication
- Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond
  
  Jonathan Godwin, Michael Schaarschmidt, Alexander Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, Peter Battaglia
  
  ICLR 2022 | April 2022
  
  Publication
- Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph
  
  Dacheng Yin, Xuanchi Ren, Chong Luo, Yuwang Wang, Zhiwei Xiong, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Representational Continuity for Unsupervised Continual Learning
  
  Divyam Madaan, Jaehong Yoon, Yuanchun Li, Yunxin Liu, Sung Ju Hwang
  
  ICLR 2022 | April 2022
  
  Publication
- Recursive Disentanglement Network
  
  Yixuan Chen, Yubin Shi, Dongsheng Li, Yujiang Wang, Mingzhi Dong, Yingying Zhao, Robert Dick, Qin Lv, Fan Yang, Li Shang
  
  ICLR 2022 | April 2022
  
  Publication
- Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics
  
  Yonathan Efroni, Dipendra Misra, Akshay Krishnamurthy, Alekh Agarwal, John Langford
  
  ICLR 2022 | April 2022
  
  Publication
- PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior
  
  Sang-gil Lee, Heeseung Kim, Chaehun Shin, Xu Tan, Chang Liu, Qi Meng, Tao Qin, Wei Chen, Sungroh Yoon, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  
  Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song
  
  ICLR 2022 | April 2022
  
  Publication Github
- On the Connection between Local Attention and Dynamic Depth-wise Convolution
  
  Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang
  
  ICLR 2022 | April 2022
  
  Publication
- No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models
  
  Chen Liang, Haoming Jiang, Simiao Zuo, Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen, Tuo Zhao
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Modular Lifelong Reinforcement Learning via Neural Composition
  
  Jorge A. Mendez, Harm van Seijen, Eric Eaton
  
  ICLR 2022 | April 2022
  
  Publication
- Missingness Bias in Model Debugging
  
  Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
  
  ICLR 2022 | April 2022
  
  Publication
- Mirror Descent Policy Optimization
  
  Manan Tomar, Lior Shani, Yonathan Efroni, Mohammad Ghavamzadeh
  
  ICLR 2022 | April 2022
  
  Publication
- Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
  
  Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Downsample for Segmentation of Ultra-High Resolution Images
  
  Chen Jin, Ryutaro Tanno, Thomy Mertzanidou, Eleftheria Panagiotaki, Daniel C. Alexander
  
  ICLR 2022 | April 2022
  
  Publication
- Learning to Dequantise with Truncated Flows
  
  Shawn Tan, Chin-Wei Huang, Alessandro Sordoni, Aaron Courville
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Object-Oriented Dynamics for Planning from Text
  
  Guiliang Liu, Ashutosh Adhikari, Amir-massoud Farahmand, Pascal Poupart
  
  ICLR 2022 | April 2022
  
  Publication
- Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View
  
  Xuanchi Ren, Tao Yang, Yuwang Wang, Wenjun Zeng
  
  ICLR 2022 | April 2022
  
  Publication
- Gradient Information Matters in Policy Optimization by Back-propagating through Model
  
  Chongchong Li, Yue Wang, Wei Chen, Yuting Liu, Zhi-Ming Ma, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- GNN is a Counter? Revisiting GNN for Question Answering
  
  Kuan Wang, Yuyu Zhang, Diyi Yang, Le Song, Tao Qin
  
  ICLR 2022 | April 2022
  
  Publication
- Generalized Kernel Thinning
  
  Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication Github
- Exploiting Class Activation Value for Partial-Label Learning
  
  Fei Zhang, Lei Feng, Bo Han, Tongliang Liu, Gang Niu, Tao Qin, Masashi Sugiyama
  
  ICLR 2022 | April 2022
  
  Publication
- Explaining Point Processes by Learning Interpretable Temporal Logic Rules
  
  Shuang Li, Mingquan Feng, Lu Wang, Abdelmajid Essofi, Yufeng Cao, Junchi Yan, Le Song
  
  ICLR 2022 | April 2022
  
  Publication
- Evaluating Distributional Distortion in Neural Language Modeling
  
  Benjamin LeBrun, Alessandro Sordoni, Timothy J. O’Donnell
  
  ICLR 2022 | April 2022
  
  Publication
- Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features
  
  Greg Yang, Michael Santacroce, Edward J. Hu
  
  ICLR 2022 | April 2022
  
  Publication
- Distribution Compression in Near-Linear Time
  
  Abhishek Shetty, Raaz Dwivedi, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting
  
  Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, Tie-Yan Liu
  
  ICLR 2022 | April 2022
  
  Publication
- Creating Training Sets via Weak Indirect Supervision
  
  Jieyu Zhang, Bohan Wang, Xiangchen Song, Yujing Wang, Yaming Yang, Jing Bai, Alexander Ratner
  
  ICLR 2022 | April 2022
  
  Publication
- Boosting the Certified Robustness of L-infinity Distance Nets
  
  Bohang Zhang, Du Jiang, Di He, Liwei Wang
  
  ICLR 2022 | March 2022
  
  Publication
- BEiT: BERT Pre-Training of Image Transformers
  
  Hangbo Bao, Li Dong, Songhao Piao, Furu Wei
  
  ICLR 2022 | April 2022
  
  Publication
- Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning
  
  Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William T. Freeman
  
  ICLR 2022 | April 2022
  
  Publication
- Anti-Concentrated Confidence Bonuses for Scalable Exploration
  
  Jordan T. Ash, Cyril Zhang, Surbhi Goel, Akshay Krishnamurthy, Sham M. Kakade
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Adversarial Retriever-Ranker for dense text retrieval
  
  Hang Zhang, Yeyun Gong, Yelong Shen, Jiancheng Lv, Nan Duan, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Publication
- Taming Sparsely Activated Transformer with Stochastic Experts
  
  Simiao Zuo, Xiaodong Liu, Jian Jiao, Young Jin Kim, Hany Hassan Awadalla, Ruofei Zhang, Tuo Zhao, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Project
- Learning to Complete Code with Sketches
  
  Daya Guo, Alexey Svyatkovskiy, Jian Yin, Nan Duan, Marc Brockschmidt, Miltos Allamanis
  
  ICLR 2022 | April 2022
  
  Publication Project Project
- Learning to Extend Molecular Scaffolds with Structural Motifs
  
  Krzysztof Maziarz, Henry Jackson-Flux, Pashmina Cameron, Finton Sirockin, Nadine Schneider, Nikolaus Stiefl, Marwin Segler, Marc Brockschmidt
  
  ICLR 2022 | April 2022
  
  Publication Github Project
- Sampling with Mirrored Stein Operators
  
  Jiaxin Shi, Chang Liu, Lester Mackey
  
  ICLR 2022 | April 2022
  
  Publication
- Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property
  
  Boshi Wang, Jialin Yi, Hang Dong, Bo Qiao, Chuan Luo, Qingwei Lin 林庆维
  
  ICLR 2022 | April 2022
  
  Publication Project
- Synchromesh: Reliable code generation from pre-trained language models
  
  Gabriel Poesia, Alex Polozov, Vu Le, Ashish Tiwari, Gustavo Soares, Chris Meek, Sumit Gulwani
  
  ICLR 2022 | April 2022
  
  Publication PDF Project
- Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning
  
  Chun-Hao Chang, Rich Caruana, Anna Goldenberg
  
  ICLR 2022 | April 2022
  
  Publication
- Knowledge Infused Decoding
  
  Ruibo Liu, Guoqing Zheng, Shashank Gupta, Radhika Gaonkar, Chongyang Gao, Soroush Vosoughi, Milad Shokouhi, Ahmed Awadallah
  
  ICLR 2022 | April 2022
  
  Publication Github
- Optimal Transport for Causal Discovery
  
  Ruibo Tu, Hedvig Kjellstrom, Kun Zhang, Cheng Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- Efficient Self-supervised Vision Transformers for Representation Learning
  
  Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao
  
  ICLR 2022 | April 2022
  
  Publication Publication Github
- Differentially private fine-tuning of language models
  
  Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Gautam Kamath, Janardhan (Jana) Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang
  
  ICLR 2022 | April 2022
  
  Publication Project
- LoRA: Low-Rank Adaptation of Large Language Models
  
  Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen
  
  ICLR 2022 | April 2022
  
  Publication Video Github Project
- Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
  
  Bogdan Mazoure, Ahmed Ahmed, Patrick MacAlpine, Devon Hjelm, Andrey Kolobov
  
  ICLR 2022 | April 2022
  
  Publication

Microsoft at ICLR 2022

Publications

Message Passing Neural PDE Solvers

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Variational oracle guiding for reinforcement learning

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

Triangle and Four Cycle Counting with Predictions in Graph Streams

Transformer Embeddings of Irregularly Spaced Events and Their Participants

Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Target-Side Input Augmentation for Sequence to Sequence Generation

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Representational Continuity for Unsupervised Continual Learning

Recursive Disentanglement Network

Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

On the Connection between Local Attention and Dynamic Depth-wise Convolution

No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models

Modular Lifelong Reinforcement Learning via Neural Composition

Missingness Bias in Model Debugging

Mirror Descent Policy Optimization

Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs

Learning to Downsample for Segmentation of Ultra-High Resolution Images

Learning to Dequantise with Truncated Flows

Learning Object-Oriented Dynamics for Planning from Text

Learning Disentangled Representation by Exploiting Pretrained Generative Models: A Contrastive Learning View

Gradient Information Matters in Policy Optimization by Back-propagating through Model

GNN is a Counter? Revisiting GNN for Question Answering

Generalized Kernel Thinning

Exploiting Class Activation Value for Partial-Label Learning

Explaining Point Processes by Learning Interpretable Temporal Logic Rules

Evaluating Distributional Distortion in Neural Language Modeling

Efficient Computation of Deep Nonlinear Infinite-Width Neural Networks that Learn Features

Distribution Compression in Near-Linear Time

DEPTS: Deep Expansion Learning for Periodic Time Series Forecasting

Creating Training Sets via Weak Indirect Supervision

Boosting the Certified Robustness of L-infinity Distance Nets

BEiT: BERT Pre-Training of Image Transformers

Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning

Anti-Concentrated Confidence Bonuses for Scalable Exploration

Adversarial Retriever-Ranker for dense text retrieval

Taming Sparsely Activated Transformer with Stochastic Experts

Learning to Complete Code with Sketches

Learning to Extend Molecular Scaffolds with Structural Motifs

Sampling with Mirrored Stein Operators

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Synchromesh: Reliable code generation from pre-trained language models

Node-GAM: Neural Generalized Additive Model For Interpretable Deep Learning

Knowledge Infused Decoding

Optimal Transport for Causal Discovery

Efficient Self-supervised Vision Transformers for Representation Learning

Differentially private fine-tuning of language models

LoRA: Low-Rank Adaptation of Large Language Models

Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL

Provable RL with Exogenous Distractors via Multistep Inverse Dynamics

Automatic Loss Function Search for Predict-Then-Optimize Problems with Strong Ranking Property

Differentially private fine-tuning of language models

Message Passing Neural PDE Solvers

Provable RL with Exogenous Distractors via Multistep Inverse Dynamics

A Piece-wise Polynomial Filtering Approach for Graph Neural Networks

Variational oracle guiding for reinforcement learning

Unsupervised Semantic Segmentation by Distilling Feature Correspondences

Unsupervised Learning of Full-Waveform Inversion: Connecting CNN and Partial Differential Equation in a Loop

Triangle and Four Cycle Counting with Predictions in Graph Streams

Transformer Embeddings of Irregularly Spaced Events and Their Participants

Towards Deployment-Efficient Reinforcement Learning: Lower Bound and Optimality

Towards Building A Group-based Unsupervised Representation Disentanglement Framework

Target-Side Input Augmentation for Sequence to Sequence Generation

SQuant: On-the-Fly Data-Free Quantization via Diagonal Hessian Approximation

Simple GNN Regularisation for 3D Molecular Property Prediction and Beyond

Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph

Representational Continuity for Unsupervised Continual Learning

Recursive Disentanglement Network

Provably Filtering Exogenous Distractors using Multistep Inverse Dynamics

PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior

Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators