ClimaX: A foundation model for weather and climate
Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover
ICML 2023 | July 2023
Autonomous Systems and Robotics Group
Developing training and simulation technologies for robotics systems
Publications
Publications
Publications by Year
-
ChatGPT for Robotics: Design Principles and Model Abilities
Sai Vemprala, Rogerio Bonatti, Arthur Bucker, Ashish Kapoor
MSR-TR-2023-8 | February 2023
Published by Microsoft
-
Learning Modular Simulations for Homogeneous Systems
Jayesh K. Gupta, Sai Vemprala, Ashish Kapoor
2022 Neural Information Processing Systems | November 2022
COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems
Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
Learning to Simulate Realistic LiDARs
Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
Towards Multi-spatiotemporal-scale Generalized PDE Modeling
Jayesh K. Gupta, Johannes Brandstetter
MSR-TR-2022-27 | September 2022
Published by Microsoft
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma, Felipe Vieira Frujeri, Shuhang Chen, Ashish Kapoor
IROS 2023 | September 2022
MoBT 17.1 / MoBIP 17.1
Clifford Neural Layers for PDE Modeling
Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta
September 2022
Missingness Bias in Model Debugging
Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
ICLR 2022 | April 2022
Scalable Online Planning for Multi-Agent MDPs
Shushman Choudhury, Jayesh K. Gupta, Peter Morales, Mykel J. Kochenderfer
Journal of Artificial Intelligence Research | March 2022, Vol 73
-
Representation Learning for Event-based Visuomotor Policies
Sai Vemprala, Sami Mian, Ashish Kapoor
NeurIPS 2021 | December 2021
Unadversarial Examples: Designing Objects for Robust Vision
Hadi Salman*, Andrew Ilyas*, Logan Engstrom*, Sai Vemprala, Aleksander Madry, Ashish Kapoor
NeurIPS 2021 | December 2021
CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning
Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor
June 2021
Preprint under review
Training Structured Mechanical Models by Minimizing Discrete Euler-Lagrange Residual
Kunal Menda, Jayesh K. Gupta, Zachary Manchester, Mykel J. Kochenderfer
MSR-TR-2021-35 | May 2021
Published by Microsoft
-
Multi-Robot Collision Avoidance under Uncertainty with Probabilistic Safety Barrier Certificates
Wenhao Luo, Ashish Kapoor
NeurIPS 2020 | December 2020
Adversarial Attacks on Optimization based Planners
Sai Vemprala, Ashish Kapoor
October 2020
Denoised Smoothing: A Provable Defense for Pretrained Classifiers
Hadi Salman, Mingjie Sun, Greg Yang, Ashish Kapoor, J. Zico Kolter
NeurIPS 2020 | September 2020
Do Adversarially Robust ImageNet Models Transfer Better?
Hadi Salman, Andrew Ilyas, Logan Engstrom, Ashish Kapoor, Aleksander Madry
July 2020
AirSim Drone Racing Lab
Ratnesh Madaan, Nicholas Gyde, Sai Vemprala, Matthew Brown, Keiko Nagami, Tim Taubner, Eric Cristofalo, Davide Scaramuzza, Mac Schwager, Ashish Kapoor
July 2020
Safety Considerations in Deep Control Policies with Safety Barrier Certificates Under Uncertainty
Tom Hirshberg, Sai Vemprala, Ashish Kapoor
June 2020
TartanAir: A Dataset to Push the Limits of Visual SLAM
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, Sebastian Scherer
March 2020
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
-
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shital Shah, Ashish Kapoor, Debadeepta Dey, Chris Lovett
Field and Service Robotics | November 2017, pp. 621-635
Publications by Research Area
-
ClimaX: A foundation model for weather and climate
Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover
ICML 2023 | July 2023
ChatGPT for Robotics: Design Principles and Model Abilities
Sai Vemprala, Rogerio Bonatti, Arthur Bucker, Ashish Kapoor
MSR-TR-2023-8 | February 2023
Published by Microsoft
Learning Modular Simulations for Homogeneous Systems
Jayesh K. Gupta, Sai Vemprala, Ashish Kapoor
2022 Neural Information Processing Systems | November 2022
Learning to Simulate Realistic LiDARs
Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems
Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
Towards Multi-spatiotemporal-scale Generalized PDE Modeling
Jayesh K. Gupta, Johannes Brandstetter
MSR-TR-2022-27 | September 2022
Published by Microsoft
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma, Felipe Vieira Frujeri, Shuhang Chen, Ashish Kapoor
IROS 2023 | September 2022
MoBT 17.1 / MoBIP 17.1
Clifford Neural Layers for PDE Modeling
Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta
September 2022
Missingness Bias in Model Debugging
Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
ICLR 2022 | April 2022
Scalable Online Planning for Multi-Agent MDPs
Shushman Choudhury, Jayesh K. Gupta, Peter Morales, Mykel J. Kochenderfer
Journal of Artificial Intelligence Research | March 2022, Vol 73
Representation Learning for Event-based Visuomotor Policies
Sai Vemprala, Sami Mian, Ashish Kapoor
NeurIPS 2021 | December 2021
CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning
Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor
June 2021
Preprint under review
Training Structured Mechanical Models by Minimizing Discrete Euler-Lagrange Residual
Kunal Menda, Jayesh K. Gupta, Zachary Manchester, Mykel J. Kochenderfer
MSR-TR-2021-35 | May 2021
Published by Microsoft
Multi-Robot Collision Avoidance under Uncertainty with Probabilistic Safety Barrier Certificates
Wenhao Luo, Ashish Kapoor
NeurIPS 2020 | December 2020
Adversarial Attacks on Optimization based Planners
Sai Vemprala, Ashish Kapoor
October 2020
Denoised Smoothing: A Provable Defense for Pretrained Classifiers
Hadi Salman, Mingjie Sun, Greg Yang, Ashish Kapoor, J. Zico Kolter
NeurIPS 2020 | September 2020
Do Adversarially Robust ImageNet Models Transfer Better?
Hadi Salman, Andrew Ilyas, Logan Engstrom, Ashish Kapoor, Aleksander Madry
July 2020
AirSim Drone Racing Lab
Ratnesh Madaan, Nicholas Gyde, Sai Vemprala, Matthew Brown, Keiko Nagami, Tim Taubner, Eric Cristofalo, Davide Scaramuzza, Mac Schwager, Ashish Kapoor
July 2020
Safety Considerations in Deep Control Policies with Safety Barrier Certificates Under Uncertainty
Tom Hirshberg, Sai Vemprala, Ashish Kapoor
June 2020
TartanAir: A Dataset to Push the Limits of Visual SLAM
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, Sebastian Scherer
March 2020
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shital Shah, Ashish Kapoor, Debadeepta Dey, Chris Lovett
Field and Service Robotics | November 2017, pp. 621-635
-
ChatGPT for Robotics: Design Principles and Model Abilities
Sai Vemprala, Rogerio Bonatti, Arthur Bucker, Ashish Kapoor
MSR-TR-2023-8 | February 2023
Published by Microsoft
-
Learning to Simulate Realistic LiDARs
Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems
Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma, Felipe Vieira Frujeri, Shuhang Chen, Ashish Kapoor
IROS 2023 | September 2022
MoBT 17.1 / MoBIP 17.1
Clifford Neural Layers for PDE Modeling
Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta
September 2022
Representation Learning for Event-based Visuomotor Policies
Sai Vemprala, Sami Mian, Ashish Kapoor
NeurIPS 2021 | December 2021
Unadversarial Examples: Designing Objects for Robust Vision
Hadi Salman*, Andrew Ilyas*, Logan Engstrom*, Sai Vemprala, Aleksander Madry, Ashish Kapoor
NeurIPS 2021 | December 2021
CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning
Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor
June 2021
Preprint under review
Do Adversarially Robust ImageNet Models Transfer Better?
Hadi Salman, Andrew Ilyas, Logan Engstrom, Ashish Kapoor, Aleksander Madry
July 2020
TartanAir: A Dataset to Push the Limits of Visual SLAM
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, Sebastian Scherer
March 2020
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
-
COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems
Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
Safety Considerations in Deep Control Policies with Safety Barrier Certificates Under Uncertainty
Tom Hirshberg, Sai Vemprala, Ashish Kapoor
June 2020
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
-
Multi-Robot Collision Avoidance under Uncertainty with Probabilistic Safety Barrier Certificates
Wenhao Luo, Ashish Kapoor
NeurIPS 2020 | December 2020
-
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
Publications by Type
-
ChatGPT for Robotics: Design Principles and Model Abilities
Sai Vemprala, Rogerio Bonatti, Arthur Bucker, Ashish Kapoor
MSR-TR-2023-8 | February 2023
Published by Microsoft
Towards Multi-spatiotemporal-scale Generalized PDE Modeling
Jayesh K. Gupta, Johannes Brandstetter
MSR-TR-2022-27 | September 2022
Published by Microsoft
Training Structured Mechanical Models by Minimizing Discrete Euler-Lagrange Residual
Kunal Menda, Jayesh K. Gupta, Zachary Manchester, Mykel J. Kochenderfer
MSR-TR-2021-35 | May 2021
Published by Microsoft
-
ClimaX: A foundation model for weather and climate
Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover
ICML 2023 | July 2023
Learning Modular Simulations for Homogeneous Systems
Jayesh K. Gupta, Sai Vemprala, Ashish Kapoor
2022 Neural Information Processing Systems | November 2022
Learning to Simulate Realistic LiDARs
Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems
Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor
International Conference on Intelligent Robots and Systems | October 2022
PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pre-Training
Rogerio Bonatti, Sai Vemprala, Shuang Ma, Felipe Vieira Frujeri, Shuhang Chen, Ashish Kapoor
IROS 2023 | September 2022
MoBT 17.1 / MoBIP 17.1
Missingness Bias in Model Debugging
Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
ICLR 2022 | April 2022
Representation Learning for Event-based Visuomotor Policies
Sai Vemprala, Sami Mian, Ashish Kapoor
NeurIPS 2021 | December 2021
Unadversarial Examples: Designing Objects for Robust Vision
Hadi Salman*, Andrew Ilyas*, Logan Engstrom*, Sai Vemprala, Aleksander Madry, Ashish Kapoor
NeurIPS 2021 | December 2021
Multi-Robot Collision Avoidance under Uncertainty with Probabilistic Safety Barrier Certificates
Wenhao Luo, Ashish Kapoor
NeurIPS 2020 | December 2020
Denoised Smoothing: A Provable Defense for Pretrained Classifiers
Hadi Salman, Mingjie Sun, Greg Yang, Ashish Kapoor, J. Zico Kolter
NeurIPS 2020 | September 2020
Learning Visuomotor Policies for Aerial Navigation Using Cross-Modal Representations
Rogerio Bonatti, Ratnesh Madaan, Vibhav Vineet, Sebastian Scherer, Ashish Kapoor
In submission | March 2020
-
Clifford Neural Layers for PDE Modeling
Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta
September 2022
CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning
Daniel McDuff, Yale Song, Jiyoung Lee, Vibhav Vineet, Sai Vemprala, Nicholas Gyde, Hadi Salman, Shuang Ma, Kwanghoon Sohn, Ashish Kapoor
June 2021
Preprint under review
Adversarial Attacks on Optimization based Planners
Sai Vemprala, Ashish Kapoor
October 2020
AirSim Drone Racing Lab
Ratnesh Madaan, Nicholas Gyde, Sai Vemprala, Matthew Brown, Keiko Nagami, Tim Taubner, Eric Cristofalo, Davide Scaramuzza, Mac Schwager, Ashish Kapoor
July 2020
Safety Considerations in Deep Control Policies with Safety Barrier Certificates Under Uncertainty
Tom Hirshberg, Sai Vemprala, Ashish Kapoor
June 2020
-
Scalable Online Planning for Multi-Agent MDPs
Shushman Choudhury, Jayesh K. Gupta, Peter Morales, Mykel J. Kochenderfer
Journal of Artificial Intelligence Research | March 2022, Vol 73
AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles
Shital Shah, Ashish Kapoor, Debadeepta Dey, Chris Lovett
Field and Service Robotics | November 2017, pp. 621-635
-
Do Adversarially Robust ImageNet Models Transfer Better?
Hadi Salman, Andrew Ilyas, Logan Engstrom, Ashish Kapoor, Aleksander Madry
July 2020
TartanAir: A Dataset to Push the Limits of Visual SLAM
Wenshan Wang, Delong Zhu, Xiangwei Wang, Yaoyu Hu, Yuheng Qiu, Chen Wang, Yafei Hu, Ashish Kapoor, Sebastian Scherer
March 2020