KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
October 2023
Jerry Li
Principal Researcher
Publications
Publications by Year
-
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
-
Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation
Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
STOC 2022 | June 2022
Clustering Mixtures with Almost Optimal Separation in Polynomial Time
Jerry Li, Allen Liu
STOC 2022 | June 2022
Learning (Very) Simple Generative Models Is Hard
Sitan Chen, Jerry Li, Yuanzhi Li
2022 Neural Information Processing Systems | May 2022
Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
ICLR 2022 | April 2022
-
List-Decodable Mean Estimation in Nearly-PCA Time
Ilias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
Robust Regression Revisited: Acceleration and Improved Estimation Rates
Arun Jambulapati, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
The Price of Tolerance in Distribution Testing
Clément L. Canonne, Ayush Jain, Gautam Kamath, Jerry Li
COLT 2022 | June 2021
Toward Instance-Optimal State Certification With Incoherent Measurements
Sitan Chen, Jerry Li, Ryan O'Donnell
COLT 2022 | February 2021
-
Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
Matthew Brennan, Guy Bresler, Samuel B. Hopkins, Jerry Li, Tselil Schramm
COLT 2021 | September 2020
Best Paper Runner Up
Security and Machine Learning in the Real World
Ivan Evtimov, Weidong Cui, Ece Kamar, Emre Kiciman, Tadayoshi Kohno, Jerry Li
July 2020
Efficiently Learning Structured Distributions from Untrusted Batches
Sitan Chen, Jerry Li, Ankur Moitra
STOC 2020 | June 2020
Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments
Sitan Chen, Jerry Li, Zhao Song
STOC 2020 | June 2020
Positive Semidefinite Programming: Mixed, Parallel, and Width-Independent
Arun Jambulapati, Yin Tat Lee, Jerry Li, Swati Padmanabhan, Kevin Tian
STOC 2020 | June 2020
Entanglement Is Necessary for Optimal Quantum Property Testing
Sébastien Bubeck, Sitan Chen, Jerry Li
FOCS 2020 | April 2020
Randomized Smoothing of All Shapes and Sizes
Greg Yang, Tony Duan, Edward Hu, Hadi Salman, Ilya Razenshteyn, Jerry Li
Arxiv | February 2020
2002.08118
-
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
Publications by Research Area
-
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
October 2023
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation
Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
STOC 2022 | June 2022
Clustering Mixtures with Almost Optimal Separation in Polynomial Time
Jerry Li, Allen Liu
STOC 2022 | June 2022
Learning (Very) Simple Generative Models Is Hard
Sitan Chen, Jerry Li, Yuanzhi Li
2022 Neural Information Processing Systems | May 2022
Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
ICLR 2022 | April 2022
List-Decodable Mean Estimation in Nearly-PCA Time
Ilias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
Robust Regression Revisited: Acceleration and Improved Estimation Rates
Arun Jambulapati, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
The Price of Tolerance in Distribution Testing
Clément L. Canonne, Ayush Jain, Gautam Kamath, Jerry Li
COLT 2022 | June 2021
Toward Instance-Optimal State Certification With Incoherent Measurements
Sitan Chen, Jerry Li, Ryan O'Donnell
COLT 2022 | February 2021
Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
Matthew Brennan, Guy Bresler, Samuel B. Hopkins, Jerry Li, Tselil Schramm
COLT 2021 | September 2020
Best Paper Runner Up
Security and Machine Learning in the Real World
Ivan Evtimov, Weidong Cui, Ece Kamar, Emre Kiciman, Tadayoshi Kohno, Jerry Li
July 2020
Efficiently Learning Structured Distributions from Untrusted Batches
Sitan Chen, Jerry Li, Ankur Moitra
STOC 2020 | June 2020
Randomized Smoothing of All Shapes and Sizes
Greg Yang, Tony Duan, Edward Hu, Hadi Salman, Ilya Razenshteyn, Jerry Li
Arxiv | February 2020
2002.08118
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
-
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
October 2023
-
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation
Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
STOC 2022 | June 2022
Clustering Mixtures with Almost Optimal Separation in Polynomial Time
Jerry Li, Allen Liu
STOC 2022 | June 2022
List-Decodable Mean Estimation in Nearly-PCA Time
Ilias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
Robust Regression Revisited: Acceleration and Improved Estimation Rates
Arun Jambulapati, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
Matthew Brennan, Guy Bresler, Samuel B. Hopkins, Jerry Li, Tselil Schramm
COLT 2021 | September 2020
Best Paper Runner Up
Efficiently Learning Structured Distributions from Untrusted Batches
Sitan Chen, Jerry Li, Ankur Moitra
STOC 2020 | June 2020
Positive Semidefinite Programming: Mixed, Parallel, and Width-Independent
Arun Jambulapati, Yin Tat Lee, Jerry Li, Swati Padmanabhan, Kevin Tian
STOC 2020 | June 2020
Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments
Sitan Chen, Jerry Li, Zhao Song
STOC 2020 | June 2020
Entanglement Is Necessary for Optimal Quantum Property Testing
Sébastien Bubeck, Sitan Chen, Jerry Li
FOCS 2020 | April 2020
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
-
Toward Instance-Optimal State Certification With Incoherent Measurements
Sitan Chen, Jerry Li, Ryan O'Donnell
COLT 2022 | February 2021
-
Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
ICLR 2022 | April 2022
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019
-
Security and Machine Learning in the Real World
Ivan Evtimov, Weidong Cui, Ece Kamar, Emre Kiciman, Tadayoshi Kohno, Jerry Li
July 2020
-
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
-
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
Publications by Type
-
KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval
Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yuksekgonul, Rahee Peshawaria, Ranjita Naik, Besmira Nushi
October 2023
Security and Machine Learning in the Real World
Ivan Evtimov, Weidong Cui, Ece Kamar, Emre Kiciman, Tadayoshi Kohno, Jerry Li
July 2020
-
Automatic Prompt Optimization with “Gradient Descent” and Beam Search
Reid Pryzant, Dan Iter, Jerry Li, Yin Tat Lee, Chenguang Zhu, Michael Zeng
May 2023
Clustering Mixture Models in Almost-Linear Time via List-Decodable Mean Estimation
Ilias Diakonikolas, Daniel M. Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
STOC 2022 | June 2022
Clustering Mixtures with Almost Optimal Separation in Polynomial Time
Jerry Li, Allen Liu
STOC 2022 | June 2022
Learning (Very) Simple Generative Models Is Hard
Sitan Chen, Jerry Li, Yuanzhi Li
2022 Neural Information Processing Systems | May 2022
Minimax Optimality (Probably) Doesn’t Imply Distribution Learning for GANs
Sitan Chen, Jerry Li, Yuanzhi Li, Raghu Meka
ICLR 2022 | April 2022
List-Decodable Mean Estimation in Nearly-PCA Time
Ilias Diakonikolas, Daniel Kane, Daniel Kongsgaard, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
Robust Regression Revisited: Acceleration and Improved Estimation Rates
Arun Jambulapati, Jerry Li, Kevin Tian
NeurIPS 2021 | December 2021
The Price of Tolerance in Distribution Testing
Clément L. Canonne, Ayush Jain, Gautam Kamath, Jerry Li
COLT 2022 | June 2021
Toward Instance-Optimal State Certification With Incoherent Measurements
Sitan Chen, Jerry Li, Ryan O'Donnell
COLT 2022 | February 2021
Statistical Query Algorithms and Low-Degree Tests Are Almost Equivalent
Matthew Brennan, Guy Bresler, Samuel B. Hopkins, Jerry Li, Tselil Schramm
COLT 2021 | September 2020
Best Paper Runner Up
Efficiently Learning Structured Distributions from Untrusted Batches
Sitan Chen, Jerry Li, Ankur Moitra
STOC 2020 | June 2020
Positive Semidefinite Programming: Mixed, Parallel, and Width-Independent
Arun Jambulapati, Yin Tat Lee, Jerry Li, Swati Padmanabhan, Kevin Tian
STOC 2020 | June 2020
Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments
Sitan Chen, Jerry Li, Zhao Song
STOC 2020 | June 2020
Entanglement Is Necessary for Optimal Quantum Property Testing
Sébastien Bubeck, Sitan Chen, Jerry Li
FOCS 2020 | April 2020
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck
33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019
Quantum Entropy Scoring for Fast Robust Mean Estimation and Improved Outlier Detection
Yihe Dong, Samuel B. Hopkins, Jerry Li
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019) | June 2019
Spotlight Presentation. Code available: https://github.com/twistedcubic/que-outlier-detection.
-
Randomized Smoothing of All Shapes and Sizes
Greg Yang, Tony Duan, Edward Hu, Hadi Salman, Ilya Razenshteyn, Jerry Li
Arxiv | February 2020
2002.08118