Sébastien Bubeck

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

Positional Description Matters for Transformers Arithmetic

Ruoqi Shen, Sébastien Bubeck, Ronen Eldan, Yin Tat Lee, Yuanzhi Li, Yi Zhang

November 2023

DOI Project

Learning threshold neurons via the “edge of stability”

Kwangjun Ahn, Sébastien Bubeck, Sinho Chewi, Yin Tat Lee, Felipe Suarez, Yi Zhang

NeurIPS 2023 | October 2023

Publication Video

The AI Revolution in Medicine GPT-4 and Beyond

Peter Lee, Carey Goldberg, Isaac S. Kohane, Sébastien Bubeck

October 2023

Publication Project

Textbooks Are All You Need II: phi-1.5 technical report

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee

September 2023

Publication Download Project

Textbooks Are All You Need

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio Cesar, Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li

June 2023

DOI Download Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco Tulio Ribeiro, Yi Zhang

March 2023

Publication Project

LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models

Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey

NeurIPS 2022 | December 2022

Publication Project

How to Fine-Tune Vision Models with SGD

Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICLR 2024 | November 2022

DOI Publication

Data Augmentation as Feature Manipulation

Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICML 2022 | July 2022

Publication

Unveiling Transformers with LEGO: a synthetic reasoning task

Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner

June 2022

Preprint Video Project Project

A single gradient step finds adversarial examples on random two-layers neural networks

Sébastien Bubeck, Yeshwanth Cherapanamjeri, Gauthier Gidel, Remi Tachet des Combes

NeurIPS 2021 | December 2021

Publication

A Universal Law of Robustness via Isoperimetry

Sébastien Bubeck, Mark Sellke

NeurIPS 2021 | December 2021

Outstanding Paper Award

Publication Video Project

Adversarial Examples in Multi-Layer Random ReLU Networks

Peter Bartlett, Sébastien Bubeck, Yeshwanth Cherapanamjeri

NeurIPS 2021 | December 2021

Publication

Cooperative and Stochastic Multi-Player Multi-Armed Bandit: Optimal Regret With Neither Communication Nor Collisions

Sébastien Bubeck, Thomas Budzinski, Mark Sellke

COLT 2021 | November 2020

Publication

A law of robustness for two-layers neural networks.

Sébastien Bubeck, Yuanzhi Li, Dheeraj Nagaraj

Computing Research Repository (CoRR) | September 2020

Publication

Online Learning for Active Cache Synchronization

Andrey Kolobov, Sébastien Bubeck, Julian Zimmert

ICML 2020 | July 2020

Publication Project

Entanglement Is Necessary for Optimal Quantum Property Testing

Sébastien Bubeck, Sitan Chen, Jerry Li

FOCS 2020 | April 2020

Publication

Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization

Hadrien Hendrikx, Lin Xiao (lixiao), Sébastien Bubeck (sebubeck), Francis Bach, Laurent Massoulie

MSR-TR-2020-5 | February 2020

Published by Microsoft Research

Publication Video Project

Coordination Without Communication: Optimal Regret in Two Players Multi-armed Bandits

Sébastien Bubeck, Thomas Budzinski

COLT 2020 | February 2020

PDF

How to Trap a Gradient Flow

Sébastien Bubeck, Dan Mikulincer

COLT 2020 | February 2020

PDF

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers

Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019

Publication PDF

Non-Stochastic Multi-Player Multi-Armed Bandits: Optimal Rate With Collision Information, Sublinear Without

Sébastien Bubeck, Yuanzhi Li, Yuval Peres, Mark Sellke

COLT 2020 | May 2019

PDF

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NIPS 2018 | December 2018

Publication

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NeurIPS 2018 | June 2018

Best Paper Award

Publication Preprint Project

Online Auctions and Multi-scale Online Learning

Sébastien Bubeck, Nikhil Devanur, Zhiyi Huang, Rad Niazadeh

18th ACM conference on Economics and Computation (EC'17) | May 2017

Publication Publication Project

Local Max-Cut In Smoothed Polynomial Time

Omer Angel, Sébastien Bubeck, Yuval Peres, Fan Wei

April 2017

Publication Publication Project

Basic models and questions in statistical network analysis

Miklos Z. Racz, Sébastien Bubeck

September 2016

Publication Publication

Kernel-Based Methods For Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan, Yin Tat Lee

July 2016

Publication Project

On Paths, Stars and Wyes In Trees

Sébastien Bubeck, Katherine Edwards, Horia Mania, Cathryn Supko

arXiv:1601.01950 [math.CO] | January 2016

Publication

Testing for high-dimensional geometry in random graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklos Z. Racz

Random Structures & Algorithms | January 2016, Vol 49: pp. 503-532

Publication Publication

Multi-Scale Exploration of Convex Functions and Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan

arXiv:1507.06580v1 [math.MG] | July 2015

Best Paper Award

Publication Project

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

Sébastien Bubeck, Ronen Eldan, Joseph Lehec

July 2015

Publication Publication Project

A Geometric Alternative To Nesterov’s Accelerated Gradient Descent

Sébastien Bubeck, Yin Tat Lee, Mohit Singh

June 2015

Publication Project

The Entropic Barrier: A Simple and Optimal Universal Self-Concordant Barrier

Sébastien Bubeck, Ronen Eldan

April 2015

Publication Publication Project

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

Sébastien Bubeck, Ofer Dekel, Tomer Koren, Yuval Peres

February 2015

Publication Publication Project

Convex Optimization: Algorithms and Complexity

Sébastien Bubeck

Foundations and Trends in Machine Learning | January 2015, Vol 8(4): pp. 231-357

Publication Publication Project

Testing For High-Dimensional Geometry In Random Graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklós Z. Rácz

November 2014

Publication

Finding Adam In Random Growing Trees

Sébastien Bubeck, Luc Devroye, Gábor Lugosi

Random Structures and Algorithms | November 2014

Publication

From trees to seeds: on the inference of the seed from large trees in the uniform attachment model

Sébastien Bubeck, Ronen Eldan, Elchanan Mossel, Miklos Z. Racz

September 2014

Publication Publication

Most Correlated Arms Identification

Che-Yu Liu, Sébastien Bubeck

COLT | April 2014

Publication

Regret in Online Combinatorial Optimization

Jean-Yves Audiber, Sébastien Bubeck, Gábor Lugosi

Mathematics of Operations Research | March 2014, Vol 39(1): pp. 31-45

Publication Publication

lil’ UCB : An Optimal Exploration Algorithm for Multi-Armed Bandits

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

COLT | January 2014

Publication

Prior-Free And Prior-Dependent Regret Bounds For Thompson Sampling

Sébastien Bubeck

NIPS'13 Proceedings of the 26th International Conference on Neural Information Processing Systems | December 2013

Publication Publication

Bandits With Heavy Tail

Sébastien Bubeck, Nicolò Cesa-Bianchi, Gábor Lugosi

IEEE Transactions On Information Theory | November 2013

Publication Publication

Bounded Regret In Stochastic Multi-Armed Bandits

Sébastien Bubeck, Vianney Perchet, Philippe Rigollet

JMLR: Workshop and Conference Proceedings | August 2013

Publication

On Finding the Largest Mean Among Many

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

arXiv:1306.3917v1 | June 2013

Publication

Detecting Positive Correlations in a Multivariate Sample

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

March 2013

Publication

Optimal Discovery with Probabilistic Expert Advice: Finite Time Analysis and Macroscopic Optimality

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

Journal of Machine Learning Research | February 2013, Vol 14: pp. 601-623

Publication

Multiple Identifications in Multi-Armed Bandits

Sébastien Bubeck, Tengyao Wang, Nitin Viswanathan

Proceedings of the 30 th International Conference on Machine Learning, Atlanta, Georgia, USA, | January 2013

Publication

How The Initialization Affects The Stability Of The K-Means Algorithm

Sébastien Bubeck, Marina Meilă, Ulrike Von Luxburg

ESAIM: Probability and Statistics | May 2012

Publication Publication

The Best of Both Worlds: Stochastic and Adversarial Bandits

Sébastien Bubeck, Aleksandrs Slivkins

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Towards Minimax Policies for Online Linear Optimization with Bandit Feedback

Sébastien Bubeck, Nicolò Cesa-Bianchi, Sham M. Kakade

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Detection of Correlations

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

January 2012

Publication Publication

Optimal Discovery With Probabilistic Expert Advice

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

51st IEEE Conference on Decision and Control (CDC) | January 2012

Publication Publication

Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems

Sébastien Bubeck, Nicolò Cesa-Bianchi

Foundations and Trends® in Machine Learning | January 2012

Publication Publication Publication Publication

Introduction to Online Optimization

Sébastien Bubeck

December 2011

Publication

Minimax Policies for Combinatorial Prediction Games

Jean-Yves Audibert, Sébastien Bubeck, Gábor Lugosi

24th Annual Conference on Learning Theory, 2011 | May 2011

Publication

X-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Journal of Machine Learning Research (JMLR) | May 2011, Vol 12: pp. 1655-1695

Publication

Multi-Bandit Best Arm Identification

Victor Gabillon, Mohammad Ghavamzadeh, Alessandro Lazaric, Sébastien Bubeck

NIPS | January 2011

Publication Publication

Pure Exploration in Finitely-Armed and Continuous-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Theoretical Computer Science | January 2011

Publication

Open Loop Optimistic Planning

Sébastien Bubeck, Rémi Munos

COLT 2010 - The 23rd Conference on Learning Theory, Haifa, Israel | June 2010

Publication

Bandits Games and Clustering Foundations

Sébastien Bubeck

June 2010

June 2010

Jacques Neveu prize 2010, runner-up for the french AI prize 2011, runner-up for the Gilles Kahn prize 2010

Publication

Regret Bounds and Minimax Policies Under Partial Monitoring

Jean-Yves Audibert, Sébastien Bubeck

Journal of Machine Learning Research | March 2010, Vol 11: pp. 2785-2836

Publication

Bandit View on Noisy Optimization

Jean-Yves Audibert, Sébastien Bubeck, Rémi Munos

Optimization for Machine Learning, 1 | Published by MIT Press | 2010 | Optimization for Machine Learning edition

Publication

Best Arm Identification in Multi-Armed Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 23rd Annual Conference on Learning Theory (COLT) | January 2010

Publication

Nearest Neighbor Clustering: A Baseline Method for Consistent Clustering with Arbitrary Objective Functions

Sébastien Bubeck, Ulrike von Luxburg

Journal of Machine Learning Research | March 2009, Vol 10: pp. 657-698

Publication

Minimax Policies for Adversarial and Stochastic Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 22nd Annual Conference on Learning Theory (COLT) | January 2009

Best Student Paper Award

Publication

Online Optimization in ê­•-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz, Csaba Szepesvári

Advances in Neural Information Processing Systems (NIPS) | January 2009

Publication Publication

Pure Exploration in Multi-Armed Bandits Problems

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Proceedings of the 20th International Conference on Algorithmic Learning Theory (ALT) | January 2009

Publication

Consistent Minimization of Clustering Objective Functions

Ulrike von Luxburg, Sébastien Bubeck, Stefanie Jegelka, Michael Kaufmann

Advances in Neural Information Processing Systems (NIPS) | January 2008

Publication Publication

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

Positional Description Matters for Transformers Arithmetic

Ruoqi Shen, Sébastien Bubeck, Ronen Eldan, Yin Tat Lee, Yuanzhi Li, Yi Zhang

November 2023

DOI Project

Learning threshold neurons via the “edge of stability”

Kwangjun Ahn, Sébastien Bubeck, Sinho Chewi, Yin Tat Lee, Felipe Suarez, Yi Zhang

NeurIPS 2023 | October 2023

Publication Video

The AI Revolution in Medicine GPT-4 and Beyond

Peter Lee, Carey Goldberg, Isaac S. Kohane, Sébastien Bubeck

October 2023

Publication Project

Textbooks Are All You Need II: phi-1.5 technical report

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee

September 2023

Publication Download Project

Textbooks Are All You Need

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio Cesar, Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li

June 2023

DOI Download Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco Tulio Ribeiro, Yi Zhang

March 2023

Publication Project

LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models

Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey

NeurIPS 2022 | December 2022

Publication Project

How to Fine-Tune Vision Models with SGD

Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICLR 2024 | November 2022

DOI Publication

Data Augmentation as Feature Manipulation

Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICML 2022 | July 2022

Publication

Unveiling Transformers with LEGO: a synthetic reasoning task

Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner

June 2022

Preprint Video Project Project

A single gradient step finds adversarial examples on random two-layers neural networks

Sébastien Bubeck, Yeshwanth Cherapanamjeri, Gauthier Gidel, Remi Tachet des Combes

NeurIPS 2021 | December 2021

Publication

Adversarial Examples in Multi-Layer Random ReLU Networks

Peter Bartlett, Sébastien Bubeck, Yeshwanth Cherapanamjeri

NeurIPS 2021 | December 2021

Publication

A Universal Law of Robustness via Isoperimetry

Sébastien Bubeck, Mark Sellke

NeurIPS 2021 | December 2021

Outstanding Paper Award

Publication Video Project

Cooperative and Stochastic Multi-Player Multi-Armed Bandit: Optimal Regret With Neither Communication Nor Collisions

Sébastien Bubeck, Thomas Budzinski, Mark Sellke

COLT 2021 | November 2020

Publication

Online Learning for Active Cache Synchronization

Andrey Kolobov, Sébastien Bubeck, Julian Zimmert

ICML 2020 | July 2020

Publication Project

Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization

Hadrien Hendrikx, Lin Xiao (lixiao), Sébastien Bubeck (sebubeck), Francis Bach, Laurent Massoulie

MSR-TR-2020-5 | February 2020

Published by Microsoft Research

Publication Video Project

Coordination Without Communication: Optimal Regret in Two Players Multi-armed Bandits

Sébastien Bubeck, Thomas Budzinski

COLT 2020 | February 2020

PDF

How to Trap a Gradient Flow

Sébastien Bubeck, Dan Mikulincer

COLT 2020 | February 2020

PDF

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers

Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019

Publication PDF

Non-Stochastic Multi-Player Multi-Armed Bandits: Optimal Rate With Collision Information, Sublinear Without

Sébastien Bubeck, Yuanzhi Li, Yuval Peres, Mark Sellke

COLT 2020 | May 2019

PDF

The AI Revolution in Medicine GPT-4 and Beyond

Peter Lee, Carey Goldberg, Isaac S. Kohane, Sébastien Bubeck

October 2023

Publication Project

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models

Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey

NeurIPS 2022 | December 2022

Publication Project

Unveiling Transformers with LEGO: a synthetic reasoning task

Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner

June 2022

Preprint Video Project Project

Entanglement Is Necessary for Optimal Quantum Property Testing

Sébastien Bubeck, Sitan Chen, Jerry Li

FOCS 2020 | April 2020

Publication

Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization

Hadrien Hendrikx, Lin Xiao (lixiao), Sébastien Bubeck (sebubeck), Francis Bach, Laurent Massoulie

MSR-TR-2020-5 | February 2020

Published by Microsoft Research

Publication Video Project

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NIPS 2018 | December 2018

Publication

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NeurIPS 2018 | June 2018

Best Paper Award

Publication Preprint Project

Online Auctions and Multi-scale Online Learning

Sébastien Bubeck, Nikhil Devanur, Zhiyi Huang, Rad Niazadeh

18th ACM conference on Economics and Computation (EC'17) | May 2017

Publication Publication Project

Local Max-Cut In Smoothed Polynomial Time

Omer Angel, Sébastien Bubeck, Yuval Peres, Fan Wei

April 2017

Publication Publication Project

Kernel-Based Methods For Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan, Yin Tat Lee

July 2016

Publication Project

On Paths, Stars and Wyes In Trees

Sébastien Bubeck, Katherine Edwards, Horia Mania, Cathryn Supko

arXiv:1601.01950 [math.CO] | January 2016

Publication

Multi-Scale Exploration of Convex Functions and Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan

arXiv:1507.06580v1 [math.MG] | July 2015

Best Paper Award

Publication Project

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

Sébastien Bubeck, Ronen Eldan, Joseph Lehec

July 2015

Publication Publication Project

A Geometric Alternative To Nesterov’s Accelerated Gradient Descent

Sébastien Bubeck, Yin Tat Lee, Mohit Singh

June 2015

Publication Project

Convex Optimization: Algorithms and Complexity

Sébastien Bubeck

Foundations and Trends in Machine Learning | January 2015, Vol 8(4): pp. 231-357

Publication Publication Project

Testing For High-Dimensional Geometry In Random Graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklós Z. Rácz

November 2014

Publication

Finding Adam In Random Growing Trees

Sébastien Bubeck, Luc Devroye, Gábor Lugosi

Random Structures and Algorithms | November 2014

Publication

Most Correlated Arms Identification

Che-Yu Liu, Sébastien Bubeck

COLT | April 2014

Publication

Regret in Online Combinatorial Optimization

Jean-Yves Audiber, Sébastien Bubeck, Gábor Lugosi

Mathematics of Operations Research | March 2014, Vol 39(1): pp. 31-45

Publication Publication

lil’ UCB : An Optimal Exploration Algorithm for Multi-Armed Bandits

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

COLT | January 2014

Publication

Prior-Free And Prior-Dependent Regret Bounds For Thompson Sampling

Sébastien Bubeck

NIPS'13 Proceedings of the 26th International Conference on Neural Information Processing Systems | December 2013

Publication Publication

Bandits With Heavy Tail

Sébastien Bubeck, Nicolò Cesa-Bianchi, Gábor Lugosi

IEEE Transactions On Information Theory | November 2013

Publication Publication

Bounded Regret In Stochastic Multi-Armed Bandits

Sébastien Bubeck, Vianney Perchet, Philippe Rigollet

JMLR: Workshop and Conference Proceedings | August 2013

Publication

On Finding the Largest Mean Among Many

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

arXiv:1306.3917v1 | June 2013

Publication

Detecting Positive Correlations in a Multivariate Sample

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

March 2013

Publication

Optimal Discovery with Probabilistic Expert Advice: Finite Time Analysis and Macroscopic Optimality

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

Journal of Machine Learning Research | February 2013, Vol 14: pp. 601-623

Publication

Multiple Identifications in Multi-Armed Bandits

Sébastien Bubeck, Tengyao Wang, Nitin Viswanathan

Proceedings of the 30 th International Conference on Machine Learning, Atlanta, Georgia, USA, | January 2013

Publication

The Best of Both Worlds: Stochastic and Adversarial Bandits

Sébastien Bubeck, Aleksandrs Slivkins

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Towards Minimax Policies for Online Linear Optimization with Bandit Feedback

Sébastien Bubeck, Nicolò Cesa-Bianchi, Sham M. Kakade

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Detection of Correlations

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

January 2012

Publication Publication

Optimal Discovery With Probabilistic Expert Advice

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

51st IEEE Conference on Decision and Control (CDC) | January 2012

Publication Publication

Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems

Sébastien Bubeck, Nicolò Cesa-Bianchi

Foundations and Trends® in Machine Learning | January 2012

Publication Publication Publication Publication

Introduction to Online Optimization

Sébastien Bubeck

December 2011

Publication

Minimax Policies for Combinatorial Prediction Games

Jean-Yves Audibert, Sébastien Bubeck, Gábor Lugosi

24th Annual Conference on Learning Theory, 2011 | May 2011

Publication

X-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Journal of Machine Learning Research (JMLR) | May 2011, Vol 12: pp. 1655-1695

Publication

Pure Exploration in Finitely-Armed and Continuous-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Theoretical Computer Science | January 2011

Publication

Multi-Bandit Best Arm Identification

Victor Gabillon, Mohammad Ghavamzadeh, Alessandro Lazaric, Sébastien Bubeck

NIPS | January 2011

Publication Publication

Open Loop Optimistic Planning

Sébastien Bubeck, Rémi Munos

COLT 2010 - The 23rd Conference on Learning Theory, Haifa, Israel | June 2010

Publication

Regret Bounds and Minimax Policies Under Partial Monitoring

Jean-Yves Audibert, Sébastien Bubeck

Journal of Machine Learning Research | March 2010, Vol 11: pp. 2785-2836

Publication

Bandit View on Noisy Optimization

Jean-Yves Audibert, Sébastien Bubeck, Rémi Munos

Optimization for Machine Learning, 1 | Published by MIT Press | 2010 | Optimization for Machine Learning edition

Publication

Best Arm Identification in Multi-Armed Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 23rd Annual Conference on Learning Theory (COLT) | January 2010

Publication

Nearest Neighbor Clustering: A Baseline Method for Consistent Clustering with Arbitrary Objective Functions

Sébastien Bubeck, Ulrike von Luxburg

Journal of Machine Learning Research | March 2009, Vol 10: pp. 657-698

Publication

Online Optimization in ê­•-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz, Csaba Szepesvári

Advances in Neural Information Processing Systems (NIPS) | January 2009

Publication Publication

Minimax Policies for Adversarial and Stochastic Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 22nd Annual Conference on Learning Theory (COLT) | January 2009

Best Student Paper Award

Publication

Pure Exploration in Multi-Armed Bandits Problems

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Proceedings of the 20th International Conference on Algorithmic Learning Theory (ALT) | January 2009

Publication

Consistent Minimization of Clustering Objective Functions

Ulrike von Luxburg, Sébastien Bubeck, Stefanie Jegelka, Michael Kaufmann

Advances in Neural Information Processing Systems (NIPS) | January 2008

Publication Publication

A single gradient step finds adversarial examples on random two-layers neural networks

Sébastien Bubeck, Yeshwanth Cherapanamjeri, Gauthier Gidel, Remi Tachet des Combes

NeurIPS 2021 | December 2021

Publication

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers

Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019

Publication PDF

A law of robustness for two-layers neural networks.

Sébastien Bubeck, Yuanzhi Li, Dheeraj Nagaraj

Computing Research Repository (CoRR) | September 2020

Publication

Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization

Hadrien Hendrikx, Lin Xiao (lixiao), Sébastien Bubeck (sebubeck), Francis Bach, Laurent Massoulie

MSR-TR-2020-5 | February 2020

Published by Microsoft Research

Publication Video Project

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NIPS 2018 | December 2018

Publication

Local Max-Cut In Smoothed Polynomial Time

Omer Angel, Sébastien Bubeck, Yuval Peres, Fan Wei

April 2017

Publication Publication Project

Basic models and questions in statistical network analysis

Miklos Z. Racz, Sébastien Bubeck

September 2016

Publication Publication

Testing for high-dimensional geometry in random graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklos Z. Racz

Random Structures & Algorithms | January 2016, Vol 49: pp. 503-532

Publication Publication

The Entropic Barrier: A Simple and Optimal Universal Self-Concordant Barrier

Sébastien Bubeck, Ronen Eldan

April 2015

Publication Publication Project

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

Sébastien Bubeck, Ofer Dekel, Tomer Koren, Yuval Peres

February 2015

Publication Publication Project

From trees to seeds: on the inference of the seed from large trees in the uniform attachment model

Sébastien Bubeck, Ronen Eldan, Elchanan Mossel, Miklos Z. Racz

September 2014

Publication Publication

How The Initialization Affects The Stability Of The K-Means Algorithm

Sébastien Bubeck, Marina Meilă, Ulrike Von Luxburg

ESAIM: Probability and Statistics | May 2012

Publication Publication

Bandits Games and Clustering Foundations

Sébastien Bubeck

June 2010

June 2010

Jacques Neveu prize 2010, runner-up for the french AI prize 2011, runner-up for the Gilles Kahn prize 2010

Publication

Online Learning for Active Cache Synchronization

Andrey Kolobov, Sébastien Bubeck, Julian Zimmert

ICML 2020 | July 2020

Publication Project

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahmoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Xihui (Eric) Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Olatunji Ruwase, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yunan Zhang, Xiren Zhou

MSR-TR-2024-12 | April 2024

Published by Microsoft

Publication Download Project

Statistically Preconditioned Accelerated Gradient Method for Distributed Optimization

Hadrien Hendrikx, Lin Xiao (lixiao), Sébastien Bubeck (sebubeck), Francis Bach, Laurent Massoulie

MSR-TR-2020-5 | February 2020

Published by Microsoft Research

Publication Video Project

Learning threshold neurons via the “edge of stability”

Kwangjun Ahn, Sébastien Bubeck, Sinho Chewi, Yin Tat Lee, Felipe Suarez, Yi Zhang

NeurIPS 2023 | October 2023

Publication Video

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers

Ganesh Jawahar, Subhabrata (Subho) Mukherjee, Xiaodong Liu, Young Jin Kim, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Ahmed Awadallah, Sébastien Bubeck, Jianfeng Gao

ACL | May 2023

Publication Project

LiteTransformerSearch: Training-free On-device Search for Efficient Autoregressive Language Models

Mojan Javaheripi, Shital Shah, Subhabrata (Subho) Mukherjee, Tomasz L. Religa, Caio C. T. Mendes, Gustavo H. de Rosa, Sébastien Bubeck, Farinaz Koushanfar, Debadeepta Dey

NeurIPS 2022 | December 2022

Publication Project

How to Fine-Tune Vision Models with SGD

Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICLR 2024 | November 2022

DOI Publication

Data Augmentation as Feature Manipulation

Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

ICML 2022 | July 2022

Publication

A single gradient step finds adversarial examples on random two-layers neural networks

Sébastien Bubeck, Yeshwanth Cherapanamjeri, Gauthier Gidel, Remi Tachet des Combes

NeurIPS 2021 | December 2021

Publication

Adversarial Examples in Multi-Layer Random ReLU Networks

Peter Bartlett, Sébastien Bubeck, Yeshwanth Cherapanamjeri

NeurIPS 2021 | December 2021

Publication

A Universal Law of Robustness via Isoperimetry

Sébastien Bubeck, Mark Sellke

NeurIPS 2021 | December 2021

Outstanding Paper Award

Publication Video Project

Cooperative and Stochastic Multi-Player Multi-Armed Bandit: Optimal Regret With Neither Communication Nor Collisions

Sébastien Bubeck, Thomas Budzinski, Mark Sellke

COLT 2021 | November 2020

Publication

Online Learning for Active Cache Synchronization

Andrey Kolobov, Sébastien Bubeck, Julian Zimmert

ICML 2020 | July 2020

Publication Project

Entanglement Is Necessary for Optimal Quantum Property Testing

Sébastien Bubeck, Sitan Chen, Jerry Li

FOCS 2020 | April 2020

Publication

Coordination Without Communication: Optimal Regret in Two Players Multi-armed Bandits

Sébastien Bubeck, Thomas Budzinski

COLT 2020 | February 2020

PDF

How to Trap a Gradient Flow

Sébastien Bubeck, Dan Mikulincer

COLT 2020 | February 2020

PDF

Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers

Hadi Salman, Greg Yang, Jerry Li, Pengchuan Zhang, Huan Zhang, Ilya Razenshteyn, Sébastien Bubeck

33rd Conference on Neural Information Processing Systems (NeurIPS 2019) | September 2019

Publication PDF

Non-Stochastic Multi-Player Multi-Armed Bandits: Optimal Rate With Collision Information, Sublinear Without

Sébastien Bubeck, Yuanzhi Li, Yuval Peres, Mark Sellke

COLT 2020 | May 2019

PDF

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NIPS 2018 | December 2018

Publication

Optimal Algorithms for Non-Smooth Distributed Optimization in Networks

Kevin Scaman, Francis Bach, Sébastien Bubeck, Yin Tat Lee, Laurent Massoulié

NeurIPS 2018 | June 2018

Best Paper Award

Publication Preprint Project

Online Auctions and Multi-scale Online Learning

Sébastien Bubeck, Nikhil Devanur, Zhiyi Huang, Rad Niazadeh

18th ACM conference on Economics and Computation (EC'17) | May 2017

Publication Publication Project

Kernel-Based Methods For Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan, Yin Tat Lee

July 2016

Publication Project

On Paths, Stars and Wyes In Trees

Sébastien Bubeck, Katherine Edwards, Horia Mania, Cathryn Supko

arXiv:1601.01950 [math.CO] | January 2016

Publication

Multi-Scale Exploration of Convex Functions and Bandit Convex Optimization

Sébastien Bubeck, Ronen Eldan

arXiv:1507.06580v1 [math.MG] | July 2015

Best Paper Award

Publication Project

A Geometric Alternative To Nesterov’s Accelerated Gradient Descent

Sébastien Bubeck, Yin Tat Lee, Mohit Singh

June 2015

Publication Project

Testing For High-Dimensional Geometry In Random Graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklós Z. Rácz

November 2014

Publication

Most Correlated Arms Identification

Che-Yu Liu, Sébastien Bubeck

COLT | April 2014

Publication

lil’ UCB : An Optimal Exploration Algorithm for Multi-Armed Bandits

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

COLT | January 2014

Publication

Prior-Free And Prior-Dependent Regret Bounds For Thompson Sampling

Sébastien Bubeck

NIPS'13 Proceedings of the 26th International Conference on Neural Information Processing Systems | December 2013

Publication Publication

Bandits With Heavy Tail

Sébastien Bubeck, Nicolò Cesa-Bianchi, Gábor Lugosi

IEEE Transactions On Information Theory | November 2013

Publication Publication

Bounded Regret In Stochastic Multi-Armed Bandits

Sébastien Bubeck, Vianney Perchet, Philippe Rigollet

JMLR: Workshop and Conference Proceedings | August 2013

Publication

On Finding the Largest Mean Among Many

Kevin Jamieson, Matthew Malloy, Robert Nowak, Sébastien Bubeck

arXiv:1306.3917v1 | June 2013

Publication

Detecting Positive Correlations in a Multivariate Sample

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

March 2013

Publication

Multiple Identifications in Multi-Armed Bandits

Sébastien Bubeck, Tengyao Wang, Nitin Viswanathan

Proceedings of the 30 th International Conference on Machine Learning, Atlanta, Georgia, USA, | January 2013

Publication

How The Initialization Affects The Stability Of The K-Means Algorithm

Sébastien Bubeck, Marina Meilă, Ulrike Von Luxburg

ESAIM: Probability and Statistics | May 2012

Publication Publication

The Best of Both Worlds: Stochastic and Adversarial Bandits

Sébastien Bubeck, Aleksandrs Slivkins

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Towards Minimax Policies for Online Linear Optimization with Bandit Feedback

Sébastien Bubeck, Nicolò Cesa-Bianchi, Sham M. Kakade

JMLR: Workshop and Conference Proceedings | February 2012

Publication

Detection of Correlations

Ery Arias-Castro, Sébastien Bubeck, Gábor Lugosi

January 2012

Publication Publication

Optimal Discovery With Probabilistic Expert Advice

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

51st IEEE Conference on Decision and Control (CDC) | January 2012

Publication Publication

Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems

Sébastien Bubeck, Nicolò Cesa-Bianchi

Foundations and Trends® in Machine Learning | January 2012

Publication Publication Publication Publication

Minimax Policies for Combinatorial Prediction Games

Jean-Yves Audibert, Sébastien Bubeck, Gábor Lugosi

24th Annual Conference on Learning Theory, 2011 | May 2011

Publication

Pure Exploration in Finitely-Armed and Continuous-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Theoretical Computer Science | January 2011

Publication

Multi-Bandit Best Arm Identification

Victor Gabillon, Mohammad Ghavamzadeh, Alessandro Lazaric, Sébastien Bubeck

NIPS | January 2011

Publication Publication

Open Loop Optimistic Planning

Sébastien Bubeck, Rémi Munos

COLT 2010 - The 23rd Conference on Learning Theory, Haifa, Israel | June 2010

Publication

Best Arm Identification in Multi-Armed Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 23rd Annual Conference on Learning Theory (COLT) | January 2010

Publication

Online Optimization in ê­•-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz, Csaba Szepesvári

Advances in Neural Information Processing Systems (NIPS) | January 2009

Publication Publication

Minimax Policies for Adversarial and Stochastic Bandits

Jean-Yves Audibert, Sébastien Bubeck

Proceedings of the 22nd Annual Conference on Learning Theory (COLT) | January 2009

Best Student Paper Award

Publication

Pure Exploration in Multi-Armed Bandits Problems

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Proceedings of the 20th International Conference on Algorithmic Learning Theory (ALT) | January 2009

Publication

Consistent Minimization of Clustering Objective Functions

Ulrike von Luxburg, Sébastien Bubeck, Stefanie Jegelka, Michael Kaufmann

Advances in Neural Information Processing Systems (NIPS) | January 2008

Publication Publication

Positional Description Matters for Transformers Arithmetic

Ruoqi Shen, Sébastien Bubeck, Ronen Eldan, Yin Tat Lee, Yuanzhi Li, Yi Zhang

November 2023

DOI Project

Textbooks Are All You Need

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio Cesar, Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li

June 2023

DOI Download Project

Introduction to Online Optimization

Sébastien Bubeck

December 2011

Publication

The AI Revolution in Medicine GPT-4 and Beyond

Peter Lee, Carey Goldberg, Isaac S. Kohane, Sébastien Bubeck

October 2023

Publication Project

Textbooks Are All You Need II: phi-1.5 technical report

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee

September 2023

Publication Download Project

Sparks of Artificial General Intelligence: Early experiments with GPT-4

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco Tulio Ribeiro, Yi Zhang

March 2023

Publication Project

Unveiling Transformers with LEGO: a synthetic reasoning task

Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner

June 2022

Preprint Video Project Project

A law of robustness for two-layers neural networks.

Sébastien Bubeck, Yuanzhi Li, Dheeraj Nagaraj

Computing Research Repository (CoRR) | September 2020

Publication

Local Max-Cut In Smoothed Polynomial Time

Omer Angel, Sébastien Bubeck, Yuval Peres, Fan Wei

April 2017

Publication Publication Project

Basic models and questions in statistical network analysis

Miklos Z. Racz, Sébastien Bubeck

September 2016

Publication Publication

Testing for high-dimensional geometry in random graphs

Sébastien Bubeck, Jian Ding, Ronen Eldan, Miklos Z. Racz

Random Structures & Algorithms | January 2016, Vol 49: pp. 503-532

Publication Publication

Sampling from a log-concave distribution with Projected Langevin Monte Carlo

Sébastien Bubeck, Ronen Eldan, Joseph Lehec

July 2015

Publication Publication Project

The Entropic Barrier: A Simple and Optimal Universal Self-Concordant Barrier

Sébastien Bubeck, Ronen Eldan

April 2015

Publication Publication Project

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

Sébastien Bubeck, Ofer Dekel, Tomer Koren, Yuval Peres

February 2015

Publication Publication Project

Convex Optimization: Algorithms and Complexity

Sébastien Bubeck

Foundations and Trends in Machine Learning | January 2015, Vol 8(4): pp. 231-357

Publication Publication Project

Finding Adam In Random Growing Trees

Sébastien Bubeck, Luc Devroye, Gábor Lugosi

Random Structures and Algorithms | November 2014

Publication

From trees to seeds: on the inference of the seed from large trees in the uniform attachment model

Sébastien Bubeck, Ronen Eldan, Elchanan Mossel, Miklos Z. Racz

September 2014

Publication Publication

Regret in Online Combinatorial Optimization

Jean-Yves Audiber, Sébastien Bubeck, Gábor Lugosi

Mathematics of Operations Research | March 2014, Vol 39(1): pp. 31-45

Publication Publication

Optimal Discovery with Probabilistic Expert Advice: Finite Time Analysis and Macroscopic Optimality

Sébastien Bubeck, Damien Ernst, Aurélien Garivier

Journal of Machine Learning Research | February 2013, Vol 14: pp. 601-623

Publication

X-Armed Bandits

Sébastien Bubeck, Rémi Munos, Gilles Stoltz

Journal of Machine Learning Research (JMLR) | May 2011, Vol 12: pp. 1655-1695

Publication

Regret Bounds and Minimax Policies Under Partial Monitoring

Jean-Yves Audibert, Sébastien Bubeck

Journal of Machine Learning Research | March 2010, Vol 11: pp. 2785-2836

Publication

Nearest Neighbor Clustering: A Baseline Method for Consistent Clustering with Arbitrary Objective Functions

Sébastien Bubeck, Ulrike von Luxburg

Journal of Machine Learning Research | March 2009, Vol 10: pp. 657-698

Publication

Bandits Games and Clustering Foundations

Sébastien Bubeck

June 2010

June 2010

Jacques Neveu prize 2010, runner-up for the french AI prize 2011, runner-up for the Gilles Kahn prize 2010

Publication

Bandit View on Noisy Optimization

Jean-Yves Audibert, Sébastien Bubeck, Rémi Munos

Optimization for Machine Learning, 1 | Published by MIT Press | 2010 | Optimization for Machine Learning edition

Publication