AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud
Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan
MLSys '25 | May 2025
Jonathan Mace
Senior Researcher
Publications
-
-
-
Automated Service Design with Cerulean (Project Showcase)
Vaastav Anand, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
2025 IEEE/ACM International Workshop on Cloud Intelligence & AIOps (AIOps) | May 2025, pp. 1-3
-
Intent-based System Design and Operation
Vaastav Anand, Yichen Li, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
Proceedings of the 4th Workshop on Practical Adoption Challenges of ML for Systems | February 2025
-
-
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan
2024 Symposium on Cloud Computing | November 2024
-
If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems
Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath
ACM SOSP 2024 | November 2024
-
-
-
Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications
João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues
2023 Symposium on Operating Systems Principles | October 2023
-
Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications
Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace
2023 Symposium on Operating Systems Principles | October 2023
-
Groundhog: Efficient Request Isolation in FaaS
Mohamed Alzayat, Jonathan Mace, Peter Druschel, Deepak Garg
2023 European Conference on Computer Systems | May 2023
-
The Benefit of Hindsight: Tracing Edge-Cases in Distributed Systems
Lei Zhang, Zhiqiang Xie, Vaastav Anand, Ymir Vigfusson, Jonathan Mace
2023 Symposium on Networked Systems Design and Implementation | April 2023
-
A Qualitative Interview Study of Distributed Tracing Visualisation: A Characterisation of Challenges and Opportunities
Thomas Davidson, Emily Wall, Jonathan Mace
IEEE Transactions on Visualization and Computer Graphics | February 2023
-
-
-
See it to Believe it? The Role of Visualisation in Systems Research
Thomas Davidson, Jonathan Mace
2022 Symposium on Cloud Computing | November 2022
-
The Odd One Out: Energy is not like Other Metrics
Vaastav Anand, Zhiqiang Xie, Matheus Stolet, Roberta De Viti, Thomas Davidson, Reyhaneh Karimipour, Safya Alzayat, Jonathan Mace
HotCarbon 2022: 1st Workshop on Sustainable Computer Systems Design and Implementation | July 2022
-
-
-
Serving DNNs like Clockwork: Performance Predictability from the Bottom Up
Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, Jonathan Mace
2020 Operating Systems Design and Implementation | October 2020
Distinguished Artifact Award
-
Distributed Tracing in Practice
Austin Parker, Daniel Spoonhower, Jonathan Mace, Rebecca Isaacs
Published by O'Reilly Media | May 2020
ISBN: 978-1492056638
-
-
-
Sifter: Scalable Sampling for Distributed Traces, without Feature Engineering
Pedro Las-Casas, Giorgi Papakerashvili, Vaastav Anand, Jonathan Mace
2019 Symposium on Cloud Computing | November 2019
-
-
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
ACM Transactions on Computer Systems | December 2018, Vol 35(4): pp. 1-28
-
Weighted Sampling of Execution Traces: Capturing More Needles and Less Hay
Pedro Las-Casas, Jonathan Mace, Dorgival Guedes, Rodrigo Fonseca
2018 Symposium on Cloud Computing | October 2018
-
A Universal Architecture for Cross-Cutting Tools in Distributed Systems
May 2018
Thèse de doctorat : Brown University | May 2018
Dennis M. Ritchie Doctoral Dissertation Award, Honorable Mention
-
Universal Context Propagation for Distributed System Instrumentation
Jonathan Mace, Rodrigo Fonseca
2018 European Conference on Computer Systems | April 2018
-
-
-
Canopy: An End-to-End Performance Tracing And Analysis System
Jonathan Kaldor, Jonathan Mace, Michał Bejda, Edison Gao, Wiktor Kuropatwa, Joe O'Neill, Kian Win Ong, Bill Schaller, Pingjia Shan, Brendan Viscomi, Vinod Venkataraman, Kaushik Veeraraghavan, Yee Jiun Song
2017 Symposium on Operating Systems Principles | October 2017
-
-
-
Principled Workflow-Centric Tracing of Distributed Systems
Raja R. Sambasivan, Ilari Shafer, Jonathan Mace, Benjamin H. Sigelman, Rodrigo Fonseca, Gregory R. Ganger
2016 Symposium on Cloud Computing | October 2016
-
-
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
2015 Symposium on Operating Systems Principles | October 2015
Best Paper Award
-
-
-
Towards General-Purpose Resource Management in Shared Cloud Services
Jonathan Mace, Peter Bodík, Rodrigo Fonseca, Madan Musuvathi
2014 Hot Topics in System Dependability | October 2014
-
-
-
AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud
Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan
MLSys '25 | May 2025
-
Automated Service Design with Cerulean (Project Showcase)
Vaastav Anand, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
2025 IEEE/ACM International Workshop on Cloud Intelligence & AIOps (AIOps) | May 2025, pp. 1-3
-
Intent-based System Design and Operation
Vaastav Anand, Yichen Li, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
Proceedings of the 4th Workshop on Practical Adoption Challenges of ML for Systems | February 2025
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan
2024 Symposium on Cloud Computing | November 2024
-
-
-
Automated Service Design with Cerulean (Project Showcase)
Vaastav Anand, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
2025 IEEE/ACM International Workshop on Cloud Intelligence & AIOps (AIOps) | May 2025, pp. 1-3
-
Intent-based System Design and Operation
Vaastav Anand, Yichen Li, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
Proceedings of the 4th Workshop on Practical Adoption Challenges of ML for Systems | February 2025
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan
2024 Symposium on Cloud Computing | November 2024
-
-
-
AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud
Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan
MLSys '25 | May 2025
-
Automated Service Design with Cerulean (Project Showcase)
Vaastav Anand, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
2025 IEEE/ACM International Workshop on Cloud Intelligence & AIOps (AIOps) | May 2025, pp. 1-3
-
Intent-based System Design and Operation
Vaastav Anand, Yichen Li, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
Proceedings of the 4th Workshop on Practical Adoption Challenges of ML for Systems | February 2025
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan
2024 Symposium on Cloud Computing | November 2024
-
If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems
Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath
ACM SOSP 2024 | November 2024
-
Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications
Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace
2023 Symposium on Operating Systems Principles | October 2023
-
Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications
João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues
2023 Symposium on Operating Systems Principles | October 2023
-
Groundhog: Efficient Request Isolation in FaaS
Mohamed Alzayat, Jonathan Mace, Peter Druschel, Deepak Garg
2023 European Conference on Computer Systems | May 2023
-
The Benefit of Hindsight: Tracing Edge-Cases in Distributed Systems
Lei Zhang, Zhiqiang Xie, Vaastav Anand, Ymir Vigfusson, Jonathan Mace
2023 Symposium on Networked Systems Design and Implementation | April 2023
-
A Qualitative Interview Study of Distributed Tracing Visualisation: A Characterisation of Challenges and Opportunities
Thomas Davidson, Emily Wall, Jonathan Mace
IEEE Transactions on Visualization and Computer Graphics | February 2023
-
See it to Believe it? The Role of Visualisation in Systems Research
Thomas Davidson, Jonathan Mace
2022 Symposium on Cloud Computing | November 2022
-
The Odd One Out: Energy is not like Other Metrics
Vaastav Anand, Zhiqiang Xie, Matheus Stolet, Roberta De Viti, Thomas Davidson, Reyhaneh Karimipour, Safya Alzayat, Jonathan Mace
HotCarbon 2022: 1st Workshop on Sustainable Computer Systems Design and Implementation | July 2022
-
Serving DNNs like Clockwork: Performance Predictability from the Bottom Up
Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, Jonathan Mace
2020 Operating Systems Design and Implementation | October 2020
Distinguished Artifact Award
-
Distributed Tracing in Practice
Austin Parker, Daniel Spoonhower, Jonathan Mace, Rebecca Isaacs
Published by O'Reilly Media | May 2020
ISBN: 978-1492056638
-
Sifter: Scalable Sampling for Distributed Traces, without Feature Engineering
Pedro Las-Casas, Giorgi Papakerashvili, Vaastav Anand, Jonathan Mace
2019 Symposium on Cloud Computing | November 2019
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
ACM Transactions on Computer Systems | December 2018, Vol 35(4): pp. 1-28
-
Weighted Sampling of Execution Traces: Capturing More Needles and Less Hay
Pedro Las-Casas, Jonathan Mace, Dorgival Guedes, Rodrigo Fonseca
2018 Symposium on Cloud Computing | October 2018
-
A Universal Architecture for Cross-Cutting Tools in Distributed Systems
May 2018
Thèse de doctorat : Brown University | May 2018
Dennis M. Ritchie Doctoral Dissertation Award, Honorable Mention
-
Universal Context Propagation for Distributed System Instrumentation
Jonathan Mace, Rodrigo Fonseca
2018 European Conference on Computer Systems | April 2018
-
Canopy: An End-to-End Performance Tracing And Analysis System
Jonathan Kaldor, Jonathan Mace, Michał Bejda, Edison Gao, Wiktor Kuropatwa, Joe O'Neill, Kian Win Ong, Bill Schaller, Pingjia Shan, Brendan Viscomi, Vinod Venkataraman, Kaushik Veeraraghavan, Yee Jiun Song
2017 Symposium on Operating Systems Principles | October 2017
-
Principled Workflow-Centric Tracing of Distributed Systems
Raja R. Sambasivan, Ilari Shafer, Jonathan Mace, Benjamin H. Sigelman, Rodrigo Fonseca, Gregory R. Ganger
2016 Symposium on Cloud Computing | October 2016
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
2015 Symposium on Operating Systems Principles | October 2015
Best Paper Award
-
Towards General-Purpose Resource Management in Shared Cloud Services
Jonathan Mace, Peter Bodík, Rodrigo Fonseca, Madan Musuvathi
2014 Hot Topics in System Dependability | October 2014
-
-
-
AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud
Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan
MLSys '25 | May 2025
-
-
-
A Qualitative Interview Study of Distributed Tracing Visualisation: A Characterisation of Challenges and Opportunities
Thomas Davidson, Emily Wall, Jonathan Mace
IEEE Transactions on Visualization and Computer Graphics | February 2023
-
-
-
Automated Service Design with Cerulean (Project Showcase)
Vaastav Anand, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
2025 IEEE/ACM International Workshop on Cloud Intelligence & AIOps (AIOps) | May 2025, pp. 1-3
-
Intent-based System Design and Operation
Vaastav Anand, Yichen Li, Alok Kumbhare, Celine Irvene, Chetan Bansal, Gagan Somashekar, Jonathan Mace, Pedro Las-Casas, Ricardo Bianchini, Rodrigo Fonseca
Proceedings of the 4th Workshop on Practical Adoption Challenges of ML for Systems | February 2025
-
A Qualitative Interview Study of Distributed Tracing Visualisation: A Characterisation of Challenges and Opportunities
Thomas Davidson, Emily Wall, Jonathan Mace
IEEE Transactions on Visualization and Computer Graphics | February 2023
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
ACM Transactions on Computer Systems | December 2018, Vol 35(4): pp. 1-28
-
-
-
AIOpsLab: A Holistic Framework for Evaluating AI Agents for Enabling Autonomous Cloud
Yinfang Chen, Manish Shetty, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Jonathan Mace, Chetan Bansal, Rujia Wang, Saravan Rajmohan
MLSys '25 | May 2025
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Manisha M Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh L. Simmhan, Xuchao Zhang, Jonathan Mace, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan
2024 Symposium on Cloud Computing | November 2024
-
If At First You Don’t Succeed, Try, Try, Again…? Insights and LLM-informed Tooling for Detecting Retry Bugs in Software Systems
Bogdan Alexandru Stoica, Utsav Sethi , Yiming Su , Cyrus Zhou, Shan Lu, Jonathan Mace, Madan Musuvathi, Suman Nath
ACM SOSP 2024 | November 2024
-
Blueprint: A Toolchain for Highly-Reconfigurable Microservice Applications
Vaastav Anand, Deepak Garg, Antoine Kaufmann, Jonathan Mace
2023 Symposium on Operating Systems Principles | October 2023
-
Antipode: Enforcing Cross-Service Causal Consistency in Distributed Applications
João Ferreira Loff, Daniel Porto, João Garcia, Jonathan Mace, Rodrigo Rodrigues
2023 Symposium on Operating Systems Principles | October 2023
-
Groundhog: Efficient Request Isolation in FaaS
Mohamed Alzayat, Jonathan Mace, Peter Druschel, Deepak Garg
2023 European Conference on Computer Systems | May 2023
-
The Benefit of Hindsight: Tracing Edge-Cases in Distributed Systems
Lei Zhang, Zhiqiang Xie, Vaastav Anand, Ymir Vigfusson, Jonathan Mace
2023 Symposium on Networked Systems Design and Implementation | April 2023
-
See it to Believe it? The Role of Visualisation in Systems Research
Thomas Davidson, Jonathan Mace
2022 Symposium on Cloud Computing | November 2022
-
The Odd One Out: Energy is not like Other Metrics
Vaastav Anand, Zhiqiang Xie, Matheus Stolet, Roberta De Viti, Thomas Davidson, Reyhaneh Karimipour, Safya Alzayat, Jonathan Mace
HotCarbon 2022: 1st Workshop on Sustainable Computer Systems Design and Implementation | July 2022
-
Serving DNNs like Clockwork: Performance Predictability from the Bottom Up
Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, Jonathan Mace
2020 Operating Systems Design and Implementation | October 2020
Distinguished Artifact Award
-
Sifter: Scalable Sampling for Distributed Traces, without Feature Engineering
Pedro Las-Casas, Giorgi Papakerashvili, Vaastav Anand, Jonathan Mace
2019 Symposium on Cloud Computing | November 2019
-
Weighted Sampling of Execution Traces: Capturing More Needles and Less Hay
Pedro Las-Casas, Jonathan Mace, Dorgival Guedes, Rodrigo Fonseca
2018 Symposium on Cloud Computing | October 2018
-
Universal Context Propagation for Distributed System Instrumentation
Jonathan Mace, Rodrigo Fonseca
2018 European Conference on Computer Systems | April 2018
-
Canopy: An End-to-End Performance Tracing And Analysis System
Jonathan Kaldor, Jonathan Mace, Michał Bejda, Edison Gao, Wiktor Kuropatwa, Joe O'Neill, Kian Win Ong, Bill Schaller, Pingjia Shan, Brendan Viscomi, Vinod Venkataraman, Kaushik Veeraraghavan, Yee Jiun Song
2017 Symposium on Operating Systems Principles | October 2017
-
Principled Workflow-Centric Tracing of Distributed Systems
Raja R. Sambasivan, Ilari Shafer, Jonathan Mace, Benjamin H. Sigelman, Rodrigo Fonseca, Gregory R. Ganger
2016 Symposium on Cloud Computing | October 2016
-
Pivot Tracing: Dynamic Causal Monitoring for Distributed Systems
Jonathan Mace, Ryan Roelke, Rodrigo Fonseca
2015 Symposium on Operating Systems Principles | October 2015
Best Paper Award
-
Towards General-Purpose Resource Management in Shared Cloud Services
Jonathan Mace, Peter Bodík, Rodrigo Fonseca, Madan Musuvathi
2014 Hot Topics in System Dependability | October 2014
-
-
-
Distributed Tracing in Practice
Austin Parker, Daniel Spoonhower, Jonathan Mace, Rebecca Isaacs
Published by O'Reilly Media | May 2020
ISBN: 978-1492056638
-
-
-
A Universal Architecture for Cross-Cutting Tools in Distributed Systems
May 2018
Thèse de doctorat : Brown University | May 2018
Dennis M. Ritchie Doctoral Dissertation Award, Honorable Mention
-