Ankur Mallick

Senior Researcher

Publications

论文与出版物

查看方式：

- Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
  
  Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
  
  ACM Sigmetrics 2026 | June 2026
  
  Publication 项目
- PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services
  
  Rohan Gandhi, Ankur Mallick
  
  ACM SoCC | November 2025
  
  Publication
- BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute
  
  Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
  
  ArXiv | June 2025, 第 abs/2506.22716 卷
  
  DOI Publication Publication
- Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search
  
  Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
  
  ICML TTODLer-FM Workshop 2025 | June 2025
  
  DOI Publication Publication 项目
- EcoAct: Economic Agent Determines When to Register What Action
  
  Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
  
  ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
  
  Publication 项目项目
- Exploring How LLMs Capture and Represent Domain-Specific Knowledge
  
  Mirian Hipolito Garcia, Camille Couturier, Daniel Madrigal, Ankur Mallick, Anastasios Kyrillidis,, Robert Sim, Victor Ruehle, Saravan Rajmohan
  
  April 2025
  
  Publication 项目
- Performance Aware LLM Load Balancer for Mixed Workloads
  
  Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
  
  EuroMLSys 2025 | April 2025
  
  Publication 项目
- On Efficient Distillation from LLMs to SLMs
  
  Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
  
  NeurIPS FITML workshop 2024 | December 2024
  
  Publication 项目
- Ensuring Fair LLM Serving Amid Diverse Applications
  
  Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
  
  ArXiv | November 2024
  
  Publication 项目
- Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
  
  A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
  
  ArXiv | August 2024, 第 abs/2408.13510 卷
  
  Preprint
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication 项目
- Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems
  
  Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi
  
  MLSys | January 2022
  
  Publication

- Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
  
  Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
  
  ACM Sigmetrics 2026 | June 2026
  
  Publication 项目
- PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services
  
  Rohan Gandhi, Ankur Mallick
  
  ACM SoCC | November 2025
  
  Publication
- Ensuring Fair LLM Serving Amid Diverse Applications
  
  Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
  
  ArXiv | November 2024
  
  Publication 项目
- Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
  
  A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
  
  ArXiv | August 2024, 第 abs/2408.13510 卷
  
  Preprint
- Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems
  
  Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi
  
  MLSys | January 2022
  
  Publication
- Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
  
  Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
  
  ACM Sigmetrics 2026 | June 2026
  
  Publication 项目
- BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute
  
  Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
  
  ArXiv | June 2025, 第 abs/2506.22716 卷
  
  DOI Publication Publication
- Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search
  
  Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
  
  ICML TTODLer-FM Workshop 2025 | June 2025
  
  DOI Publication Publication 项目
- EcoAct: Economic Agent Determines When to Register What Action
  
  Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
  
  ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
  
  Publication 项目项目
- Exploring How LLMs Capture and Represent Domain-Specific Knowledge
  
  Mirian Hipolito Garcia, Camille Couturier, Daniel Madrigal, Ankur Mallick, Anastasios Kyrillidis,, Robert Sim, Victor Ruehle, Saravan Rajmohan
  
  April 2025
  
  Publication 项目
- Performance Aware LLM Load Balancer for Mixed Workloads
  
  Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
  
  EuroMLSys 2025 | April 2025
  
  Publication 项目
- On Efficient Distillation from LLMs to SLMs
  
  Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
  
  NeurIPS FITML workshop 2024 | December 2024
  
  Publication 项目
- Ensuring Fair LLM Serving Amid Diverse Applications
  
  Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
  
  ArXiv | November 2024
  
  Publication 项目
- Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
  
  A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
  
  ArXiv | August 2024, 第 abs/2408.13510 卷
  
  Preprint
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication 项目

- Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale
  
  Kunal Jain, A. Parayil, Ankur Mallick, Rujia Wang, Renee St. Amant, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Shashwat Jaiswal, Yogesh Simmhan, Anoop Kulkarni, Steve Kofsky
  
  ACM Sigmetrics 2026 | June 2026
  
  Publication 项目
- PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services
  
  Rohan Gandhi, Ankur Mallick
  
  ACM SoCC | November 2025
  
  Publication
- Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search
  
  Dongge Han, Menglin Xia, Daniel Madrigal, Samuel Kessler, Ankur Mallick, Xuchao Zhang, Mirian Hipolito Garcia, Jin Xu, Victor Ruehle, Saravan Rajmohan
  
  ICML TTODLer-FM Workshop 2025 | June 2025
  
  DOI Publication Publication 项目
- EcoAct: Economic Agent Determines When to Register What Action
  
  Shaokun Zhang, Jieyu Zhang, Dujian Ding, Mirian Hipolito Garcia, Ankur Mallick, Daniel Madrigal, Menglin Xia, Victor Ruehle, Qingyun Wu, Chi Wang
  
  ICLR Workshop on Reasoning and Planning for Large Language Models | April 2025
  
  Publication 项目项目
- Performance Aware LLM Load Balancer for Mixed Workloads
  
  Kunal Jain, A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Anoop Kulkarni, Steve Kofsky, Saravan Rajmohan
  
  EuroMLSys 2025 | April 2025
  
  Publication 项目
- On Efficient Distillation from LLMs to SLMs
  
  Metod Jazbec, Menglin Xia, Ankur Mallick, Daniel Madrigal, Dongge Han, Samuel Kessler, Victor Ruehle
  
  NeurIPS FITML workshop 2024 | December 2024
  
  Publication 项目
- Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing
  
  Dujian Ding, Ankur Mallick, Chi Wang, Robert Sim, Subhabrata Mukherjee, Victor Ruehle, Laks V. S. Lakshmanan, Ahmed Awadallah
  
  ICLR 2024 | February 2024
  
  Publication 项目
- Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems
  
  Ankur Mallick, Kevin Hsieh, Behnaz Arzani, Gauri Joshi
  
  MLSys | January 2022
  
  Publication
- BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute
  
  Dujian Ding, Ankur Mallick, Shaokun Zhang, Chi Wang, Daniel Madrigal, Mirian Hipolito Garcia, Menglin Xia, L. Lakshmanan, Qingyun Wu, Victor Ruehle
  
  ArXiv | June 2025, 第 abs/2506.22716 卷
  
  DOI Publication Publication
- Ensuring Fair LLM Serving Amid Diverse Applications
  
  Kunal Jain, Ankur Mallick, A. Parayil, Renee St. Amant, Rujia Wang, Victor Ruehle, Chetan Bansal, Saravan Rajmohan, Redwan Ibne Seraj Khan, Haiying Shen, Anoop Kulkarni, Steve Kofsky, Pankhuri Choudhary, Yue Cheng
  
  ArXiv | November 2024
  
  Publication 项目
- Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling
  
  A. Parayil, Ankur Mallick, Esha Choukse, Xiaoting Qin, Jue Zhang, Íñigo Goiri, Rujia Wang, Chetan Bansal, Victor Ruehle, Saravan Rajmohan, Kunal Jain, Anoop Kulkarni, Steve Kofsky
  
  ArXiv | August 2024, 第 abs/2408.13510 卷
  
  Preprint
- Exploring How LLMs Capture and Represent Domain-Specific Knowledge
  
  Mirian Hipolito Garcia, Camille Couturier, Daniel Madrigal, Ankur Mallick, Anastasios Kyrillidis,, Robert Sim, Victor Ruehle, Saravan Rajmohan
  
  April 2025
  
  Publication 项目

Ankur Mallick

论文与出版物

Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale

PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services

BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute

Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search

EcoAct: Economic Agent Determines When to Register What Action

Exploring How LLMs Capture and Represent Domain-Specific Knowledge

Performance Aware LLM Load Balancer for Mixed Workloads

On Efficient Distillation from LLMs to SLMs

Ensuring Fair LLM Serving Amid Diverse Applications

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale

PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services

Ensuring Fair LLM Serving Amid Diverse Applications

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale

BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute

Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search

EcoAct: Economic Agent Determines When to Register What Action

Exploring How LLMs Capture and Represent Domain-Specific Knowledge

Performance Aware LLM Load Balancer for Mixed Workloads

On Efficient Distillation from LLMs to SLMs

Ensuring Fair LLM Serving Amid Diverse Applications

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Serving Models, Fast and Slow:Optimizing Heterogeneous LLM Inferencing Workloads at Scale

PnM: Efficient Intra-Datacenter Calls Packing for Large Conferencing Services

Enhancing Reasoning Capabilities of Small Language Models with Blueprints and Prompt Template Search

EcoAct: Economic Agent Determines When to Register What Action

Performance Aware LLM Load Balancer for Mixed Workloads

On Efficient Distillation from LLMs to SLMs

Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Matchmaker: Data Drift Mitigation in Machine Learning for Large-Scale Systems

BEST-Route: Adaptive LLM Routing with Test-Time Optimal Compute

Ensuring Fair LLM Serving Amid Diverse Applications

Intelligent Router for LLM Workloads: Improving Performance Through Workload-Aware Scheduling

Exploring How LLMs Capture and Represent Domain-Specific Knowledge