SANDHI: Fine-grained Merging for Memory Efficient Multi-Model Serving

• Vima Gupta ,
• Oytun Kuday Duran ,
• Nandan Suresh Meda ,
• Ikhyun An ,
• Ganesh Ananthanarayanan ,
• Anand Iyer

2026 ACM SOSP | September 2026

Organized by ACM