Global cloud service providers handle inference workloads for Large Language Models (LLMs) that span latency-sensitive (e.g., chatbots) and insensitive (e.g., report writing) tasks, resulting in diverse and often conflicting Service Level Agreement (SLA) requirements. Managing such mixed workloads is challenging due to the complexity of…
CPUs provide isolation mechanisms like virtualization and privilege levels to protect software. Yet these focus on architectural isolation while typically overlooking microarchitectural side channels, exemplified by Meltdown and Foreshadow. Software must therefore supplement architectural defenses with ad-hoc microarchitectural patches, which are constantly evolving as new…
Large Language Models (LLMs) are increasingly employed in complex workflows, where different LLMs and fine-tuned variants collaboratively address complex tasks. However, these systems face significant inefficiencies due to redundant context processing of the shared context. We propose DroidSpeak, a framework that optimizes context sharing between…
Container platforms like Kubernetes are widely adopted for deploying latency-sensitive cloud services, and CPU resources for these containers are over-provisioned to ensure low 99th percentile tail latency under peak load. At the same time, cloud services exhibit bursty traffic patterns resulting in CPU usage variability…
Misconfiguration is frequently cited as a leading cause of service disruptions and outages. To prevent misconfiguration, we introduce network contracts — lightweight configuration checks that run efficiently, localize errors to specific lines, and require no heavyweight modeling of network protocols. We develop a tool Concord…
The increasing capability of AI models to generate user interfaces has the potential to transform HCI and design practice. We invite researchers, designers, developers, and practitioners to explore how generative UI – interfaces created by AI models – will reshape design methods, workflows, and user…
The widespread adoption of Large Language Models (LLMs) has enabled diverse applications with very different latency requirements. Existing LLM serving frameworks rely on siloed infrastructure with coarse-grained workload segregation -- interactive and batch -- leading to inefficient resource utilization and limited support for fine-grained Quality-of-Service…
In this work we consider the Metric Steiner Forest problem in the sublinear time model. Given a set V of n points in a metric space where distances are provided by means of query access to an n×n distance matrix, along with a set of…
Microsoft Research stories Emerging technology is propelled by great ideas, but transforming research ideas into meaningful impact is no small feat. These stories are deeper explorations of the research journey at Microsoft, including the beliefs and experiences that animate our research, our diverse range of…
Holoportation™ technology, enabling real-time 3D telecommunications, has evolved from the lab to real-world use. After a decade of refinement and real-world deployment, it's been released via open source license to encourage wider use and development.
Fundamental research is the source of all innovation, and Microsoft Research Asia is dedicated to defining new computing paradigms and unlocking long-term breakthroughs. Through interdisciplinary research across fields such as AI for healthcare, finance, and societal applications, we believe AI will become the next basic…
We are seeking Senior Researcher – AI and Systems Reliability – Microsoft Research areas such as distributed systems and reliability, formal methods and verification, machine learning for system reliability, and reliability of machine learning systems. As AI (Artificial Intelligence) technologies—like large language models—become central to…
