Image of researcher working on a computer to promote the about MSR page.

Microsoft Research: Advancing science and technology to benefit humanity

View our story

Microsoft Research Blog

Research at Microsoft 2023: A year of groundbreaking AI advances and discoveries

December 22, 2023

An example of the generative LLM inference process and the two phases associated with it. The initial prompt is “Which is better, pizza or burger?” and it generates the word “Pizza”. The token generation phase generates the words/tokens: “is”, “better”, and “.”. The prompt phase has the following properties: (1) all input tokens are processed in parallel to generate the first output token, (2) compute intensive, and (3) is a smaller part of the end-to-end latency. The token phase is: (1) serialized, (2) memory intensive, and (3) tends to be the majority of the end-to-end latency.
Microsoft Research Blog

Splitwise improves GPU usage by splitting LLM inference phases 

January 4, 2024

MSR Podcast - AI Frontiers with Chris Bishop
Microsoft Research Blog

AI Frontiers: A deep dive into deep learning with Ashley Llorens and Chris Bishop 

December 18, 2023 | Ashley Llorens, Christopher Bishop

AI and Microsoft Research header - abstract neural network pattern on dark spectrum background
Focus Area

AI and Microsoft Research 

Explore Microsoft Research Health Futures

Peter Lee smiling at the camera with the Microsoft Research Podcast logo to the right

AI Frontiers: AI for health and the future of research with Peter Lee 

March 30, 2023 | Peter Lee, Ashley Llorens

EMNLP 2023 blog hero - female radiologist analyzing an MRI image of the head

GPT-4's potential in shaping the future of radiology 

November 27, 2023 | Javier Alvarez-Valle, Matthew Lungren

Doctor at computer

How AI is helping to shrink waiting times for NHS cancer patients 

June 27, 2023 | Microsoft News Centre UK

The KDD2023 logo in white with the dates August 6-10 and the city Long Beach, CA on a green and blue gradient background

Microsoft at KDD 2023: Advancing health at the speed of AI 

August 10, 2023 | Hoifung Poon

Careers in research

Asia-Pacific Europe Middle East & Africa North America South America
See all open research positions

No upcoming events

News & awards

View more news and awards