Image of researcher working on a computer to promote the about MSR page.

Microsoft Research: Advancing science and technology to benefit humanity

View our story

Microsoft Research Blog

Orca 2: Teaching Small Language Models How to Reason 

November 20, 2023

Orca-2 blog hero | abstract waves of data
Microsoft Research Podcast: Abstracts, November 20, 2023
microsoft research podcast

Abstracts: November 20, 2023 

November 20, 2023 | Shrey Jain, Zoë Hitzig

Illustrated figure of lifelong model editing with GRACE. On the left is a question and the model’s existing answer to it (which is incorrect). Editing method needs to update it the correct answer. In the middle the architecture is shown where the language model is frozen and embeddings are extracted to retrieve appropriate values (new embeddings) from the codebook. On the right the codebook is shown which includes a set of trainable embeddings.
Microsoft Research Blog

Lifelong model editing in large language models: Balancing low-cost targeted edits and catastrophic forgetting 

November 20, 2023 | Tom Hartvigsen, Hamid Palangi

abstract neural network pattern on dark blue background
Focus Area

AI and Microsoft Research 

Explore Microsoft Research Health Futures

Peter Lee wearing glasses and smiling at the camera with the Microsoft Research Podcast logo to the left

AI Frontiers: AI for health and the future of research with Peter Lee 

AI and the future of health - female doctor reviewing tablet

AI and the Future of Health 

Doctor at computer

How AI is helping to shrink waiting times for NHS cancer patients 

Microsoft at KDD 2023: Advancing health at the speed of AI

Microsoft at KDD 2023: Advancing health at the speed of AI 

August 10, 2023 | Hoifung Poon

Careers in research

Asia-Pacific Europe Middle East & Africa North America South America

Research Fellowship Opportunity 

Posted: November 20, 2023

Locations: Bangalore, Karnataka, India; Gurgaon, Haryana, India; Hyderabad, Telangana, India; Mumbai, Maharashtra, India; Noida, Uttar Pradesh, India

See all open research positions

Events & webinars

NeurIPS 2023 

Upcoming: December 10, 2023 – December 16, 2023

New Orleans, LA

Upcoming events and webinars

News & awards

View more news and awards