Artificial Intelligence
Pursuing computing advances to create intelligent machines that complement human reasoning to augment and enrich our experience and competencies.
Tool
Dion: Distributed Orthonormal Updates
Dion is a scalable optimizer that accelerates neural network training by applying orthonormal weight updates using amortized power iteration, which works efficiently on sharded matrices. It reduces communication overhead through low-rank compression and error feedback,…
Microsoft Research Blog
Tool-space interference in the MCP era: Designing for agent compatibility at scale
As agentic AI ushers in a new era marked by tool expansion, systems are converging, and complexity is rising. Microsoft Research explores the Model Context Protocol (MCP) as a new standard for agent collaboration across…
Publication
Is In-Context Learning Learning?
Publication