News & features
Promptions helps make AI prompting more precise with dynamic UI controls
| Sean Rintel, Advait Sarkar, Jack Williams, Nicholas Wilson, Richard Banks, Neeltje Berger, Philipp Steinacher, Payod Panda, and Ian Drosos
Promptions helps developers add dynamic, context-aware controls to chat interfaces so users can guide generative AI responses. It lets users shape outputs quickly without writing long instructions.
Introducing Muse: Our first generative AI model designed for gameplay ideation
| Katja Hofmann
Today Nature published Microsoft’s research detailing our WHAM, an AI model that generates video game visuals & controller actions. We are releasing the model weights, sample data, & WHAM Demonstrator on Azure AI Foundry, enabling researchers to build on the…
Research Focus: Week of October 28, 2024
New Research | FLASH: Workflow automation agent for diagnosing recurring incidents; METAREFLECTION: Learning instructions for language agents using past reflections; Boosting LLM training efficiency through faster communication between GPUs; and more.
Abstracts: September 30, 2024
| Amber Tingle, Daniela Massiceti, and Martin Grayson
The personalizable object recognizer Find My Things was recently recognized for accessible design. Researcher Daniela Massiceti and software development engineer Martin Grayson talk about the research project’s origins and the tech advances making it possible.
In the news | Communications of the ACM
AI Should Challenge, Not Obey
“How should we evaluate the legacy of Thomas Jefferson?,” asks a professor of American history. The reply: “The general consensus on Thomas Jefferson is that he was a complex and contradictory figure who championed the ideals of democracy, tolerance, and…
Research Focus: Week of April 29, 2024
In this edition: Can LLMs transform natural language into formal method postconditions; Semantically aligned question + code generation for automated insight generation; Explaining CLIP performance disparities on blind/low vision data; plus recent news.
Collaborators: Teachable AI with Cecily Morrison and Karolina Pakėnaitė
| Gretchen Huizinga, Cecily Morrison, and Karolina Pakėnaitė
Cecily Morrison and Karolina Pakėnaitė are collaborators on a research prototype designed to help members of the blind community find their personal items. Learn how the work is advancing an approach to empower people to shape their own AI experiences.
Microsoft at VL/HCC 2023: Focus on co-audit tools for spreadsheets
| Jack Williams, Ian Drosos, and Kasra Ferdowsi
These research papers were presented at the IEEE Symposium on Visual Languages and Human-Centric Computing (opens in new tab) (VL/HCC 2023), a premier forum for design, theory, and application of computing technologies for programming, modelling, and communication. Large language models…
Using generative AI to imitate human behavior
| Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Stevenson, Sergio Valcarcel Macua, Shanzheng Tan, Ida Momennejad, Katja Hofmann, and Sam Devlin
Diffusion models have been used to generate photorealistic images and short videos, compose music, and synthesize speech. In a new paper, Microsoft Researchers explore how they can be used to imitate human behavior in interactive environments.