Microsoft Research Blog

  1. diagram

    Three mysteries in deep learning: Ensemble, knowledge distillation, and self-distillation

    Under now-standard techniques, such as over-parameterization, batch-normalization, and adding residual links, “modern age” neural network training—at least for image classification tasks and many others—is usually quite stable. Using standard neural network architectures and training algorithms (typically SGD with momentum), the learned models perform consistently well,…
    January 19, 2021 by Zeyuan Allen-Zhu and Yuanzhi Li

Microsoft Research

Webinar Series

Online lectures from Microsoft’s computer scientists

View All Webinars

Microsoft Research


Ongoing conversations at the cutting edge of research

View All Episodes
  1. graphical user interface

    Unadversarial examples: Designing objects for robust vision

    Many of the items and objects we use in our daily lives were designed with people in mind. In October, the Reserve Bank of Australia put out into the world its redesigned $100 banknote. Some design elements remained the same—such as color and size, characteristics…
    December 22, 2020 by Hadi Salman
  2. ‘Seeing’ on tiny battery-powered microcontrollers with RNNPool

    Computer vision has rapidly evolved over the past decade, allowing for such applications as Seeing AI, a camera app that describes aloud a person’s surroundings, helping those who are blind or have low vision; systems that can detect whether a product, such as a computer…
    December 11, 2020
  3. Image from Game of Drones simulation

    Research Collection – Reinforcement Learning at Microsoft

    Reinforcement learning is about agents taking information from the world and learning a policy for interacting with it, so that they perform better. So, you can imagine a future where, every time you type on the keyboard, the keyboard learns to understand you better. Or…
    December 7, 2020
  4. A Microsoft custom data type for efficient inference

    AI is taking on an increasingly important role in many Microsoft products, such as Bing and Office 365. In some cases, it’s being used to power outward-facing features like semantic search in Microsoft Word or intelligent answers in Bing, and deep neural networks (DNNs) are…
    December 2, 2020