Microsoft Research Blog

Factorized layers revisited: Compressing deep networks without playing the lottery 

From BiT (928 million parameters (opens in new tab)) to GPT-3 (175 billion parameters (opens in new tab)), state-of-the-art machine learning models are rapidly growing in size. With the greater expressivity and easier trainability of these models come skyrocketing training costs, deployment difficulties, and even…

Recent Posts

  1. graphical user interface, text, application, email

    The science behind semantic search: How AI from Bing is powering Azure Cognitive Search 

    March 2, 2021

    Azure Cognitive Search (opens in new tab) is a cloud search service that gives developers APIs and tools to build rich search experiences over private, heterogeneous content in web, mobile, and enterprise applications. It has multiple components, including an API for indexing and querying, seamless integration through Azure data ingestion, deep integration with Azure Cognitive Services, and persistent storage…

  2. hexagonal AI icons on a blue background

    AAAI 2021: Accelerating the impact of artificial intelligence 

    February 24, 2021

    The purpose of the Association for the Advancement of Artificial Intelligence, according to its bylaws, is twofold. The first is to promote research in the area of AI, and the second is to promote the responsible use of these types of technology. The result was a 35th AAAI Conference on Artificial Intelligence (AAAI-21) (opens in new tab) schedule that broadens the…

  3. Designer-centered reinforcement learning 

    February 17, 2021 | Batu Aytemiz, Mikhail Jacob, Sam Devlin, and Katja Hofmann

    In video games, nonplayer characters, bots, and other game agents help bring a digital world and its story to life. They can help make the mission of saving humanity feel urgent, transform every turn of a corner into a gamer’s potential demise, and intensify the…

  4. Suphx - Mahjong board

    Research Collection – Shall we play a game? 

    February 5, 2021

    From a research point of view, games offer an amazing environment in which to develop new machine learning algorithms and techniques. And we hope, in due course, that those new algorithms will feed back not just into gaming, but into many other domains. Beyond the…

Explore More

  • Events & conferences

    Events & conferences 

    Meet our community of researchers, learn about exciting research topics, and grow your network

  • Podcasts

    Podcasts 

    Ongoing conversations at the cutting edge of research

  • Microsoft Research Forum

    Microsoft Research Forum 

    Join us for a continuous exchange of ideas about research in the era of general AI