Microsoft Research Blog

The Microsoft Research blog provides in-depth views and perspectives from our researchers, scientists and engineers, plus information about noteworthy events and conferences, scholarships, and fellowships designed for academic and scientific communities.

  1. Turing-NLG: A 17-billion-parameter language model by Microsoft

    This figure was adapted from a similar image published in DistilBERT. Turing Natural Language Generation (T-NLG) is a 17 billion parameter language model by Microsoft that outperforms the state of the art on many downstream NLP tasks. We present a demo of the model, including its freeform generation, question answering, and summarization capabilities, to academics for feedback and research purposes. <|endoftext|>  - This summary was generated by the Turing-NLG language model itself. Massive deep learning…

    February 13th, 2020

  2. ZeRO & DeepSpeed: New system optimizations enable training models with over 100 billion parameters

    The latest trend in AI is that larger natural language models provide better accuracy; however, larger models are difficult to train because of cost, time, and ease of code integration. Microsoft is releasing an open-source library called DeepSpeed, which vastly advances large model training by improving scale, speed, cost, and usability, unlocking the ability to train 100-billion-parameter models. DeepSpeed is compatible with PyTorch. One piece of that library, called ZeRO, is a new parallelized optimizer…

    February 13th, 2020

  3. Microsoft Scheduler and dawn of Intelligent PDAs with Dr. Pamela Bhattacharya

    Episode 106 | February 12, 2020 - In a world where productivity is paramount and only a handful of people have personal assistants, many of us are frustrated by the amount of time we spend in meetings, and worse, the amount time we spend planning, scheduling and rescheduling those meetings! Fortunately, Dr. Pamela Bhattacharya, a Principal Applied Scientist in Microsoft’s Outlook group, wants to turn your email into your own personal assistant. And a smart…

    February 12th, 2020

  4. Responsible AI with Dr. Saleema Amershi

    Episode 105 | February 5, 2020 - There’s an old adage that says if you fail to plan, you plan to fail. But when it comes to AI, Dr. Saleema Amershi, a principal researcher in the Adaptive Systems and Interaction group at Microsoft Research, contends that if you plan to fail, you’re actually more likely to succeed! She’s an advocate of calling failure what it is, getting ahead of it in the AI development cycle…

    February 5th, 2020

  5. The personal web: Connecting information for better search and recommendation

    In the digital era, almost everyone struggles with the mountains of information they have. Every activity in our lives seemingly generates more information: emails, files, receipts, photos—the list goes on. We have trails of digital information from each of our work projects, vacations, hobbies, and kids’ schools, including websites, files, and calendar appointments, not to mention contacts—the people we work, play, and live with in each of these spaces. We spend a significant amount of…

    February 4th, 2020

  6. Going deep on deep learning with Dr. Jianfeng Gao

    Episode 104 | January 29, 2020 - Dr. Jianfeng Gao is a veteran computer scientist, an IEEE Fellow and the current head of the Deep Learning Group at Microsoft Research. He and his team are exploring novel approaches to advancing the state-of-the-art on deep learning in areas like NLP, computer vision, multi-modal intelligence and conversational AI. Today, Dr. Gao gives us an overview of the deep learning landscape and talks about his latest work on…

    January 29th, 2020

  7. Open-source library provides explanation for machine learning through diverse counterfactuals

    Consider a person who applies for a loan with a financial company, but their application is rejected by a machine learning algorithm used to determine who receives a loan from the company. How would you explain the decision made by the algorithm to this person? One option is to provide them with a list of features that contributed to the algorithm’s decision, such as income and credit score. Many of the current explanation methods provide…

    January 28th, 2020

  8. Microsoft Investigator fellows accelerate scientific and teaching impact with Azure cloud computing

    I am pleased to announce the winners of the new Microsoft Investigator Fellowship. This fellowship is designed to empower researchers of all disciplines who plan to make an impact with research and teaching using the Microsoft Azure cloud computing platform. Each fellowship provides $100,000 USD annually for two years and various training and community events. We received over 290 proposals from an impressive group of faculty researchers. Ultimately, 15 fellowships were awarded. “The unique value…

    January 28th, 2020

  9. 2020 Ada Lovelace and PhD Fellowships help recipients achieve broad research and educational goals

    In their second and thirteenth years respectively, the Ada Lovelace Fellowship and PhD Fellowship continue a Microsoft Research tradition of providing promising doctoral students in North America with funding to support their studies and research. This year, there were over 600 submissions between both fellowships. Microsoft Research is proud to announce the 2020 recipients for each of these awards. The breadth of fellows’ pursuits speaks to the increasingly broad impact of technology in the world…

    January 23rd, 2020

  10. Project Rocket platform—designed for easy, customizable live video analytics—is open source

    Thanks to advances in computer vision and deep neural networks (DNNs) in what can arguably be described as the golden age of vision, AI, and machine learning, video analytics systems—systems performing analytics on live camera streams—are becoming more accurate. This accuracy offers opportunities to support individuals and society in exciting ways, like informing homeowners when a package has been delivered outside their door, allowing people to give their pets the attention they need when out…

    January 22nd, 2020

  11. Innovating in India with Dr. Sriram Rajamani

    Episode 103 | January 22, 2020 - Dr. Sriram Rajamani is a Distinguished Scientist and the Managing Director of the Microsoft Research lab in Bangalore. He’s dedicated his career to advancing globally applicable science in the testbed that is India. He is, by any measure, a world-class researcher and leader. He’s also, as you’ll find out shortly, a world-class storyteller! On the podcast, Dr. Rajamani talks about the unique challenges and opportunities of leading MSR’s…

    January 22nd, 2020