Loading...
DeepSpeed shares findings and innovations for MoE models and systems that 1) reduce training cost by 5x, 2) reduce MoE parameter size by up to 3.7x and 3) reduce MoE inference latency by 7.3x at an unprecedented scale and offer up to 4.5x faster and 9x cheaper inference for MoE models compared to quality-equivalent dense models.
Microsoft Research Blog

DeepSpeed: Advancing MoE inference and training to power next-generation AI scale 

January 19, 2022 | DeepSpeed Team and Andrey Proskurin

In the last three years, the largest trained dense models have increased in size by over 1,000 times, from a few hundred million parameters to over 500 billion parameters in Megatron-Turing NLG 530B (MT-NLG). Improvements in model quality with size…

Awards | ACM

Four Microsoft researchers named as 2021 ACM Fellows 

January 19, 2022

Four Microsoft researchers were among those honored for 2021: Nikolaj Bjorner, Tie-Yan Liu, Ryen White, and Tom Zimmermann. ACM Fellows includes the top 1% of ACM members for their outstanding accomplishments in computing and information technology and/or outstanding service to…

In the news | VentureBeat

Why games may not be the best benchmark for AI 

January 18, 2022

Microsoft believes in the power of gaming as a platform for AI, pointing to Project Paidia. “With projects like this, we’re showing how AI is shifting from competitive applications to being used to empower players to achieve more,” Sam Devlin…

Lili Qiu
Articles

ACM/IEEE Fellow邱锂力博士担任微软亚洲研究院(上海)负责人 

January 17, 2022

2022年1月17日,中国北京——微软亚洲研究院宣布,无线及移动网络领域的国际顶级专家邱锂力博士正式加入微软亚洲研究院,担任副院长一职,主要负责微软亚洲研究院(上海)的研究工作,以及与产学研各界的合作。加入微软亚洲研究院之前,邱锂力博士在美国得克萨斯大学奥斯汀分校担任计算机系教授,并担任国际计算机学会无线及移动系统专委(ACM SIGMOBILE)的主席。 对于邱锂力博士的加入,微软亚洲研究院院长...

a couple of people posing for the camera
Microsoft Research India Podcast

Podcast: Collaborating to Develop a Low-cost Keratoconus Diagnostic Solution. With Dr. Kaushik Murali and Dr. Mohit Jain 

January 17, 2022

 Episode 011 | January 18, 2022 Keratoconus is a severe eye disease that affects the cornea, causing it to become thin and develop a conical bulge. Keratoconus, if undiagnosed and untreated, can lead to partial or complete blindness in…

In the news | Discover Magazine

Is Holographic Data Storage the Next Big Thing? 

January 17, 2022

Every email you send, every selfie you take, every TikTok video you post adds to the amount of digital data in the world. And that pile of data is growing at an astonishing rate. According to recent estimates, by 2025,…

a woman smiling for the camera
Articles

ACM/IEEE Fellow Dr. Lili Qiu joins Microsoft Research Asia as Assistant Managing Director 

January 16, 2022

Microsoft Research Asia announced that Dr. Lili Qiu, a world-leading expert in the field of Internet and mobile wireless networks, has officially joined Microsoft Research Asia as Assistant Managing Director and will be mainly responsible for overseeing the research, as…

In the news | Neowin

EzPC: Microsoft’s attempt to enhance data security in AI model validation 

January 14, 2022

Those who have worked in the domain of data science know that developing an artificial intelligence (AI) model typically includes three stages at a high level: training, validation, and testing. When testing the accuracy of the model, there are usually…

In the news | AI Magazine

AI3C: Accelerating AI innovation in the healthcare industry 

January 14, 2022

Leading US health, educational, and research organisations have come together with the creation of a group aimed at accelerating artificial intelligence innovation and adoption in healthcare, Microsoft has announced.

  • Previous
  • 1
  • …
  • 170
  • 171
  • 172
  • 173
  • 174
  • …
  • 568
  • Next