Loading...

In the news | MarTechPost

Microsoft Research Introduces ‘Tutel’: A High-Performance MoE Library To Facilitate The Development Of Large-Scale DNN (Deep Neural Network) Models 

November 24, 2021

Tutel is a high-performance MoE library developed by Microsoft researchers to aid in the development of large-scale DNN (Deep Neural Network) models; Tutel is highly optimized for the new Azure NDm A100 v4 series, and Tutel’s diverse and flexible MoE algorithmic…

Awards | IEEE

Xing Xie elevated to IEEE Fellow 

November 23, 2021

Dr. Xing Xie was elevated to IEEE Fellow 2022 for his contributions to spatial data mining and recommendation systems. IEEE Fellow is a distinction reserved for select IEEE members whose extraordinary accomplishments in any of the IEEE fields of interest…

A line graph comparing the end-to-end performance of Meta’s MoE language model using Azure NDm A100 v4 VMs with and without Tutel. The x-axis is the number of A100 (80GB) GPUs, beginning at 8 and going up to 512, and the y-axis is the throughput (K tokens/s), beginning with 0 and going up to 1,000 in intervals of 100. Tutel always achieves higher throughput than fairseq.
Microsoft Research Blog

Tutel: An efficient mixture-of-experts implementation for large DNN model training 

November 22, 2021 | Wei Cui, Yifan Xiong, Peng Cheng, and Rafael Salas

Mixture of experts (MoE) is a deep learning model architecture in which computational cost is sublinear to the number of parameters, making scaling easier. Nowadays, MoE is the only approach demonstrated to scale deep learning models to trillion-plus parameters, paving…

Z-Code multilingual model

In the news | Microsoft Translator Blog

Multilingual translation at scale: 10000 language pairs and beyond 

November 22, 2021

Microsoft is on a quest for AI at Scale with high ambition to enable the next generation of AI experiences. The Microsoft Translator ZCode team is working together with Microsoft Project Turing and Microsoft Research Asia to advance language and…

In the news | Microsoft Worklab

The Rise of the Triple Peak Day 

November 22, 2021

If the pandemic has revealed anything about work life, it’s that work and life are melded like never before: morning staff meetings streamed from the breakfast table; in-person presentations before school pickup; and evenings of quiet concentration whenever the opportunity…

Articles

第一篇发表论文就斩获马尔奖!微软亚洲研究院实习生的科研经验分享 

November 19, 2021

在计算机视觉领域顶级会议 ICCV 2021 中,来自微软亚洲研究院的论文 “Swin Transformer: Hierarchical Vision Transformer using Shifted Windows” 荣获最佳论文奖(马尔奖,Marr Prize)。马尔奖每两年评选一次,被看作是计算机视觉研究方面的最高荣誉之一。 在这项研究工作中,来自微软亚洲研究院的三位实习生——联合培养博...

Articles

Unlocking Young Minds with Soundscape 

November 18, 2021

Year 6 (age 11) classroom teachers in the UK will be all too familiar with the challenge of keeping their pupils engaged in that very last summer half term of their primary education before they move onto a new secondary…

In the news | Daily Mail

COVID-19 public health measures such as social distancing led to a nearly 40% decrease in emergency room visits for pink eye 

November 18, 2021

Researchers at Microsoft worked together with Researchers at the University of Washington. During the pandemic, fewer people sought out care for pink eye due to coronavirus-inspired social distancing, increased handwashing and other health measures. Researchers analyzed both emergency department visits…

In the news | Microsoft Transform

Novartis empowers scientists with AI to speed the discovery and development of breakthrough medicines 

November 18, 2021

Here’s a cooking story unlike any you’ve heard before. That’s because the chefs are chemists, the ingredients are molecules, and the main course is a new medication designed to defeat illness. At least, that’s Luca Finelli’s snackable description to explain…

  • Previous
  • 1
  • …
  • 178
  • 179
  • 180
  • 181
  • 182
  • …
  • 569
  • Next