Yifan Xiong的肖像

Yifan Xiong

Senior Researcher

新闻与深度文章

Research Focus: August 5, 2024
微软研究院博客

In this issue: Research Forum Ep. 4 expl…

奖项 | USENIX ATC 2024

Our paper titled "SuperBench: Improving …

A line graph comparing the end-to-end performance of Meta’s MoE language model using Azure NDm A100 v4 VMs with and without Tutel. The x-axis is the number of A100 (80GB) GPUs, beginning at 8 and going up to 512, and the y-axis is the throughput (K tokens/s), beginning with 0 and going up to 1,000 in intervals of 100. Tutel always achieves higher throughput than fairseq.
微软研究院博客

| Wei Cui, Yifan Xiong, Peng Cheng, 和 Rafael Salas

Mixture of experts (MoE) is a deep learn…