Microsoft Research Blog

language modeling

  1. An overview of PipeDream's workflow

    PipeDream: A more effective way to train deep neural networks using pipeline parallelism 

    October 28, 2019 | Amar Phanishayee

    Deep Neural Networks (DNNs) have facilitated tremendous progress across a range of applications, including image classification, translation, language modeling, and video captioning. DNN training is extremely time-consuming, needing efficient multi-accelerator parallelization. In “PipeDream: Generalized Pipeline Parallelism for DNN Training,” published at the 27th ACM Symposium…

  2. Kinect Sign Language Translator – part 2 

    October 30, 2013

    Today, we have the second part of a two-part blog posted by program managers in Beijing and Redmond respectively—second up, Stewart Tansley: When Microsoft Research shipped the first official Kinect for Windows software development kit (SDK) beta in June 2011, it was both an ending and…

  3. Kinect Sign Language Translator – part 1 

    October 29, 2013

    Today, we have the first part of a two-part blog posted by program managers in Beijing and Redmond respectively—first up, Guobin Wu: I consider myself incredibly lucky to be the program manager of the Kinect Sign Language Translator project. There are more than 20 million…