Publications
Microsoft Research Blog
Microsoft Research Blog
Microsoft Research Blog
Microsoft Research Blog
Overview
The Deep Learning group’s mission is to advance the state-of-the-art on deep learning and its application to natural language processing, computer vision, multi-modal intelligence, and for making progress on conversational AI. Our research interests are:
- Neural language modeling for natural language understanding and generation. Some ongoing projects are MT-DNN, UniLM, question-answering, long text generation, etc.
- Neural symbolic computing. We are developing next-generation architectures to bridge gap between neural and symbolic representations with neural symbols. Some ongoing projects are relational encoding using Tensor-Product Representations, text-to-code, etc.
- Vision-language grounding and understanding. Some ongoing projects are vision-language pre-training, vision language navigation, image editing and generation, image commenting and captioning, etc.
- Conversational AI. Some ongoing projects are conversation learner which enables you to build task-oriented dialog system via machine teaching, ConvLab which is an open-source multi-domain dialog system platform, and response generation for social bots such as Microsoft XiaoIce, etc.
News
- Three papers accepted to ICML 17
- Three papers accepted to CVPR 17 and our team which included University of Adelaide and Australian National University won 1st place in the Visual Question Answering Challenge 2017. See the leaderboard and MSFTResearch Twitter.
- One paper accepted to ACL 17
- Two papers accepted to ICLR 17
- Released the image captioning service in Microsoft Cognitive Services/Vision API. You can try the CaptionBot demo at http://CaptionBot.ai, or add it to your Skype and have a photo chat. The technology is based on our competition winning deep learning multimodal intelligence models.
- Our Microsoft Research entry won 1st Prize, tied with Google, at the MS COCO Captioning Challenge 2015, achieved the highest score in the Turing Test among all submissions. More details in the CVPR paper, demo, relevant talk, and recent media coverage by Microsoft blog, TechNet, SlashGear, Engadget, ventureBeat, androidHeadlines.
