Portrait of Margaret Mitchell

Margaret Mitchell



I am a researcher in Microsoft’s NLP Research Group. I work on grounded language generation, focusing on how to help computers communicate based on what they can process.
In addition to leveraging natural language processing techniques, this brings in computer vision, social media analysis, various statistical methods, and insights from cognitive science.


MSR Ability

The Ability team is a virtual team consisting of members of MSR's Labs who work on accessible technologies for people with disabilities. The Ability team's mission is to: Understand the tech-related challenges and needs of people with…

From Captions to Visual Concepts and Back

Established: April 9, 2015

We introduce a novel approach for automatically generating image descriptions. Visual detectors, language models, and deep multimodal similarity models are learned directly from a dataset of image captions. Our system is state-of-the-art on the official Microsoft COCO benchmark, producing a…

Data-Driven Conversation

This project aims to enable people to converse with their devices. We are trying to teach devices to engage with humans using human language in ways that appear seamless and natural to humans. Our research focuses on statistical methods by…



From Captions to Visual Concepts and Back
Hao Fang, Saurabh Gupta, Forrest Iandola, Rupesh Srivastava, Li Deng, Piotr Dollar, Jianfeng Gao, Xiaodong He, Margaret Mitchell, John Platt, Lawrence Zitnick, Geoffrey Zweig, Larry Zitnick, in The proceedings of CVPR, IEEE – Institute of Electrical and Electronics Engineers, June 1, 2015, View abstract, Download PDF


Commonsense and World Knowledge Link description

Commonsense and World Knowledge


July 24, 2015


Benjamin Van Durme, Dan Roth, Lucy Vanderwende, Margaret Mitchell, and Raymond J. Mooney


Microsoft Research, University of Texas at Austin, University of Illinois at Urbana-Champaign, Johns Hopkins University

Vision to Language Link description

Vision to Language


July 17, 2015


Julia Hockenmaier, Larry Zitnick, Margaret Mitchell, and Richard Zemel


Microsoft Research, Universty of Illinois-Urbana Champaign, University of Toronto