The Ability team is a virtual team consisting of members of MSR's Labs who work on accessible technologies for people with disabilities. The Ability team's mission is to: Understand the tech-related challenges and needs of people with…
I am a researcher in Microsoft’s NLP Research Group. I work on grounded language generation, focusing on how to help computers communicate based on what they can process.
In addition to leveraging natural language processing techniques, this brings in computer vision, social media analysis, various statistical methods, and insights from cognitive science.
Established: April 9, 2015
We introduce a novel approach for automatically generating image descriptions. Visual detectors, language models, and deep multimodal similarity models are learned directly from a dataset of image captions. Our system is state-of-the-art on the official Microsoft COCO benchmark, producing a…
This project aims to enable people to converse with their devices. We are trying to teach devices to engage with humans using human language in ways that appear seamless and natural to humans. Our research focuses on statistical methods by…
July 24, 2015
Benjamin Van Durme, Dan Roth, Lucy Vanderwende, Margaret Mitchell, and Raymond J. Mooney
Microsoft Research, University of Texas at Austin, University of Illinois at Urbana-Champaign, Johns Hopkins University
July 17, 2015
Ethan Jackson, Jeannette Wing, Jennifer Listgarten, Larry Zitnick, Meg Mitchell, and P. Anandan
July 17, 2015
Julia Hockenmaier, Larry Zitnick, Margaret Mitchell, and Richard Zemel
Microsoft Research, Universty of Illinois-Urbana Champaign, University of Toronto