About

I'm a researcher at Microsoft Research AI, and my main research interests are in artificial intelligence, natural language processing, deep learning, neural conversational models, neural text generation, machine translation, and text and speech summarization. My current research focuses primarily on deep learning methods for conversational intelligence.

Academic Background

2007-2009 Postdoc in Computer Science, Stanford University
2007 Ph.D. in Computer Science, Columbia University
2002 M.Sc. in Computer Science, Columbia University
2001 Diploma in Computer Science, EPFL

Projects

Conversational Intelligence

Intelligent agents that can handle human language play a growing role in personalized, ubiquitous computing and the everyday use of devices. Agents need to be able to communicate and collaborate with humans in ways that are seamless and natural, and to be able to learn new behaviors, concepts, and relationships as first-class operations. In other words, our devices need to be able to converse with us. In this project, Microsoft Research AI teams are interested…

Data-Driven Conversation

Established: June 1, 2014

This project aims to enable people to converse with their devices. We are trying to teach devices to engage with humans using human language in ways that appear seamless and natural to humans. Our research focuses on statistical methods by which devices can learn from human-human conversational interactions and can situate responses in the verbal context and in physical or virtual environments. Natural and Engaging Agents that process human language will play a growing role…

Recurrent Neural Networks for Language Processing

Established: November 23, 2012

This project focuses on advancing the state-of-the-art in language processing with recurrent neural networks. We are currently applying these to language modeling, machine translation, speech recognition, language understanding and meaning representation. A special interest in is adding side-channels of information as input, to model phenomena which are not easily handled in other frameworks. A toolkit for doing RNN language modeling with side-information is in the associated download. Sample word vectors for use with this toolkit…

Publications

2017

2016

Visual Storytelling
Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell, in Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 2016, June 13, 2016, View abstract, Download PDF, View external link

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2001

Downloads

Plato Neural Network Library

June 2015

    Click the icon to access this download

  • Website

Microsoft Research Dense Visual Annotation Corpus

August 2014

    Click the icon to access this download

  • Website