Microsoft Research Blog

Microsoft Research Blog

The Microsoft Research blog provides in-depth views and perspectives from our researchers, scientists and engineers, plus information about noteworthy events and conferences, scholarships, and fellowships designed for academic and scientific communities.

Advancing machine comprehension with question generation

May 10, 2017 | By Microsoft blog editor

Microsoft Research Montreal lab’s vision is to create machines that can comprehend, reason and communicate with humans.

We see a future where humans interact with machines just as they would with another human. We could ask a question in natural language and have the machine respond with an appropriate answer.

Yet answering questions is only one part of an interaction. In addition to our work in training machines to seek information and then read and reason upon text and answer questions, we are now training machines to ask questions.

The importance of questions

While asking a question may seem straightforward, it is the process of asking the right question that can drive the better understanding of concepts and information. While many QA datasets are geared to training for answering questions – an extractive task – the process of asking questions is comparatively abstractive: it requires the generation of text that may not appear in the context document. Asking ‘good’ questions involves skills beyond those needed to answer them.

Examples of conditional question generation given a context and an answer

We propose a recurrent neural model that generates natural-language questions from documents, conditioned on answers. We show how to train the model using a combination of supervised and reinforcement learning to improve its performance. After teacher forcing for standard maximum likelihood training, we fine-tune the model using policy gradient techniques to maximize several rewards that measure question quality. Most notably, one of these rewards is the performance of a question-answering system.

To our knowledge, this is the first end-to-end, text-to-text model for question generation.

Our research paper outlines the development of the model, the training used, the results as well as implications and next steps.

Read the paper >

Up Next

Artificial intelligence

Transfer learning for machine reading comprehension

By Xiaodong He, Principal Researcher, Microsoft Research For human beings, reading comprehension is a basic task, performed daily. As early as in elementary school, we can read an article, and answer questions about its key ideas and details. But for AI, full reading comprehension is still an elusive goal–but a necessary one if we’re going […]

Microsoft blog editor

QA model

Artificial intelligence, Human language technologies, Search and information retrieval

A Joint Model for Question Answering and Question Generation

At the Microsoft Research Montreal lab, one of our primary research focuses is to advance the field of Question Answering. Automatic question-answering systems can provide humans with efficient access to vast amounts of information, and the task also acts as an important proxy for assessing machine literacy via reading comprehension. Researchers in psychology have observed that […]

Microsoft blog editor

Artificial intelligence

Creating curious machines: Building information-seeking agents

  Humans have an innate desire to know and understand. From a child learning to ride a bike to an adult gaining skills in an online course, we constantly absorb information from our environment through interaction. Motivated by this observation, we’ve developed a suite of tasks that teach artificial agents how to seek information actively, […]

Microsoft blog editor