Microsoft Research Blog

The Microsoft Research blog provides in-depth views and perspectives from our researchers, scientists and engineers, plus information about noteworthy events and conferences, scholarships, and fellowships designed for academic and scientific communities.

At Microsoft Research Asia, artificial intelligence is informing, and informed by, the human experience

November 5, 2015 | By Microsoft blog editor

Posted by Allison Linn

Artificial intelligence and the human experience

Hsiao Wuen-Hon, corporate vice president in charge of Microsoft Research Asia, demonstrates XiaoIce at the 21st Century Computing Conference in Beijing.

When most people use automated speech recognition technology today, it’s because they have a task that needs to get done: A person to call, directions to get, a quick text to send.

In China, millions of people are using this type of natural language processing in a much more human way: To carry on a casual conversation with a Microsoft technology called XiaoIce.

Hsiao-Wuen Hon, corporate vice president in charge of Microsoft Research Asia, sees XiaoIce as an example of the vast possibility that artificial intelligence holds — not to replace human tasks and experiences, but rather to augment them. This way in which advanced technology is increasingly being used to create very human experiences is just beginning, he noted.

“We’ve just barely scratched the surface,” he said.

Hon recently joined some of the world’s leading computer scientists at the 21st Century Computing Conference in Beijing, an annual meeting of researchers and computer science students, to discuss some of these emerging trends.

Microsoft Research Asia has been hosting the conference since 1999, as a way to give young and promising computer scientists in Asia Pacific the opportunity to meet and talk with some of the world’s most renowned computer scientists. This year alone, the conference included two Turing Award winners.

Artificial intelligence was one of the hottest topics at the conference, because of the recent, major advances in these technologies that can see, hear, speak and even understand. It’s also one of the primary focuses of Microsoft’s research lab in China, where more than 230 researchers are doing cutting-edge research in areas including natural user interfaces and next-generation multimedia.

The lab’s researchers have contributed key elements of many products that consumers use today, including the real-time translation tool Skype Translator and products such as Windows, Office, Bing, Xbox, Kinect and Windows Phone, in collaboration with other Microsoft research labs and groups.

Peter Lee, the Microsoft corporate vice president whose responsibilities include overseeing Microsoft Research Asia, said efforts like Skype Translator have been part of Microsoft Research’s strategy of aligning research around a specific goal they want to accomplish.

“How can we eliminate the language barrier for all people on the Internet, by using Skype? That’s a goal and it’s very, very exciting,” he said.

Big bets and concrete accomplishments

The Asia lab’s researchers also are looking much further into the future, at tools that may seem outlandish today but that we could take for granted in years to come.

Lee noted that it is both important and alluring to do research that goes directly into products consumers use immediately, such as Skype Translator. But, he said, a research lab also needs to be thinking about bigger, bolder bets that may not pay off immediately but could change the world in the future.

Peter Lee addresses the 21st Century Computing Conference

Peter Lee, corporate vice president for Microsoft Research, discusses the future of computing at the 21st Century Computing Conference in Beijing.

He noted that many of the world’s most important technological innovations, including the personal computer and the transistor, came out of corporate research labs. One challenge is that people don’t always immediately recognize how important an innovation is, and only see its importance a few years down the line.

“Sometimes I wonder if Microsoft Research has already invented the idea that will change the world, but we just don’t know it yet,” he told journalists at the 21st Century Computing Conference.

A more personalized search engine

That’s why researchers at the Asia lab are looking at both near- and long-term implications of the work they are doing.

Take XiaoIce, for example. The fact that so many Chinese people like to talk to her – about their day at work, the weather or current events – makes Hon think that, in the future, speech recognition technology could be used to make all sorts of tools more personalized and more human.

Think of a search engine that worked more like XiaoIce. Instead of just typing a phrase into a box, Hon envisions a world in which the search engine is more like a personal assistant you have a conversation with.

“The search engine could change into more like your chatting buddy,” Hon said.

The buddy would do research for you and offer opinions, and it would be human-like in other ways as well, he said. For example, the chatbot could remember your search chat for the next few days and send you additional information as it becomes available.

And, just like most people have many human contacts with different areas of expertise, you might have multiple chatbots who are experts in various topics, like medicine, cooking or hiking. You also might choose to take the chatbot’s advice, or ignore it and seek out another chatbot for additional perspectives.

An invisible revolution

The advances in speech recognition and natural language processing are part of what Harry Shum, Microsoft’s executive vice president in charge of technology and research, calls the “invisible revolution” in technological progress.

Until now, many of the biggest leaps in technology have come from faster computers and better gadgets. But in the coming years, Shum says, many of those new discoveries will instead come from tools that you use but don’t necessarily see. Those include cloud computing systems that can analyze vast amounts of data in a just a few minutes and productivity tools that can use machine learning, in which systems get smarter as they amass more data, to better understand and anticipate people’s needs.

In China, Hon said he’s already seeing that revolution take place with tools such as face recognition technology.

Researchers and other Microsoft employees in China recently partnered with a leading non-governmental organization to use face recognition technology to help locate missing children. The Photo Missing Children project uses face recognition technology from a suite of tools called Project Oxford to help the organization recognize and find children.

Hon expects to see many more of these types of tools in years to come, and he said those will come more quickly because of recent, major advances in artificial intelligence and the related fields of machine learning and big data analysis.

Thanks to these tools, researchers can now analyze larger amounts of data much more quickly, and then use that data to train systems to do complex tasks. That will help everyone from company executives who want to better understand sales trends to teenagers who want to accurately dictate texts in loud rooms.

“Why are artificial intelligence and machine learning and big data so exciting?” Hon asked. “Because it touches everything we do.”


Allison Linn is a senior writer at Microsoft Research. Follow Allison on Twitter.

Up Next

Artificial intelligence

Celebrating 20 years of MSR in Asia with Dr. Hsiao-Wuen Hon

Episode 49, November 7, 2018 - Dr. Hon gives us a brief history of Microsoft Research Asia, from its humble beginnings to its significant role in the AI boom today, talks about Microsoft Research Asia’s unique talent pipeline, shares his vision for the complementary roles of machine intelligence and human wisdom, and explains why, he believes, the more progress we make in AI, the better we understand ourselves.

Microsoft blog editor

Two guys writing equations on a window in Asia

Artificial intelligence, Graphics and multimedia, Human language technologies

Growing a generation of computer scientists – Microsoft Research Asia at 20 and going beyond technical achievement

Microsoft Research Asia celebrates its 20th anniversary this year, and the milestone provided an occasion for many in the industry to reflect on an amazing journey, one not only replete with excellence and technological achievement, but also significant in its profound influence as it cultivated a generation of computer scientists and engineers, catalyzed collaboration between […]

Microsoft blog editor

Artificial intelligence, Search and information retrieval

Microsoft Research Montreal welcomes Fernando Diaz, Principal Researcher and lead of the new Montreal FATE Research Group

Microsoft Research Montreal further bolsters its research force this month, welcoming Fernando Diaz to the Montreal FATE (Fairness, Accountability, Transparency and Ethics in AI) research group as Principal Researcher. Diaz, whose research area is the design of information access systems, including search engines, music recommendation services and crisis response platforms is particularly interested in understanding […]

Microsoft blog editor