Chinese Tradition Inspires Machine Learning Advancements, Product Contributions


Posted by George Thomas Jr.

A new online Chinese riddle game is steeped in more than just tradition. In fact, the machine learning and artificial intelligence that fuels it derives from years of research that also helps drive Bing Search, Bing Translator, the Translator App for Windows Phone, and other products.

Launched in celebration of the Chinese New Year, Microsoft Chinese Character Riddle (opens in new tab) is based on the two-player game unique to Chinese traditional culture and part of the Chinese Lantern Festival (opens in new tab). Developed by the Natural Language Computing Group (opens in new tab) in the Microsoft Research's Beijing lab (opens in new tab), the game not only quickly returns an answer to a user's riddle, but also works in reverse: when a user enters a single Chinese character as the intended answer, the system generates several riddles from which to choose.

Microsoft Research Podcast

Collaborators: Holoportation™ communication technology with Spencer Fowers and Kwame Darko

Spencer Fowers and Kwame Darko break down how the technology behind Holoportation and the telecommunication device being built around it brings patients and doctors together when being in the same room isn’t an easy option and discuss the potential impact of the work.

"These innovations typically embody the strategic thought of Natural Language Processing (opens in new tab) 2.0, which is to collect big data on the Internet, to automatically build AI models using statistical machine learning (opens in new tab) methods, and to involve users in the innovation process by quickly getting their on-line feedback." Says Dr. Ming Zhou (opens in new tab), Group Leader for Natural Language Computing Group and Principal Researcher at Microsoft Research Asia. "Thus the riddle system will continue to improve."

 (opens in new tab)

Riddle: 两相逢在异 (two persons meet in a foreign land)

Answer: (vertical, formed by characters in red)

The riddle system is actually built upon the success of Microsoft Couplet (opens in new tab), launched in 2004, which resulted from a challenge by then lab director Harry Shum (opens in new tab), now Executive Vice President, Technology and Research, who asked Zhou to build a computer that could generate Chinese couplets.

 (opens in new tab)
A challenge between colleagues to build a computer that could solve riddles has led to numerous machine translation advancements and patents. Pictured above is an example of a Chinese couplet.

Couplets are poetry unique to traditional Chinese culture (opens in new tab) and date back thousands of years. Comprised of two phrases or sentences, the challenge of the couplet is to answer the initial statement with one that matches its rhythm, length and context. For example, a response to "Horses gallop to embrace blessings" could be "Goats dance to announce spring."

Zhou, embraced the challenge and designed a novel statistical machine translation-based approach which, over time and with an ever-expanding research team, resulted in the Microsoft Couplets website. The site was especially popular during Chinese New Year, with over 35,000 couplets created by users every day.

While improving the cultural image of Bing in China, the technologies used in couplets generation have also been used to improve statistical machine translation. The machine translation approach to couplets was introduced in the paper, Generating Chinese Couplets using a Statistical MT Approach (opens in new tab) (290 KB .pdf).

See also: Microsoft Translator Team Blog (opens in new tab)

Based on the decade-long, rich experiences of developing Microsoft Couplets, Zhou's group spent 4 months on the new riddle system, which involved a large dose of data mining (opens in new tab) to optimize statistical machine learning methods capable of converting numerous natural language descriptions into specific riddles in Chinese character. The webpage not only displays the riddle answer but also the reasoning process behind it, which could help shape how users think about the riddles.

The team's efforts in machine translation not only generated some 30 patents, but also significant advances in natural language processing, machine learning, and artificial intelligence — mainstream impact in the form of Bing Translator (opens in new tab) (Chinese-English), Bing Search (opens in new tab), Bing Dictionary (opens in new tab), Bing Input Method Editor (IME) (opens in new tab), the Translator App for Windows Phone (opens in new tab) (Chinese-English), sign language translator (opens in new tab), and, circling back to Chinese culture, wildly popular intuitive web-based Chinese couplets and riddle systems. Now, Windows Phone apps for Couplets (opens in new tab) and Riddle (opens in new tab) are both available as free downloads.

"I believe we are the first to solve Chinese character riddle through a computer," Says Zhou, "With Microsoft Couplets and Microsoft Chinese Character Riddle, we hope to help modern Chinese people better inherit and carry on this tradition and cultural legacy through our AI models. It also can be an interesting tool to learn Chinese language."