{"id":558228,"date":"2018-12-26T23:35:08","date_gmt":"2018-12-27T07:35:08","guid":{"rendered":"https:\/\/www.microsoft.com\/en-us\/research\/?post_type=msr-project&#038;p=558228"},"modified":"2022-04-22T03:02:58","modified_gmt":"2022-04-22T10:02:58","slug":"machine-translation-2","status":"publish","type":"msr-project","link":"https:\/\/www.microsoft.com\/en-us\/research\/project\/machine-translation-2\/","title":{"rendered":"Neural Machine Translation"},"content":{"rendered":"<p>We are working on neural machine translation, using deep neural networks for machine translation. We <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/blogs.microsoft.com\/ai\/machine-translation-news-test-set-human-parity\/\">achieved human parity<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> in translating news from Chinese to English.<\/p>\n<p><strong>Our Papers<\/strong><br \/>\nXu Tan, Yi Ren, Di He, Tao Qin, Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/openreview.net\/pdf?id=S1gUsoR9YX\">Multilingual Neural Machine Translation with Knowledge Distillation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>ICLR<\/strong> 2019.<br \/>\nYiren Wang, Fei Tian, Di He, Tao Qin, Chengxiang Zhai, Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/taoqin.github.io\/papers\/nat.reg.AAAI2019.pdf\">Non-Autoregressive Machine Translation with Auxiliary Regularization<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>AAAI<\/strong> 2019.<br \/>\nJunliang Guo, Xu Tan, Di He, Tao Qin, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/taoqin.github.io\/papers\/NAT.enhanced.inputs.AAAI19.pdf\">Non-Autoregressive Neural Machine Translation with Enhanced Decoder Input<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>AAAI<\/strong> 2019.<br \/>\nYingce Xia, Tianyu He, Xu Tan, Fei Tian, Di He, and Tao Qin, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/taoqin.github.io\/papers\/tiedT.AAAI2019.pdf\">Tied Transformers: Neural Machine Translation with Shared Encoder and Decoder<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>AAAI<\/strong> 2019.<br \/>\nTianyu He, Xu Tan, Yingce Xia, Di He, Tao Qin, Zhibo Chen, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/papers.nips.cc\/paper\/8019-layer-wise-coordination-between-encoder-and-decoder-for-neural-machine-translation.pdf\">Layer-Wise Coordination between Encoder and Decoder for Neural Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>NIPS <\/strong>2018.<br \/>\nLijun Wu, Fei Tian, Tao Qin, Jianhuang Lai and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/aclweb.org\/anthology\/D18-1397\">A Study of Reinforcement Learning for Neural Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>EMNLP<\/strong> 2018.<br \/>\nXu Tan, Lijun Wu, Di He, Fei Tian, Tao Qin, Jianhuang Lai, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"http:\/\/aclweb.org\/anthology\/D18-1396\">Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>EMNLP<\/strong> 2018.<br \/>\nLijun Wu, Yingce Xia, Li Zhao, Fei Tian, Tao Qin, Jianhuang Lai, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/arxiv.org\/pdf\/1704.06933\">Adversarial Neural Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>ACML<\/strong> 2018.<br \/>\nHany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, Shujie Liu, Tie-Yan Liu, Renqian Luo, Arul Menezes, Tao Qin, Frank Seide, Xu Tan, Fei Tian, Lijun Wu, Shuangzhi Wu, Yingce Xia, Dongdong Zhang, Zhirui Zhang, Ming Zhou, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/arxiv.org\/abs\/1803.05567\">Achieving Human Parity on Automatic Chinese to English News Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, arXiv 2018.<br \/>\nYanyao Shen, Xu Tan, Di He, Tao QIN, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/arxiv.org\/abs\/1806.00722\">Dense Information Flow for Neural Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>NAACL<\/strong> 2018. [<a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/github.com\/yanyao-shen\/fairseq\">code<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>]<br \/>\nYijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, and Tie-Yan Liu, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/wp-content\/uploads\/2017\/11\/17041-72820-1-SM.pdf\">Dual Transfer Learning for Neural Machine Translation with Marginal Distribution Regularization<\/a>, <strong>AAAI<\/strong> 2018.<br \/>\nDi He, Hanqing Lu, Yingce Xia, Tao Qin, Liwei Wang, and Tie-Yan Liu, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"https:\/\/papers.nips.cc\/paper\/6622-decoding-with-value-networks-for-neural-machine-translation.pdf\">Decoding with Value Networks for Neural Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>NIPS<\/strong> 2017.<br \/>\nDi He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma, <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" target=\"_blank\" href=\"\/\/arxiv.org\/pdf\/1611.00179\"\">Dual Learning for Machine Translation<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, <strong>NIPS<\/strong> 2016.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We are working on neural machine translation, using deep neural networks for machine translation. We achieved human parity in translating news from Chinese to English. Our Papers Xu Tan, Yi Ren, Di He, Tao Qin, Tie-Yan Liu, Multilingual Neural Machine Translation with Knowledge Distillation, ICLR 2019. Yiren Wang, Fei Tian, Di He, Tao Qin, Chengxiang [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","footnotes":""},"research-area":[13556],"msr-locale":[268875],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-558228","msr-project","type-msr-project","status-publish","hentry","msr-research-area-artificial-intelligence","msr-locale-en_us","msr-archive-status-active"],"msr_project_start":"","related-publications":[],"related-downloads":[],"related-videos":[],"related-groups":[705946],"related-events":[],"related-opportunities":[],"related-posts":[680043],"related-articles":[],"tab-content":[],"slides":[],"related-researchers":[{"type":"user_nicename","display_name":"Dongdong Zhang","user_id":31677,"people_section":"Section name 1","alias":"dozhang"},{"type":"guest","display_name":"Haoyang Huang","user_id":742429,"people_section":"Section name 1","alias":""}],"msr_research_lab":[199560],"msr_impact_theme":[],"_links":{"self":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/558228","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project"}],"about":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-project"}],"version-history":[{"count":4,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/558228\/revisions"}],"predecessor-version":[{"id":558249,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/558228\/revisions\/558249"}],"wp:attachment":[{"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/media?parent=558228"}],"wp:term":[{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=558228"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=558228"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=558228"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/www.microsoft.com\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=558228"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}