Introduction to Dual Learning
Many AI tasks are emerged in dual forms, e.g., English-to-French translation vs. French-to-English translation, speech recognition vs. text to speech, question answering vs. question generation, and image classification vs. image generation. While structural duality is common in AI, most learning algorithms have not exploited it in learning/inference. We propose a new learning paradigm, dual learning, which leverages the primal-dual structure of AI tasks to obtain effective feedback or regularization signals to enhance the learning/inference process. Dual learning has been studied in different learning settings, including unsupervised/supervised/semi-supervised/transfer settings, and applied to different applications, including machine translation, sentimental analysis, image classification/generation, question answering/generation …
Tutorial and code
Tutorial on dual learning at ACML 2018
Dual Supervised Learning for image classification/generation and sentiment analysis, [Code@Github]
Yiren Wang, Yingce Xia, Tianyu He, Fei Tian, Tao Qin, ChengXiang Zhai, Tie-Yan Liu, Multi-Agent Dual Learning, ICLR 2019.
Yingce Xia, Xu Tan, Fei Tian, Tao Qin, Nenghai Yu, and Tie-Yan Liu, Model-Level Dual Learning, ICML 2018.
Hany Hassan, Anthony Aue, Chang Chen, Vishal Chowdhary, Jonathan Clark, Christian Federmann, Xuedong Huang, Marcin Junczys-Dowmunt, William Lewis, Mu Li, Shujie Liu, Tie-Yan Liu, Renqian Luo, Arul Menezes, Tao Qin, Frank Seide, Xu Tan, Fei Tian, Lijun Wu, Shuangzhi Wu, Yingce Xia, Dongdong Zhang, Zhirui Zhang, Ming Zhou, Achieving Human Parity on Automatic Chinese to English News Translation, arXiv 2018.
Jianxin Lin, Yingce Xia, Tao Qin, Zhibo Chen, and Tie-Yan Liu, Conditional Image-to-Image Translation, CVPR 2018.
Yijun Wang, Yingce Xia, Li Zhao, Jiang Bian, Tao Qin, Guiquan Liu, and Tie-Yan Liu, Dual Transfer Learning for Neural Machine Translation with Marginal Distribution Regularization, AAAI 2018.
Duyu Tang, Nan Duan, Tao Qin, Zhao Yan, and Ming Zhou, Question Answering and Question Generation as Dual Tasks, arXiv 2017.
Yingce Xia, Tao Qin, Wei Chen, Jiang Bian, Nenghai Yu and Tie-Yan Liu, Dual Supervised Learning, ICML 2017.
Yingce Xia, Jiang Bian, Tao Qin, Tie-Yan Liu, Dual Inference for Machine Learning, IJCAI 2017.
Di He, Yingce Xia, Tao Qin, Liwei Wang, Nenghai Yu, Tie-Yan Liu, and Wei-Ying Ma, Dual Learning for Machine Translation, NIPS 2016.