Portrait of Tao Mei

Tao Mei

Senior Researcher/Research Manager

About

Tao Mei is a Senior Researcher with Microsoft Research Asia. His current research interests include multimedia analysis and understanding, computer vision, and machine learning. He is leading a team working on image and video analysis, vision and language, and multimedia search. Tao has shipped a dozen inventions and technologies to Microsoft products, such as Windows Photo, Bing, Office, Azure, OneDrive, Cognitive Services, Chat Bot, Cognitive Services, etc. He has authored or co-authored over 150 papers in journals and conferences, 10 book chapters, and edited four books. He holds over 50 US and international patents (with 20 granted).

Tao was the recipient of a number of paper awards from prestigious multimedia journals and conferences, including the Best Paper Awards from ACM Trans. on Multimedia Computing, Communications, and Applications (2017),  IEEE Trans. on Circuits and Systems for Video Technology (2014), IEEE Trans. on Multimedia (2013), ACM International Conference on Multimedia (2009 and 2007), and so on. He is or has been an Editorial Board Member of IEEE Trans. on Multimedia (TMM), ACM Trans. on Multimedia Computing, Communications, and Applications (TOMM), IEEE Trans. on Circuits and Systems for Video Technology (TCSVT), and Pattern Recognition (PR). He is the General Co-chair of IEEE ICME 2019, the Program Co-chair of ACM Multimedia 2018, IEEE ICME 2015 and IEEE MMSP 2015, and the Area Chair for a dozen international conferences.

Tao received B.E. and Ph.D. degrees from the University of Science and Technology of China, Hefei, China, in 2001 and 2006, respectively. Tao was elected as a Fellow of IAPR and a Distinguished Scientist of ACM in 2016, for his contributions to large-scale video analysis and applications. He is an IEEE Signal Processing Society Distinguished Industry Speaker (2018-2019).

 

Email: tmei [AT] microsoft [DOT] com; tmei [AT] live [DOT] com

* Updated in Oct 2017.

Projects

Publications

Other

Selected Talks/Tutorials/Keynotes.

  1. Deep Learning for Intelligent Video Analysis,” Tutorial at ACM Multimedia, Oct 2017. (with Cha Zhang)
  2. Vision and Language: Bridging Vision and Language with Deep Learning,” Tutorial at IEEE ICIP, September 2017. (with Jiebo Luo)
  3. “Video Content 3C: Creation, Curation, and Consumption,” Keynote, CCF-GAIR Conference, July 2017.
  4. “Vision and Language,” Keynote, Vision and Learning Seminar (VALSE), Xiamen, April 2017.
  5. “Empowering ChatBot with All-Seeing Eyes,” Data Science Forum, Fudan University, Dec 2016.
  6. Bridging Video and Language with Deep Learning,” Invited Tutorial at ECCV-ACM Multimedia, Amsterdam, The Netherlands, Oct. 2016.
  7. “Empowering ChatBot with All-Seeing Eyes,” Keynote, CCF PhD Forum, Nanjing University, Aug. 2016.
  8. “Video Captioning and Commenting: Bridging Video and Language with Deep Learning,” Keynote, IEEE Signal and Data Science Forum, Wuhan, April 2016.
  9. “Video Captioning: Bridging Video and Language with Deep Learning,” Peking University, Jan. 2016.
  10. “Video Captioning: Bridging Video and Language,” Beijing Jiaotong University, Dec. 2015.
  11. “Video Understanding Meets Deep Learning,” National University of Singapore, Dec. 2015.
  12. “Video Understanding Meets Deep Learning,” National Taiwan University, Nov. 2015.
  13. “Video Understanding Meets Deep Learning,” The Chinese University of Hong Kong, Nov. 2015.
  14. “Video Understanding Meets Deep Learning,” Hong Kong University of Science and Technology, Nov. 2015.
  15. “When Multimedia Information Retrieval Meets Big User Data,” Yonsei University, Seoul, Korea, May 2015.
  16. “When Multimedia Information Retrieval Meets Big User Data,” Seoul National University, Seoul, Korea, May 2015.
  17. “User-Centric Social Multimedia Analysis,” Academia Sinica, Taipei, Dec. 2014.
  18. “Social Multimedia as Sensors,” Tutorial at IEEE ICDM (together with Jiebo Luo), 2014.
  19. “User-Centric Social Multimedia Analysis,” City University of Hong Kong, Oct. 2014.
  20. “User-Centric Social Multimedia Analysis,” International Symposium on Social Multimedia Computing, Chinese Academy of Sciences, Beijing, China, Sept., 2014.
  21. “User-Centric Social Multimedia Analysis,” Keynote, iDB workshop, Fukuoka, Japan, Aug. 2014.
  22. “Social Multimedia as Sensors,” Tutorial in IEEE ICME, Chengdu, China, July 2014. (with Jiebo Luo)
  23. “Social Multimedia Recommendation with Deep Understanding of Users,” Nanyang Technological University, Singapore, Jan. 2014.
  24. “Deep Understanding of Users for Socio-Mobile Recommendation,” National Taiwan University, July 2013.
  25. “Deep Understanding of Users for Socio-Mobile Recommendation,” Keynote, NLPR Forum, Institute of Automation of Chinese Academy of Sciences, Beijing, March 2013.
  26. “User-Centric Multimedia Analysis: Opportunities from Cloud and Client,” Keynote, YOCSEF Forum, Fudan University, Shanghai, Nov. 2012.
  27. “Understanding Users from Large Scale Social Media Data,” NII Shonan Meeting on the Future of Multimedia Analysis and Mining, Shonan Village, Japan, Nov. 2012.
  28. “Understanding Users from Large Scale Social Media,” International Workshop on Vision, Learning and Cognition, Institute of Automation of Chinese Academy of Sciences, Beijing, Aug. 2012.
  29. “Empowering Cross-domain Internet Media with Real-time Topic Learning from Social Streams.” Mini-panel in IEEE ICME, Melbourne, Australia, July 2012.
  30. “Understanding Users from Social Media,” Tutorial, IEEE Signal Processing Seasonal School, Sydney, Australia, July 2012.
  31. “Mobile Recommendation: Contextual and Personalized Local Business Recommendation.” The University of Queensland, Brisbane, Australia, July 2012.
  32. “Mobile Recommendation: Contextual and Personalized Local Business Recommendation.” Queensland University of Technology, Brisbane, Australia, July 2012.
  33. “Contextual Online Multimedia Advertising.” University of Technology Sydney, Sydney, Australia, July 2012.
  34. “Contextual Online Multimedia Advertising.” Industry Practitioner Day Talk, International Conference on Multimedia Retrieval (ICMR), Hong Kong, June 2012.
  35. “Mobile Recommendation and Visual Search: Towards Understanding User Intent On-the-Go.” Keynote, Vision and Learning Seminar (VALSE), Xi’an, China, April 2012.
  36. “Contextual Online Multimedia Advertising.” Tutorial in ACM Internaltional Conference on Multimedia, Scottsdale, AZ, USA, Nov. 2011.
  37. “Contextual Internet Multimedia Advertising.” National University of Singapore, Singapore, July 2010.
  38. “Multimedia Advertising.” Korean Advanced Institute of Science and Technology, Daejeon, Korea, Nov. 2008.

Services

Selected Services

Editorial Board Member

Technical Committee Member

Guest Editor

Conference Chair

Organizing Committee Member

  • Tutorial Co-chairs, IEEE International Conference on Image Processing (ICIP), Taipei, 2019.
  • Open Source Software Competition Co-chair, ACM International Conference on Multimedia (ACM MM), Amsterdam, The Netherland, 2016.
  • Open Source Software Competition Co-chair, ACM International Conference on Multimedia (ACM MM), Brisbane, Australia, 2015.
  • Workshop Co-chair, IEEE International Conference on Multimedia & Expo (ICME), 2014.
  • Video Program Co-chair, ACM International Conference on Multimedia (ACM MM), Nara, Japan, 2012.
  • Workshop Co-chair, IEEE International Conference on Multimedia & Expo (ICME), 2012.
  • Travel Grants Co-chair, ACM International Conference on Multimedia (ACM MM), Scottsdale, Arizona, 2011.

Selected Technical Program Committee (TPC) Members and Area Chairs 

  • IAPR International Conference on Pattern Recognition (ICPR), Area Chair [2016].
  • ACM International Conference on Multimedia (ACM MM), Area Chair [2010, 2012, 2013, 2015, 2017], TPC Member [2011, 2014, 2016].
  • IEEE International Conference on Multimedia & Expo (ICME), Area Chair [2013, 2014, 2016, 2017, 2018], TPC Member [2009, 2010, 2011, 2012].
  • ACM International Conference on Information and Knowledge Management (CIKM), Area Chair [2014].
  • IEEE International Symposium on Circuits and Systems (ISCAS), Area Chair [2016, 2017].
  • IEEE International Conference on Image Processing (ICIP), Area Chair [2015, 2016, 2018].
  • IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), TPC Member [2009, 2011, 2013, 2014, 2015, 2016, 2017, 2018].
  • IEEE International Conference on Computer Vision (ICCV), TPC Member [2013, 2015, 2017].
  • International Joint Conference on Artificial Intelligence (IJCAI), TPC Member [2015, 2016, 2017].
  • ACM International Conference on Research and Development in Information Retrieval (SIGIR), TPC Member [2010-2017].
  • Pacific-Rim Conference on Multimedia (PCM), Area Chair (2012), TPC Member [2007~2011].
  • IEEE International Workshop on Multimedia Signal Processing (MMSP), TPC Member [2008~2017].

Fellow of IAPR (2016).

Distinguished Scientist of ACM (2016).

Distinguished Industry Speaker of IEEE SPS (2018-2019).

Senior Member of IEEE (since 2011), and CCF (since 2015).

Awards

  • IEEE Signal Processing Society Distinguished Industry Speaker, 2018-2019.
  • Nicolas D. Georganas Best Paper Award, ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 2017. “Automatic Generation of Visual-Textual Presentation Layout,” with Xuyong Yang, Ying-Qing Xu, Yong Rui, and Shipeng Li.
  • Rank 1 in the Dense-Captioning Events in Videos (ActivityNet Captions), July 2017, with Ting Yao, Yingwei Pan, Yehao Li, Zhaofan Qiu, Fuchen Long, et al.
  • Fellow of IAPR, for contributions to large-scale video analysis, understanding, and applications, 2016.
  • Distinguished Scientist of ACM, for contributions in large-scale video analysis, 2016.
  • Rank 1 in the COCO Image Captioning Challenge, July 2016, with Ting Yao, Yingwei Pan, Yehao Li, et al.
  • Best Paper Finalist, ACM International Conference on Multimedia Retrieval (ICMR), 2016. “Action Recognition by Learning Deep Multi-Granular Spatio-Temporal Video Representation,” with Qing Li, Zhaofan Qiu, Ting Yao, Jiebo Luo, and Yong Rui.
  • Microsoft Stock Award, 2016.
  • IEEE Communications Society MMTC Best Journal Paper Award, 2015. “Towards Cross-Domain Learning for Social Video Popularity Prediction,” IEEE Trans. on Multimedia, with Suman Deb Roy, Wenjun Zeng, and Shipeng Li.
  • Best Associate Editor Award of Multimedia Systems, 2014.
  • Best Paper Award, IEEE Circuits and Systems Society Circuits and Systems for Video Technology (TCSVT),  2014. “Contextual Bag-of-Words for Visual Categorization,” with Teng Li, In So Kweon, Xian-Sheng Hua.
  • Microsoft Spot Award, 2014.
  • Prize Paper Award, IEEE Transactions on Multimedia (TMM), 2013. “Video Annotation Through Search and Graph Reinforcement Mining,” with Emily Moxley, Bangalore S. Manjunath.
  • Best Student Paper Award, IEEE International Conference on Visual Communications and Image Processing (VCIP), 2012. “Assessing Photo Quality with Geo-context and Crowdsourced Photos,” with Wenyuan Yin and Chang Wen Chen.
  • Best Paper Finalist, “Finding Perfect Rendezvous On the Go: Accurate Mobile Visual Localization and Its Applications to Routing,” ACM International Conference on Multimedia (ACM MM), 2012, with Heng Liu, Jiebo Luo, Houqiang Li, and Shipeng Li.
  • Best Paper Award, “AMIGO: Accurate Mobile Image Geotagging”, ACM International Conference on Internet Multimedia Computing and Service (ICIMCS),  2012, with Xiaobin Xu, Wenjun Zeng, Nenghai Yu, and Jiebo Luo.
  • Top 10% Paper Award, “Interactive Mobile Visual Search for Social Activities Completion Using Query Image Contextual Model,” IEEE International Workshop on Multimedia Signal Processing (MMSP), 2012, with Ning Zhang, Xian-Sheng Hua, Ling Guan, and Shipeng Li.
  • “Circle to Search”, Microsoft Research Technology Transfer Award, Microsoft, 2012.
  • Outstanding Service Award, IEEE International Conference on Multimedia and Expo, 2012.
  • “Query Entity Extraction”, Microsoft Research Technology Transfer Award, Microsoft, 2010.
  • “Lasso”, Microsoft Research Technology Transfer Award, Microsoft, 2010.
  • Gold Star Award, Microsoft, 2010.
  • The Best Papers of ThinkWeek, Microsoft, 2009.
  • Best Paper Award, “Visual Query Suggestion“, ACM International Conference on Multimedia (ACM MM), 2009, with Zheng-Jun Zha, Linjun Yang, Meng Wang, and Zengfu Wang.
  • Best Poster Paper Award, “When Multimedia Advertising Meets the New Internet Era,” IEEE International Workshop on Multimedia Signal Processing (MMSP), 2008, with Xian-Sheng Hua and Shipeng Li.
  • Best Paper Award, “Correlative Multi-Label Video Annotation,” ACM International Conference on Multimedia (ACM MM), 2007, with Guo-Jun Qi, Xian-Sheng Hua, Yong Rui, Jinhui Tang, and Hong-Jiang Zhang.
  • Rank 1 in automatic video search task at TRECVID evaluation, 2007.
  • Best Demo Award, “Video Collage,” ACM International Conference on Multimedia (ACM MM), 2007, with Xueliang Liu, Xian-Sheng Hua, Bo Yang, and He-Qin Zhou.
  • President Scholarship of the Chinese Academy of Sciences, 2006.
  • Microsoft Fellowship Award (18/Asia), Microsoft Research Asia, 2002.

Patents

20 granted US patents, 50+ filed applications.