LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
Xiaofan Wang, Xingyu Gao, Jianlong Fu, Zuolei Li, Dean Fortier, Galen Mullins, Andrey Kolobov, Baining Guo
December 2025
Jianlong Fu
Principal Research Manager
出版物
-
-
-
TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
Hokyun Im, Euijin Jeong, Andrey Kolobov, Jianlong Fu, Youngwoon Lee
November 2025
-
-
-
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
November 2024
-
PromptFix: You Prompt and We Fix the Photo
Yongsheng Yu, Ziyun Zeng, Hang Hua, Jianlong Fu, Jiebo Luo
NeurIPS 2024 | May 2024
-
Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu
CVPR 2024 | March 2024
-
-
-
Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
ArXiv | May 2023, 巻abs/2305.15357
-
-
-
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
-
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
-
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
-
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
-
MiniViT: Compressing Vision Transformers with Weight Multiplexing
Jinnian Zhang, Houwen Peng, Kan Wu, Mengchen Liu, Bin Xiao, Jianlong Fu, Lu Yuan
CVPR 2022 | May 2022
-
-
-
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
-
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
NeurIPS 2021 | December 2021
-
Searching the Search Space of Vision Transformer
Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
NeurIPS 2021 | December 2021
-
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
-
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
-
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
-
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
-
AutoFormer: Searching Transformers for Visual Recognition
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
ICCV 2021 | October 2021
-
Learning Spatio-Temporal Transformer for Visual Tracking
Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu
ICCV 2021 | October 2021
-
Rethinking and Improving Relative Position Encoding for Vision Transformer
Kan Wu, Houwen Peng, Minghao Chen, Jianlong Fu, Hongyang Chao
ICCV 2021 | October 2021
-
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
-
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, 巻30: pp. 6637-6647
-
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
-
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Bin Yan, Houwen Peng, Kan Wu, Dong Wang, Jianlong Fu, Huchuan Lu
CVPR 2021 | June 2021
-
One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
CVPR 2021 | June 2021
-
-
-
Aesthetic-Aware Image Style Transfer
ACM Multimedia | October 2020
-
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search
Houwen Peng, Hao Du, Hongyuan Yu, Qi Li, Jianlong Fu
NeurIPS 2020 | October 2020
編集者: Houwen Peng, Jianlong Fu
-
Learning Semantic-aware Normalization for Generative Adversarial Networks
NeurIPS 2020 | October 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Yanhong Zeng, Jianlong Fu, Hongyang Chao
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Ocean: Object-aware Anchor-free Tracking
Zhipeng Zhang, Houwen Peng, Jianlong Fu, Bing Li, Weiming Hu
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
ECCV | July 2020
-
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
-
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Microsoft による投稿
-
-
-
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
-
WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
ICCV | October 2019
-
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
CVPR | July 2019
編集者: Yanhong Zeng, Jianlong Fu,Hongyang Chao, Baining Guo
-
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
-
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Microsoft による投稿
CVPR 2019, VQA Workshop
-
-
-
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo
Conference on Empirical Methods in Natural Language Processing | October 2018
-
What Dress Fits Me Best? Fashion Recommendation on the Clothing Style for Personal Body Shape
Shintami Chusnul Hidayati, Jianlong Fu, Wen-Huang Cheng
ACM International Conference on Multimedia (ACM Multimedia) | October 2018
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Deep Attention Neural Tensor Network for Visual Question Answering
Yalong Bai, Jianlong Fu, Tiejun Zhao, Tao Mei
European Conference on Computer Vision | September 2018
-
DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks
Shuang Ma, Jianlong Fu, ChangWen Chen, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | June 2018
-
Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
-
Self-view Grounding Given a Narrated 360 Video
Shih-Han Chou, Jianlong Fu, Min Sun
AAAI Conference on Artificial Intelligence | February 2018
-
-
-
Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition (ICCV 2017 Oral)
Heliang Zheng, Jianlong Fu, Tao Mei, Jiebo Luo
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Searching Personal Photos on the Phone with Instant Visual Qery Suggestion and Joint Text-Image Hashing
Zhaoyang Zeng, Jianlong Fu, Hongyang Chao, Tao Mei
ACM International Conference on Multimedia (ACM Multimedia) | October 2017
-
Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
Tseng-Hung Chen, Jianlong Fu, Min Sun
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Advances in deep learning approaches for image tagging
Jianlong Fu, Yong Rui
APSIPA Transactions on Signal and Information Processing | October 2017
-
Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-grained Image Recognition (CVPR 2017 Oral)
Jianlong Fu (jianf), Heliang Zheng, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Multi-level Attention Networks for Visual Question Answering
Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Let Your Photos Talk: Generating Narrative Paragraph for Photo Stream via Bidirectional Attention Recurrent Neural Networks
Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen
February 2017
-
-
-
Beyond Object Recognition: Visual Sentiment Analysis with Deep Coupled Adjective and Noun Neural Networks
Jingwen Wang, Jianlong Fu, Yong Xu, Tao Mei
International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
-
-
-
Relaxing from Vocabulary: Robust Weakly-Supervised Deep Learning for Vocabulary-Free Image Tagging
Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, Yong Rui
December 2015
-
Tagging Personal Photos with Transfer Deep Learning
Jianlong Fu, Tao Mei, Kuiyuan Yang, Hanqing Lu, Yong Rui
International World Wide Web conference (WWW) | May 2015
-
-
-
LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
Xiaofan Wang, Xingyu Gao, Jianlong Fu, Zuolei Li, Dean Fortier, Galen Mullins, Andrey Kolobov, Baining Guo
December 2025
-
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
November 2024
-
PromptFix: You Prompt and We Fix the Photo
Yongsheng Yu, Ziyun Zeng, Hang Hua, Jianlong Fu, Jiebo Luo
NeurIPS 2024 | May 2024
-
Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu
CVPR 2024 | March 2024
-
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
-
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
-
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
-
MiniViT: Compressing Vision Transformers with Weight Multiplexing
Jinnian Zhang, Houwen Peng, Kan Wu, Mengchen Liu, Bin Xiao, Jianlong Fu, Lu Yuan
CVPR 2022 | May 2022
-
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
-
Searching the Search Space of Vision Transformer
Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
NeurIPS 2021 | December 2021
-
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
NeurIPS 2021 | December 2021
-
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
-
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
-
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
-
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
-
AutoFormer: Searching Transformers for Visual Recognition
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
ICCV 2021 | October 2021
-
Learning Spatio-Temporal Transformer for Visual Tracking
Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu
ICCV 2021 | October 2021
-
Rethinking and Improving Relative Position Encoding for Vision Transformer
Kan Wu, Houwen Peng, Minghao Chen, Jianlong Fu, Hongyang Chao
ICCV 2021 | October 2021
-
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
-
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, 巻30: pp. 6637-6647
-
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
-
One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
CVPR 2021 | June 2021
-
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Bin Yan, Houwen Peng, Kan Wu, Dong Wang, Jianlong Fu, Huchuan Lu
CVPR 2021 | June 2021
-
Ocean: Object-aware Anchor-free Tracking
Zhipeng Zhang, Houwen Peng, Jianlong Fu, Bing Li, Weiming Hu
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Yanhong Zeng, Jianlong Fu, Hongyang Chao
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
ECCV | July 2020
-
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
-
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Microsoft による投稿
-
WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
ICCV | October 2019
-
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
CVPR | July 2019
編集者: Yanhong Zeng, Jianlong Fu,Hongyang Chao, Baining Guo
-
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Microsoft による投稿
CVPR 2019, VQA Workshop
-
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo
Conference on Empirical Methods in Natural Language Processing | October 2018
-
What Dress Fits Me Best? Fashion Recommendation on the Clothing Style for Personal Body Shape
Shintami Chusnul Hidayati, Jianlong Fu, Wen-Huang Cheng
ACM International Conference on Multimedia (ACM Multimedia) | October 2018
-
Deep Attention Neural Tensor Network for Visual Question Answering
Yalong Bai, Jianlong Fu, Tiejun Zhao, Tao Mei
European Conference on Computer Vision | September 2018
-
DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks
Shuang Ma, Jianlong Fu, ChangWen Chen, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | June 2018
-
Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
-
Self-view Grounding Given a Narrated 360 Video
Shih-Han Chou, Jianlong Fu, Min Sun
AAAI Conference on Artificial Intelligence | February 2018
-
Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
Tseng-Hung Chen, Jianlong Fu, Min Sun
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Searching Personal Photos on the Phone with Instant Visual Qery Suggestion and Joint Text-Image Hashing
Zhaoyang Zeng, Jianlong Fu, Hongyang Chao, Tao Mei
ACM International Conference on Multimedia (ACM Multimedia) | October 2017
-
Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition (ICCV 2017 Oral)
Heliang Zheng, Jianlong Fu, Tao Mei, Jiebo Luo
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Advances in deep learning approaches for image tagging
Jianlong Fu, Yong Rui
APSIPA Transactions on Signal and Information Processing | October 2017
-
Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-grained Image Recognition (CVPR 2017 Oral)
Jianlong Fu (jianf), Heliang Zheng, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Multi-level Attention Networks for Visual Question Answering
Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Let Your Photos Talk: Generating Narrative Paragraph for Photo Stream via Bidirectional Attention Recurrent Neural Networks
Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen
February 2017
-
Beyond Object Recognition: Visual Sentiment Analysis with Deep Coupled Adjective and Noun Neural Networks
Jingwen Wang, Jianlong Fu, Yong Xu, Tao Mei
International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
-
Relaxing from Vocabulary: Robust Weakly-Supervised Deep Learning for Vocabulary-Free Image Tagging
Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, Yong Rui
December 2015
-
Tagging Personal Photos with Transfer Deep Learning
Jianlong Fu, Tao Mei, Kuiyuan Yang, Hanqing Lu, Yong Rui
International World Wide Web conference (WWW) | May 2015
-
-
-
TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
Hokyun Im, Euijin Jeong, Andrey Kolobov, Jianlong Fu, Youngwoon Lee
November 2025
-
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
November 2024
-
Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
ArXiv | May 2023, 巻abs/2305.15357
-
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
-
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
-
Learning Semantic-aware Normalization for Generative Adversarial Networks
NeurIPS 2020 | October 2020
-
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search
Houwen Peng, Hao Du, Hongyuan Yu, Qi Li, Jianlong Fu
NeurIPS 2020 | October 2020
編集者: Houwen Peng, Jianlong Fu
-
Aesthetic-Aware Image Style Transfer
ACM Multimedia | October 2020
-
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Microsoft による投稿
-
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
-
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Microsoft による投稿
CVPR 2019, VQA Workshop
-
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
-
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo
Conference on Empirical Methods in Natural Language Processing | October 2018
-
What Dress Fits Me Best? Fashion Recommendation on the Clothing Style for Personal Body Shape
Shintami Chusnul Hidayati, Jianlong Fu, Wen-Huang Cheng
ACM International Conference on Multimedia (ACM Multimedia) | October 2018
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Deep Attention Neural Tensor Network for Visual Question Answering
Yalong Bai, Jianlong Fu, Tiejun Zhao, Tao Mei
European Conference on Computer Vision | September 2018
-
DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks
Shuang Ma, Jianlong Fu, ChangWen Chen, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | June 2018
-
Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
-
Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-grained Image Recognition (CVPR 2017 Oral)
Jianlong Fu (jianf), Heliang Zheng, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Multi-level Attention Networks for Visual Question Answering
Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Relaxing from Vocabulary: Robust Weakly-Supervised Deep Learning for Vocabulary-Free Image Tagging
Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, Yong Rui
December 2015
-
-
-
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
November 2024
-
-
-
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
-
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
-
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
-
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
-
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
-
Self-view Grounding Given a Narrated 360 Video
Shih-Han Chou, Jianlong Fu, Min Sun
AAAI Conference on Artificial Intelligence | February 2018
-
Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
Tseng-Hung Chen, Jianlong Fu, Min Sun
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Searching Personal Photos on the Phone with Instant Visual Qery Suggestion and Joint Text-Image Hashing
Zhaoyang Zeng, Jianlong Fu, Hongyang Chao, Tao Mei
ACM International Conference on Multimedia (ACM Multimedia) | October 2017
-
Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition (ICCV 2017 Oral)
Heliang Zheng, Jianlong Fu, Tao Mei, Jiebo Luo
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Advances in deep learning approaches for image tagging
Jianlong Fu, Yong Rui
APSIPA Transactions on Signal and Information Processing | October 2017
-
Let Your Photos Talk: Generating Narrative Paragraph for Photo Stream via Bidirectional Attention Recurrent Neural Networks
Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen
February 2017
-
Beyond Object Recognition: Visual Sentiment Analysis with Deep Coupled Adjective and Noun Neural Networks
Jingwen Wang, Jianlong Fu, Yong Xu, Tao Mei
International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
-
Relaxing from Vocabulary: Robust Weakly-Supervised Deep Learning for Vocabulary-Free Image Tagging
Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, Yong Rui
December 2015
-
Tagging Personal Photos with Transfer Deep Learning
Jianlong Fu, Tao Mei, Kuiyuan Yang, Hanqing Lu, Yong Rui
International World Wide Web conference (WWW) | May 2015
-
-
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
-
-
LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
Xiaofan Wang, Xingyu Gao, Jianlong Fu, Zuolei Li, Dean Fortier, Galen Mullins, Andrey Kolobov, Baining Guo
December 2025
-
CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
November 2024
-
-
-
TwinVLA: Data-Efficient Bimanual Manipulation with Twin Single-Arm Vision-Language-Action Models
Hokyun Im, Euijin Jeong, Andrey Kolobov, Jianlong Fu, Youngwoon Lee
November 2025
-
-
-
PromptFix: You Prompt and We Fix the Photo
Yongsheng Yu, Ziyun Zeng, Hang Hua, Jianlong Fu, Jiebo Luo
NeurIPS 2024 | May 2024
-
Zero-Reference Low-Light Enhancement via Physical Quadruple Priors
Wenjing Wang, Huan Yang, Jianlong Fu, Jiaying Liu
CVPR 2024 | March 2024
-
MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
arXiv | December 2022
-
Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
NeurIPS 2022 | November 2022
-
Learning Trajectory-Aware Transformer for Video Super-Resolution
Chengxu Liu, Huan Yang, Jianlong Fu, Xueming Qian
CVPR 2022 | June 2022
Oral
-
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
CVPR 2022 | June 2022
-
MiniViT: Compressing Vision Transformers with Weight Multiplexing
Jinnian Zhang, Houwen Peng, Kan Wu, Mengchen Liu, Bin Xiao, Jianlong Fu, Lu Yuan
CVPR 2022 | May 2022
-
Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers
Yanhong Zeng, Huan Yang, Hongyang Chao, Jianbo Wang, Jianlong Fu
NeurIPS 2021 | December 2021
-
Searching the Search Space of Vision Transformer
Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
NeurIPS 2021 | December 2021
-
Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
NeurIPS 2021 | December 2021
-
Learning Fine-Grained Motion Embedding for Landscape Animation
Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
ACM Multimedia 2021 | October 2021
Oral
-
A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
ACM Multimedia 2021 | October 2021
-
Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment
Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo
ICCV 2021 | October 2021
-
Domain-Aware Universal Style Transfer
Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun
ICCV 2021 | October 2021
-
AutoFormer: Searching Transformers for Visual Recognition
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
ICCV 2021 | October 2021
-
Learning Spatio-Temporal Transformer for Visual Tracking
Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu
ICCV 2021 | October 2021
-
Rethinking and Improving Relative Position Encoding for Vision Transformer
Kan Wu, Houwen Peng, Minghao Chen, Jianlong Fu, Hongyang Chao
ICCV 2021 | October 2021
-
MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
ICMR 2021 | August 2021
-
Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
CVPR 2021 | June 2021
Oral
-
One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking
Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling
CVPR 2021 | June 2021
-
LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search
Bin Yan, Houwen Peng, Kan Wu, Dong Wang, Jianlong Fu, Huchuan Lu
CVPR 2021 | June 2021
-
Learning Semantic-aware Normalization for Generative Adversarial Networks
NeurIPS 2020 | October 2020
-
Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search
Houwen Peng, Hao Du, Hongyuan Yu, Qi Li, Jianlong Fu
NeurIPS 2020 | October 2020
編集者: Houwen Peng, Jianlong Fu
-
Aesthetic-Aware Image Style Transfer
ACM Multimedia | October 2020
-
Ocean: Object-aware Anchor-free Tracking
Zhipeng Zhang, Houwen Peng, Jianlong Fu, Bing Li, Weiming Hu
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
Yanhong Zeng, Jianlong Fu, Hongyang Chao
16th European Conference Computer Vision (ECCV 2020) | August 2020
-
Learning Joint Spatial-Temporal Transformations for Video Inpainting
ECCV | July 2020
-
Learning Texture Transformer Network for Image Super-Resolution
Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, Baining Guo
CVPR 2020 | June 2020
-
Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
ACM Multimedia | October 2019
-
WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
ICCV | October 2019
-
Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting
CVPR | July 2019
編集者: Yanhong Zeng, Jianlong Fu,Hongyang Chao, Baining Guo
-
Emotion Reinforced Visual Storytelling
Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
ICMR | June 2019
-
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo
Conference on Empirical Methods in Natural Language Processing | October 2018
-
What Dress Fits Me Best? Fashion Recommendation on the Clothing Style for Personal Body Shape
Shintami Chusnul Hidayati, Jianlong Fu, Wen-Huang Cheng
ACM International Conference on Multimedia (ACM Multimedia) | October 2018
-
Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
2018 ACM Multimedia | October 2018
Best Paper Award
-
Deep Attention Neural Tensor Network for Visual Question Answering
Yalong Bai, Jianlong Fu, Tiejun Zhao, Tao Mei
European Conference on Computer Vision | September 2018
-
DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks
Shuang Ma, Jianlong Fu, ChangWen Chen, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | June 2018
-
Show, Reward and Tell: Automatic Generation of Narrative Paragraph from Photo Stream by Adversarial Training
Jing Wang, Jianlong Fu, Jinhui Tang, Zechao Li, Tao Mei
The AAAI Conference on Artificial Intelligence (AAAI), 2018. | February 2018
-
Self-view Grounding Given a Narrated 360 Video
Shih-Han Chou, Jianlong Fu, Min Sun
AAAI Conference on Artificial Intelligence | February 2018
-
Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner
Tseng-Hung Chen, Jianlong Fu, Min Sun
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Searching Personal Photos on the Phone with Instant Visual Qery Suggestion and Joint Text-Image Hashing
Zhaoyang Zeng, Jianlong Fu, Hongyang Chao, Tao Mei
ACM International Conference on Multimedia (ACM Multimedia) | October 2017
-
Learning Multi-Attention Convolutional Neural Network for Fine-Grained Image Recognition (ICCV 2017 Oral)
Heliang Zheng, Jianlong Fu, Tao Mei, Jiebo Luo
IEEE International Conference on Computer Vision (ICCV) | October 2017
-
Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-grained Image Recognition (CVPR 2017 Oral)
Jianlong Fu (jianf), Heliang Zheng, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Multi-level Attention Networks for Visual Question Answering
Dongfei Yu, Jianlong Fu, Yong Rui, Tao Mei
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) | July 2017
-
Let Your Photos Talk: Generating Narrative Paragraph for Photo Stream via Bidirectional Attention Recurrent Neural Networks
Yu Liu, Jianlong Fu, Tao Mei, Chang Wen Chen
February 2017
-
Beyond Object Recognition: Visual Sentiment Analysis with Deep Coupled Adjective and Noun Neural Networks
Jingwen Wang, Jianlong Fu, Yong Xu, Tao Mei
International Joint Conference on Artificial Intelligence (IJCAI) | August 2016
-
Relaxing from Vocabulary: Robust Weakly-Supervised Deep Learning for Vocabulary-Free Image Tagging
Jianlong Fu, Yue Wu, Tao Mei, Jinqiao Wang, Hanqing Lu, Yong Rui
December 2015
-
Tagging Personal Photos with Transfer Deep Learning
Jianlong Fu, Tao Mei, Kuiyuan Yang, Hanqing Lu, Yong Rui
International World Wide Web conference (WWW) | May 2015
-
-
-
Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
Y. Ma, Huan Yang, Wenhan Yang, Jianlong Fu, Jiaying Liu
ArXiv | May 2023, 巻abs/2305.15357
-
Reference-Based Defect Detection Network
Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
IEEE Transactions on Image Processing | July 2021, 巻30: pp. 6637-6647
-
Advances in deep learning approaches for image tagging
Jianlong Fu, Yong Rui
APSIPA Transactions on Signal and Information Processing | October 2017
-
-
-
Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
MSR-TR-2020-51 | April 2020
Microsoft による投稿
-
Learning Rich Image Region Representation for Visual Question Answering
Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
MSR-TR-2020-1 | June 2019
Microsoft による投稿
CVPR 2019, VQA Workshop
-