Bei Liu

Senior Researcher

Connect on LinkedIn

论文与出版物

查看方式：

- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  
  Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
  
  November 2024
  
  DOI Publication Publication
- MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  
  Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
  
  arXiv | December 2022
  
  Publication 项目
- Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
  
  Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
  
  NeurIPS 2022 | November 2022
  
  Publication
- Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
  
  Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
  
  CVPR 2022 | June 2022
  
  Publication 项目
- Debiasing Event Understanding for Visual Commonsense Tasks
  
  Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu
  
  May 2022
- Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
  
  Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  NeurIPS 2021 | December 2021
  
  Publication
- Searching the Search Space of Vision Transformer
  
  Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
  
  NeurIPS 2021 | December 2021
  
  Publication
- Learning Fine-Grained Motion Embedding for Landscape Animation
  
  Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  ACM Multimedia 2021 | October 2021
  
  Oral
  
  Publication 项目
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI 项目
- Reference-Based Defect Detection Network
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
  
  IEEE Transactions on Image Processing | July 2021, 第 30 卷: pp. 6637-6647
  
  Publication
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication 项目
- Aesthetic-Aware Image Style Transfer
  
  Bei Liu, Jianlong Fu
  
  ACM Multimedia | October 2020
  
  Publication 项目
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  作者：Microsoft
  
  Publication 项目
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication 项目
- SMP Challenge: An Overview of Social Media Prediction Challenge 2019
  
  Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo
  
  ACM Multimedia | October 2019
  
  Publication
- WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
  
  ICCV | October 2019
  
  Publication 项目
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication 项目
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  作者：Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication 项目
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF 项目

- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  
  Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
  
  November 2024
  
  DOI Publication Publication
- Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
  
  Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
  
  NeurIPS 2022 | November 2022
  
  Publication
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication 项目
- Aesthetic-Aware Image Style Transfer
  
  Bei Liu, Jianlong Fu
  
  ACM Multimedia | October 2020
  
  Publication 项目
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  作者：Microsoft
  
  Publication 项目
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication 项目
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  作者：Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication 项目
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication 项目
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF 项目
- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  
  Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
  
  November 2024
  
  DOI Publication Publication
- MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  
  Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
  
  arXiv | December 2022
  
  Publication 项目
- Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
  
  Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
  
  CVPR 2022 | June 2022
  
  Publication 项目
- Searching the Search Space of Vision Transformer
  
  Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
  
  NeurIPS 2021 | December 2021
  
  Publication
- Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
  
  Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  NeurIPS 2021 | December 2021
  
  Publication
- Learning Fine-Grained Motion Embedding for Landscape Animation
  
  Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  ACM Multimedia 2021 | October 2021
  
  Oral
  
  Publication 项目
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI 项目
- Reference-Based Defect Detection Network
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
  
  IEEE Transactions on Image Processing | July 2021, 第 30 卷: pp. 6637-6647
  
  Publication
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication 项目
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  作者：Microsoft
  
  Publication 项目
- WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
  
  ICCV | October 2019
  
  Publication 项目
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  作者：Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication 项目
- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  
  Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
  
  November 2024
  
  DOI Publication Publication
- Debiasing Event Understanding for Visual Commonsense Tasks
  
  Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu
  
  May 2022
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF 项目
- Learning Fine-Grained Motion Embedding for Landscape Animation
  
  Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  ACM Multimedia 2021 | October 2021
  
  Oral
  
  Publication 项目
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI 项目
- SMP Challenge: An Overview of Social Media Prediction Challenge 2019
  
  Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo
  
  ACM Multimedia | October 2019
  
  Publication
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication 项目
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication 项目
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF 项目

- CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  
  Qixiu Li, Yaobo Liang, Zeyu Wang, Lin Luo, Xi Chen, Mozheng Liao, Fangyun Wei, Yu Deng, Sicheng Xu, Yizhong Zhang, Xiaofan Wang, Bei Liu, Jianlong Fu, Jianmin Bao, Dong Chen, Yuanchun Shi, Jiaolong Yang, Baining Guo
  
  November 2024
  
  DOI Publication Publication
- MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  
  Ludan Ruan, Yiyang Ma, Huan Yang, Huiguo He, Bei Liu, Jianlong Fu, Nicholas Jing Yuan, Qin Jin, Baining Guo
  
  arXiv | December 2022
  
  Publication 项目
- Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning
  
  Yuchong Sun, Hongwei Xue, Ruihua Song, Bei Liu, Huan Yang, Jianlong Fu
  
  NeurIPS 2022 | November 2022
  
  Publication
- Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
  
  Hongwei Xue, Tiankai Hang, Yanhong Zeng, Yuchong Sun, Bei Liu, Huan Yang, Jianlong Fu, Baining Guo
  
  CVPR 2022 | June 2022
  
  Publication 项目
- Searching the Search Space of Vision Transformer
  
  Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling
  
  NeurIPS 2021 | December 2021
  
  Publication
- Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training
  
  Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  NeurIPS 2021 | December 2021
  
  Publication
- Learning Fine-Grained Motion Embedding for Landscape Animation
  
  Hongwei Xue, Bei Liu, Huan Yang, Jianlong Fu, Houqiang Li, Jiebo Luo
  
  ACM Multimedia 2021 | October 2021
  
  Oral
  
  Publication 项目
- Unifying multimodal transformer for bi-directional image and text generation
  
  Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation
  
  Yupan Huang, Bei Liu, Jianlong Fu, Yutong Lu
  
  ACM Multimedia 2021 | October 2021
  
  Publication 项目
- MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding
  
  Bei Liu, Jianlong Fu, Shizhe Chen, Qin Jin, Alexander Hauptmann, Yong Rui
  
  ICMR 2021 | August 2021
  
  DOI 项目
- Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  
  Zhicheng Huang*, Zhaoyang Zeng*, Yupan Huang*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  CVPR 2021 | June 2021
  
  Oral
  
  Publication 项目
- Aesthetic-Aware Image Style Transfer
  
  Bei Liu, Jianlong Fu
  
  ACM Multimedia | October 2020
  
  Publication 项目
- SMP Challenge: An Overview of Social Media Prediction Challenge 2019
  
  Bo Wu, Wen-Huang Cheng, Peiye Liu, Bei Liu, Zhaoyang Zeng, Jiebo Luo
  
  ACM Multimedia | October 2019
  
  Publication
- Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences
  
  Shizhe Chen, Bei Liu, Jianlong Fu, Ruihua Song, Qin Jin, Pingping Lin, Xiaoyu Qi, Chunting Wang, Jin Zhou
  
  ACM Multimedia | October 2019
  
  Publication 项目
- WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao, Lei Zhang
  
  ICCV | October 2019
  
  Publication 项目
- Emotion Reinforced Visual Storytelling
  
  Nanxing Li, Bei Liu, Zhizhong Han, Yu-Shen Liu, Jianlong Fu
  
  ICMR | June 2019
  
  Publication 项目
- Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training
  
  Bei Liu, Jianlong Fu, Makoto P. Kato, Masatoshi Yoshikawa
  
  2018 ACM Multimedia | October 2018
  
  Best Paper Award
  
  DOI Publication PDF 项目
- Debiasing Event Understanding for Visual Commonsense Tasks
  
  Minji Seo, YeonJoon Jung, Seungtaek Choi, seung-won hwang, Bei Liu
  
  May 2022
- Reference-Based Defect Detection Network
  
  Zhaoyang Zeng, Bei Liu, Jianlong Fu, Hongyang Chao
  
  IEEE Transactions on Image Processing | July 2021, 第 30 卷: pp. 6637-6647
  
  Publication
- Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers
  
  Zhicheng Huang*, Zhaoyang Zeng*, Bei Liu, Dongmei Fu, Jianlong Fu
  
  MSR-TR-2020-51 | April 2020
  
  作者：Microsoft
  
  Publication 项目
- Learning Rich Image Region Representation for Visual Question Answering
  
  Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu
  
  MSR-TR-2020-1 | June 2019
  
  作者：Microsoft
  
  CVPR 2019, VQA Workshop
  
  Publication 项目

Bei Liu

论文与出版物

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Debiasing Event Understanding for Visual Commonsense Tasks

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Searching the Search Space of Vision Transformer

Learning Fine-Grained Motion Embedding for Landscape Animation

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

Unifying multimodal transformer for bi-directional image and text generation

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Reference-Based Defect Detection Network

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Aesthetic-Aware Image Style Transfer

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Emotion Reinforced Visual Storytelling

Learning Rich Image Region Representation for Visual Question Answering

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Aesthetic-Aware Image Style Transfer

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Learning Rich Image Region Representation for Visual Question Answering

Emotion Reinforced Visual Storytelling

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Searching the Search Space of Vision Transformer

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Learning Fine-Grained Motion Embedding for Landscape Animation

Unifying multimodal transformer for bi-directional image and text generation

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Reference-Based Defect Detection Network

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Learning Rich Image Region Representation for Visual Question Answering

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

Debiasing Event Understanding for Visual Commonsense Tasks

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Learning Fine-Grained Motion Embedding for Landscape Animation

Unifying multimodal transformer for bi-directional image and text generation

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

Emotion Reinforced Visual Storytelling

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation

MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

Searching the Search Space of Vision Transformer

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training

Learning Fine-Grained Motion Embedding for Landscape Animation

Unifying multimodal transformer for bi-directional image and text generation

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

MMPT’21: International Joint Workshop on Multi-Modal Pre-Training for Multimedia Understanding

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

Aesthetic-Aware Image Style Transfer

SMP Challenge: An Overview of Social Media Prediction Challenge 2019

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

Emotion Reinforced Visual Storytelling

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Debiasing Event Understanding for Visual Commonsense Tasks

Reference-Based Defect Detection Network

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

Learning Rich Image Region Representation for Visual Question Answering