Microsoft at ICCV 2021

CvT: Introducing Convolutions to Vision Transformers

Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang

MicroNet: Improving Image Recognition with Extremely Low FLOPs

Yunsheng Li, Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Lu Yuan, Zicheng Liu, Lei Zhang, Nuno Vasconcelos

How To Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wild

Okan Köpüklü, Maja Taseska, Gerhard Rigoll

Compressing Visual-Linguistic Model via Knowledge Distillation

Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu

Learning To Generate Scene Graph From Natural Language Supervision

Yiwu Zhong, Jing Shi, Jianwei Yang, Chenliang Xu, Yin Li

Let’s See Clearly: Contaminant Artifact Removal for Moving Cameras

Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models

Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu

Group-Free 3D Object Detection via Transformers

Ze Liu, Zheng Zhang, Yue Cao, Han Hu, Xin Tong

Dynamic DETR: End-to-End Object Detection With Dynamic Attention

Xiyang Dai, Yinpeng Chen, Jianwei Yang, Pengchuan Zhang, Lu Yuan, Lei Zhang

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

End-to-End Semi-Supervised Object Detection with Soft Teacher

Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Yangyu Huang, Hao Yang, Chong Li, Jongyoo Kim, Fangyun Wei

Conditional DETR for Fast Training Convergence

Depu Meng, Xiaokang Chen, Zejia Fan, Gang Zeng, Houqiang Li, Yuhui Yuan, Lei Sun, Jingdong Wang

Fake It Till You Make It: Face analysis in the wild using synthetic data alone

Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Sebastian Dziadzio, Matthew Johnson, Virginia Estellers, Tom Cashman, Jamie Shotton

Towards Efficient Graph Convolutional Networks for Point Cloud Handling

Yawei Li, He Chen, Zhaopeng Cui, Radu Timofte, Marc Pollefeys, Gregory Chirikjian, Luc Van Gool

High-Fidelity Pluralistic Image Completion with Transformers

Ziyu Wan, Jingbo Zhang, Dongdong Chen, Jing Liao

The Benefit of Distraction: Denoising Camera-Based Physiological Measurements Using Inverse Attention

Ewa M Nowara, Daniel McDuff, Ashok Veeraraghavan

MBA-VO: Motion Blur Aware Visual Odometry

Peidong Liu, Xingxing Zuo, Viktor Larsson, Marc Pollefeys

Orthographic-Perspective Epipolar Geometry

Viktor Larsson, Marc Pollefeys, Magnus Oskarsson

Neural Articulated Radiance Field

Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada

Pixel-Perfect Structure-From-Motion With Featuremetric Refinement

Philipp Lindenberger, Paul-Edouard Sarlin, Viktor Larsson, Marc Pollefeys

Cross-Descriptor Visual Localization and Mapping

Mihai Dusmanu, Ondrej Miksik, Johannes L. Schönberger, Marc Pollefeys

PatchMatch-RL: Deep MVS with Pixelwise Depth, Normal, and Visibility

Jae Yong Lee, Joseph DeGol, Chuhang Zou, Derek Hoiem

Learning With Noisy Labels for Robust Point Cloud Segmentation

Shuquan Ye, Dongdong Chen, Songfang Han, Jing Liao

Manifold Matching via Deep Metric Learning for Generative Modeling

Mengyu Dai, Haibin Hang

Interpolation-Aware Padding for 3D Sparse Convolutional Neural Networks

Yu-Qi Yang, Peng-Shuai Wang, Yang Liu

Temporal Action Detection with Multi-level Supervision

Baifeng Shi, Qi Dai, Judy Hoffman, Kate Saenko, Trevor Darrell, Huijuan Xu

Self-Supervised Video Representation Learning with Meta-Contrastive Network

Yuanze Lin, Xun Guo, Yan Lu

Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation

Jay Patravali, Gaurav Mittal, Ye Yu, Fuxin Li, Mei Chen

Dual Path Learning for Domain Adaptation of Semantic Segmentation

Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Fang Wen, Wenqiang Zhang

Re-energizing Domain Discriminator with Sample Relabeling for Adversarial Domain Adaptation

Xin Jin, Cuiling Lan, Wenjun Zeng, Zhibo Chen

Long Short View Feature Decomposition via Contrastive Video Representation Learning

Nadine Behrmann, Mohsen Fayyaz, Juergen Gall, Mehdi Noroozi

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li

Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows

Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, Baining Guo

Rethinking and Improving Relative Position Encoding for Vision Transformer

Kan Wu, Houwen Peng, Minghao Chen, Jianlong Fu, Hongyang Chao

H2O: Two Hands Manipulating Objects for First Person Interaction Recognition

Taein Kwon, Bugra Tekin, Jan Stuhmer, Federica Bogo, Marc Pollefeys

Self-Supervised Visual Representations Learning by Contrastive Mask Prediction

Yucheng Zhao, Guangting Wang, Chong Luo, Wenjun Zeng, Zheng-Jun Zha

Improve Unsupervised Pretraining for Few-label Transfer

Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu

Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment

Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo

ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning

Sangho Lee, Jiwan Chung, Youngjae Yu, Gunhee Kim, Thomas Breuel, Gal Chechik, Yale Song

Learning Spatio-Temporal Transformer for Visual Tracking

Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu

High-Resolution Optical Flow from 1D Attention and Correlation

Haofei Xu, Jiaolong Yang, Jianfei Cai, Juyong Zhang, Xin Tong

ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition

Daniela Massiceti, Luisa Zintgraf, John Bronskill, Lida Theodorou, Matthew Tobias Harris, Ed Cutrell, Cecily Morrison, Katja Hofmann, Simone Stumpf

An Empirical Study of the Collapsing Problem in Semi-Supervised 2D Human Pose Estimation

Rongchang Xie, Chunyu Wang, Wenjun Zeng, Yizhou Wang

Contextually Plausible and Diverse 3D Human Motion Prediction

Sadegh Aliakbarian, Fatemeh Sadat Saleh, Lars Petersson, Stephen Gould, Mathieu Salzmann

Learning Motion Priors for 4D Human Body Capture in 3D Scenes

Siwei Zhang, Haiyan Zhang, Federica Bogo, Marc Pollefeys, Siyu Tang

Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation

Ailing Zeng, Xiao Sun, Lei Yang, Nanxuan Zhao, Minhao Liu, Qiang Xu

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment

Jianwei Yang, Yonatan Bisk, Jianfeng Gao

Full-Body Motion From a Single Head-Mounted Device: Generating SMPL Poses From Partial Observations

Andrea Dittadi, Sebastian Dziadzio, Darren Cosker, Ben Lundell, Tom Cashman, Jamie Shotton

AutoFormer: Searching Transformers for Visual Recognition

Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling

Sat2Vid: Street-view Panoramic Video Synthesis from a Single Satellite Image

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Rongjun Qin, Marc Pollefeys, Martin Ralf Oswald

Mesh Graphormer

Kevin Lin, Lijuan Wang, Zicheng Liu

Learning to Track Objects from Unlabeled Videos

Jilai Zheng, Chao Ma, Houwen Peng, Xiaokang Yang

Learning High-Fidelity Face Texture Completion Without Complete Face Texture

Jongyoo Kim, Jiaolong Yang, Xin Tong

Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation

Weilun Wang, Wengang Zhou, Jianmin Bao, Dong Chen, Houqiang Li

FastNeRF: High-Fidelity Neural Rendering at 200FPS

Stephan J. Garbin, Marek Kowalski (HE/HIM), Matthew Johnson, Jamie Shotton, Julien Valentin

Domain-Aware Universal Style Transfer

Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun

Exploring Temporal Coherence for More General Video Face Forgery Detection

Yinglin Zheng, Jianmin Bao, Dong Chen, Ming Zeng, Fang Wen

Indoor Scene Generation from a Collection of Semantic-Segmented Depth Images

Ming-Jia Yang, Yu-Xiao Guo, Bin Zhou, Xin Tong

Admix: Enhancing the Transferability of Adversarial Attacks

Xiaosen Wang, Xuanran He, Jingdong Wang, Kun He

High-Fidelity Pluralistic Image Completion with Transformers

Ziyu Wan, Jingbo Zhang, Dongdong Chen, Jing Liao

The Benefit of Distraction: Denoising Camera-Based Physiological Measurements Using Inverse Attention

Ewa M Nowara, Daniel McDuff, Ashok Veeraraghavan

MBA-VO: Motion Blur Aware Visual Odometry

Peidong Liu, Xingxing Zuo, Viktor Larsson, Marc Pollefeys

Orthographic-Perspective Epipolar Geometry

Viktor Larsson, Marc Pollefeys, Magnus Oskarsson

Neural Articulated Radiance Field

Atsuhiro Noguchi, Xiao Sun, Stephen Lin, Tatsuya Harada

Pixel-Perfect Structure-From-Motion With Featuremetric Refinement

Philipp Lindenberger, Paul-Edouard Sarlin, Viktor Larsson, Marc Pollefeys

Cross-Descriptor Visual Localization and Mapping

Mihai Dusmanu, Ondrej Miksik, Johannes L. Schönberger, Marc Pollefeys

PatchMatch-RL: Deep MVS with Pixelwise Depth, Normal, and Visibility

Jae Yong Lee, Joseph DeGol, Chuhang Zou, Derek Hoiem

Learning With Noisy Labels for Robust Point Cloud Segmentation

Shuquan Ye, Dongdong Chen, Songfang Han, Jing Liao

Manifold Matching via Deep Metric Learning for Generative Modeling

Mengyu Dai, Haibin Hang

Interpolation-Aware Padding for 3D Sparse Convolutional Neural Networks

Yu-Qi Yang, Peng-Shuai Wang, Yang Liu

Temporal Action Detection with Multi-level Supervision

Baifeng Shi, Qi Dai, Judy Hoffman, Kate Saenko, Trevor Darrell, Huijuan Xu

CvT: Introducing Convolutions to Vision Transformers

Haiping Wu, Bin Xiao, Noel Codella, Mengchen Liu, Xiyang Dai, Lu Yuan, Lei Zhang

MicroNet: Improving Image Recognition with Extremely Low FLOPs

Yunsheng Li, Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Lu Yuan, Zicheng Liu, Lei Zhang, Nuno Vasconcelos

How To Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wild

Okan Köpüklü, Maja Taseska, Gerhard Rigoll

Compressing Visual-Linguistic Model via Knowledge Distillation

Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu

Learning To Generate Scene Graph From Natural Language Supervision

Yiwu Zhong, Jing Shi, Jianwei Yang, Chenliang Xu, Yin Li

Let’s See Clearly: Contaminant Artifact Removal for Moving Cameras

Xiaoyu Li, Bo Zhang, Jing Liao, Pedro V. Sander

Adversarial VQA: A New Benchmark for Evaluating the Robustness of VQA Models

Linjie Li, Jie Lei, Zhe Gan, Jingjing Liu

Group-Free 3D Object Detection via Transformers

Ze Liu, Zheng Zhang, Yue Cao, Han Hu, Xin Tong

Dynamic DETR: End-to-End Object Detection With Dynamic Attention

Xiyang Dai, Yinpeng Chen, Jianwei Yang, Pengchuan Zhang, Lu Yuan, Lei Zhang

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

Pengchuan Zhang, Xiyang Dai, Jianwei Yang, Bin Xiao, Lu Yuan, Lei Zhang, Jianfeng Gao

End-to-End Semi-Supervised Object Detection with Soft Teacher

Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu

ADNet: Leveraging Error-Bias Towards Normal Direction in Face Alignment

Yangyu Huang, Hao Yang, Chong Li, Jongyoo Kim, Fangyun Wei

FMODetect: Robust Detection of Fast Moving Objects

Denys Rozumnyi, Jiri Matas, Filip Sroubek, Marc Pollefeys, Martin Ralf Oswald

Conditional DETR for Fast Training Convergence

Depu Meng, Xiaokang Chen, Zejia Fan, Gang Zeng, Houqiang Li, Yuhui Yuan, Lei Sun, Jingdong Wang

Fake It Till You Make It: Face analysis in the wild using synthetic data alone

Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Sebastian Dziadzio, Matthew Johnson, Virginia Estellers, Tom Cashman, Jamie Shotton

Towards Efficient Graph Convolutional Networks for Point Cloud Handling

Yawei Li, He Chen, Zhaopeng Cui, Radu Timofte, Marc Pollefeys, Gregory Chirikjian, Luc Van Gool

Sat2Vid: Street-view Panoramic Video Synthesis from a Single Satellite Image

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Rongjun Qin, Marc Pollefeys, Martin Ralf Oswald

Mesh Graphormer

Kevin Lin, Lijuan Wang, Zicheng Liu

Learning to Track Objects from Unlabeled Videos

Jilai Zheng, Chao Ma, Houwen Peng, Xiaokang Yang

Learning High-Fidelity Face Texture Completion Without Complete Face Texture

Jongyoo Kim, Jiaolong Yang, Xin Tong

Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translation

Weilun Wang, Wengang Zhou, Jianmin Bao, Dong Chen, Houqiang Li

FastNeRF: High-Fidelity Neural Rendering at 200FPS

Stephan J. Garbin, Marek Kowalski (HE/HIM), Matthew Johnson, Jamie Shotton, Julien Valentin

Domain-Aware Universal Style Transfer

Kibeom Hong, Seogkyu Jeon, Huan Yang, Jianlong Fu, Hyeran Byun

Exploring Temporal Coherence for More General Video Face Forgery Detection

Yinglin Zheng, Jianmin Bao, Dong Chen, Ming Zeng, Fang Wen

Indoor Scene Generation from a Collection of Semantic-Segmented Depth Images

Ming-Jia Yang, Yu-Xiao Guo, Bin Zhou, Xin Tong

Admix: Enhancing the Transferability of Adversarial Attacks

Xiaosen Wang, Xuanran He, Jingdong Wang, Kun He

Self-Supervised Video Representation Learning with Meta-Contrastive Network

Yuanze Lin, Xun Guo, Yan Lu

Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation

Jay Patravali, Gaurav Mittal, Ye Yu, Fuxin Li, Mei Chen

Dual Path Learning for Domain Adaptation of Semantic Segmentation

Yiting Cheng, Fangyun Wei, Jianmin Bao, Dong Chen, Fang Wen, Wenqiang Zhang

Re-energizing Domain Discriminator with Sample Relabeling for Adversarial Domain Adaptation

Xin Jin, Cuiling Lan, Wenjun Zeng, Zhibo Chen

Long Short View Feature Decomposition via Contrastive Video Representation Learning

Nadine Behrmann, Mohsen Fayyaz, Juergen Gall, Mehdi Noroozi

Energy-Based Open-World Uncertainty Modeling for Confidence Calibration

Yezhen Wang, Bo Li, Tong Che, Kaiyang Zhou, Ziwei Liu, Dongsheng Li

Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows

Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, Baining Guo

Rethinking and Improving Relative Position Encoding for Vision Transformer

Kan Wu, Houwen Peng, Minghao Chen, Jianlong Fu, Hongyang Chao

H2O: Two Hands Manipulating Objects for First Person Interaction Recognition

Taein Kwon, Bugra Tekin, Jan Stuhmer, Federica Bogo, Marc Pollefeys

Self-Supervised Visual Representations Learning by Contrastive Mask Prediction

Yucheng Zhao, Guangting Wang, Chong Luo, Wenjun Zeng, Zheng-Jun Zha

Improve Unsupervised Pretraining for Few-label Transfer

Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu

Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment

Heliang Zheng, Huan Yang, Jianlong Fu, Zheng-Jun Zha, Jiebo Luo

ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning

Sangho Lee, Jiwan Chung, Youngjae Yu, Gunhee Kim, Thomas Breuel, Gal Chechik, Yale Song

Learning Spatio-Temporal Transformer for Visual Tracking

Bin Yan, Houwen Peng, Jianlong Fu, Dong Wang, Huchuan Lu

High-Resolution Optical Flow from 1D Attention and Correlation

Haofei Xu, Jiaolong Yang, Jianfei Cai, Juyong Zhang, Xin Tong

ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition

Daniela Massiceti, Luisa Zintgraf, John Bronskill, Lida Theodorou, Matthew Tobias Harris, Ed Cutrell, Cecily Morrison, Katja Hofmann, Simone Stumpf

An Empirical Study of the Collapsing Problem in Semi-Supervised 2D Human Pose Estimation

Rongchang Xie, Chunyu Wang, Wenjun Zeng, Yizhou Wang

Contextually Plausible and Diverse 3D Human Motion Prediction

Sadegh Aliakbarian, Fatemeh Sadat Saleh, Lars Petersson, Stephen Gould, Mathieu Salzmann

Learning Motion Priors for 4D Human Body Capture in 3D Scenes

Siwei Zhang, Haiyan Zhang, Federica Bogo, Marc Pollefeys, Siyu Tang

Learning Skeletal Graph Neural Networks for Hard 3D Pose Estimation

Ailing Zeng, Xiao Sun, Lei Yang, Nanxuan Zhao, Minhao Liu, Qiang Xu

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment

Jianwei Yang, Yonatan Bisk, Jianfeng Gao

Full-Body Motion From a Single Head-Mounted Device: Generating SMPL Poses From Partial Observations

Andrea Dittadi, Sebastian Dziadzio, Darren Cosker, Ben Lundell, Tom Cashman, Jamie Shotton

AutoFormer: Searching Transformers for Visual Recognition

Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling