About

[CV] [Google Scholar]

I am a researcher in the Interactive Media (IMG) Group at Microsoft Research Redmond. My research interests lie broadly in computer vision, robotics and computer graphics and I work on various topics related to 3d scene reconstruction from images and video. These topics include structure from motion, SLAM, visual odometry, stereo matching, optical flow and scene flow, multi-view stereo, photometric stereo, image-based localization and place recognition. I am interested in applications ranging from 3D scanning, depth sensing, augmented reality (AR) and building computer vision-aided autonomous UAVs.

I received my M.S. and Ph.D. from the University of North Carolina at Chapel Hill where I studied topics in 3D reconstruction and multi-view geometry in computer vision.

Projects

FarmBeats: AI & IoT for Agriculture

Established: May 14, 2015

Several studies have demonstrated the need to significantly increase the world’s food production by 2050. However, there is limited amount of additional arable land, and water levels have also been receding. Although technology could help the farmer, its adoption is limited because the farms usually do not have power, or Internet connectivity, and the farmers are typically not technology savvy. We are working towards an end-to-end approach, from sensors to the cloud, to solve the…

Publications

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

Other

Fast Multi-frame Stereo Scene Flow with Motion Segmentation

CVPR 2017

www | pdf | extended-pdf | youtube

Flight Dynamics-based Recovery of a UAV Trajectory using Ground Cameras

CVPR 2017

www | pdf | dataset | supp | video

 

FarmBeats: An IoT Platform for Data-Driven Agriculture

NSDI 2017

www | pdf

Multiview Rectification of Folded Documents

TPAMI 2017

www | pdf

 

Efficient and Robust Color Consistency for Community Photo Collections

parkcvpr2016

CVPR 2016

www | pdf | supplementary

 

Joint Recovery of Dense Correspondence and Cosegmentation in Two Images

CVPR 2016

www | pdf | supplementary | dataset

 

Monocular Localization of a moving person onboard a Quadrotor MAV

ICRA 2015

www | pdf | video2 | dataset

 

Calibrating a non-isotropic near point light source using a plane

CVPR 2014

www | pdf | supp

High-Resolution Stereo Matching using Local Plane Sweeps

High Resolution Stereo Matching

CVPR 2014

www | pdf

 

3D Spin Movies and Photosynth 2

December 2013

MSR Blog | Techfest 2011 | Photosynth2-tutorial

 

 

Multiview Photometric Stereo using Planar Mesh Parameterization

Multiview Photometric Stereo using Planar Mesh Parameterization

ICCV 2013, TPAMI 2016

www | pdf | video2 | dataset

 

Leveraging Structure from Motion to Learn Discriminative Codebooks for Scalable Landmark Classification

CVPR 2013

www | pdf | sup

 

Detecting and Reconstructing 3D Mirror Symmetric Objects

ECCV 2012

www | pdf

 

 

Multiple View Object Cosegmentation using Appearance and Stereo Cues

ECCV 2012

www | pdf | supp | dataset

 

 

Real-time Image-based 6-DOF Localization in Large-Scale Environments

CVPR 2012

www | pdf | video | poster

 

Image-Based Rendering for Scenes with Reflections

SIGGRAPH 2012

www | pdf | video

 

Structure from motion for scenes with large duplicate structures

CVPR 2011

www | pdf | datasets

 

A linear approach to structure from motion

RMLE – ECCV workshop 2010

www | supplementary

 

Piecewise Planar Stereo for Image-based Rendering

ICCV 2009

www | pdf | video

 

Interactive 3D Architectural Modeling from Unordered Photo Collections

photomodel

SIGGRAPH Asia 2008

www | pdf | supp

 

Activities

Organization

Awards

Conference Program Committee

  • ACM Multimedia Conference 2016.
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009 — 2017.
  • British Machine Vision Conference (BMVC) 2017.
  • 3D Processing, Visualization and Transmission (3DPVT 2012, 3DV 2013, 2014, 2015).
  • Asian Conference on Computer Vision (ACCV) 2009, 2010, 2012, 2014, 2016.
  • European Conference on Computer Vision (ECCV) 2008, 2010, 2012, 2014, 2016.
  • IEEE International Conference on Computer Vision (ICCV) 2009, 2011, 2013, 2015.
  • Indian Conference on Vision, Graphics and Image Processing (ICVGIP) 2010, 2012, 2014, 2016.

Workshop Program Committee

  • Workshop on Performance Metrics for Correspondence Problems (CVPR 2015).
  • Ground Truth – What is a good dataset ? (CVPR 2013 Workshop).
  • Workshop on Unsolved Problems in Optic Flow and Stereo Estimation (ECCV 2012).
  • Consumer Depth Cameras for Computer Vision (ECCV 2012 Workshop).
  • Vision and Graphics Computing for Multimedia Communications (ICME 2011 Workshop).
  • Reconstruction and Modeling of Large-Scale 3D Virtual Environments (ECCV 2010Workshop).
  • Computer Vision on GPUs (CV-GPU) (ECCV 2010 Workshop).
  • Dynamic 3D Imaging (DAGM 2009 Workshop).
  • Time of Flight Camera based Computer Vision (TOF{CV), (CVPR 2008 Workshop).

Reviewer

  • SIGGRAPH 2008–2017, SIGGRAPH Asia 2009–2012, 2016
  • EuroGraphics 2012, 2014, 2015, 2016
  • ICRA 2015, 2016
  • IROS 2016
  • ACM Transaction on Graphics (ToG)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)
  • IEEE Transactions on Visualization and Computer Graphics (TVCG)
  • IEEE Transactions of Computational Imaging (TCI)
  • Computer Vision and Image Understanding (CVIU)
  • Journal of Visual Communication and Image Representation (JVCI)
  • Machine Vision and Applications (MVA)
  • Image and Visual Computing (IVC)
  • IEEE Pervasive Computing
  • Optics

 

Teaching

  • CVPR 2017 Tutorial: Geometric and Semantic 3D Reconstruction
  • 3DV 2016 Tutorial: Semantic and Structured 3D Modeling