[CV] [Google Scholar]

I am a researcher in the Interactive Media (IMG) Group at Microsoft Research Redmond. My research interests lie broadly in computer vision, robotics and computer graphics and I work on various topics related to 3d scene reconstruction from images and video. These topics include structure from motion, SLAM, visual odometry, stereo matching, optical flow and scene flow, multi-view stereo, photometric stereo, image-based localization and place recognition. I am interested in applications ranging from 3D scanning, depth sensing, augmented reality (AR) and building computer vision-aided autonomous UAVs.

I received my M.S. and Ph.D. from the University of North Carolina at Chapel Hill where I studied topics in 3D reconstruction and multi-view geometry in computer vision.


Live Video Analytics

Cameras are now everywhere. Large-scale video processing is a grand challenge representing an important frontier for analytics, what with videos from factory floors, traffic intersections, police vehicles, and retail shops. It's the golden era for computer vision, AI, and machine learning - it's a great time now to extract value from videos to impact science, society, and business! Project Rocket's goal is to democratize video analytics: build a system for real-time, low-cost, accurate analysis of live videos. This system…

Edge Computing

Established: December 6, 2015

News Stories Network World, Microsoft Researcher: Why Micro Datacenters Really Matter to Mobile's Future, September 3, 2015 (also Computer World, IT World, Info World) Shepherd's PI, Why a Cloudlet Beats the Cloud for Mobile Apps, by Lewis Sheppherd, December 13, 2009 Keynote Presentations Cloud 2020: Emergence of Micro Data Centers (Cloudlets) for Latency Sensitive Computing Devices and Networking Summit 2015, Paris, France, May 13, 2015 IEEE Wireless Communications and Networking Conference (WCNC) 2015, New Orleans,…


















Fast Multi-frame Stereo Scene Flow with Motion Segmentation

CVPR 2017

www | pdf | extended-pdf | youtube

Flight Dynamics-based Recovery of a UAV Trajectory using Ground Cameras

CVPR 2017

www | pdf | dataset | supp | video


FarmBeats: An IoT Platform for Data-Driven Agriculture

NSDI 2017

www | pdf

Multiview Rectification of Folded Documents

TPAMI 2017

www | pdf


Efficient and Robust Color Consistency for Community Photo Collections


CVPR 2016

www | pdf | supplementary


Joint Recovery of Dense Correspondence and Cosegmentation in Two Images

CVPR 2016

www | pdf | supplementary | dataset


Monocular Localization of a moving person onboard a Quadrotor MAV

ICRA 2015

www | pdf | video2 | dataset


Calibrating a non-isotropic near point light source using a plane

CVPR 2014

www | pdf | supp

High-Resolution Stereo Matching using Local Plane Sweeps

High Resolution Stereo Matching

CVPR 2014

www | pdf


3D Spin Movies and Photosynth 2

December 2013

MSR Blog | Techfest 2011 | Photosynth2-tutorial



Multiview Photometric Stereo using Planar Mesh Parameterization

Multiview Photometric Stereo using Planar Mesh Parameterization

ICCV 2013, TPAMI 2016

www | pdf | video2 | dataset


Leveraging Structure from Motion to Learn Discriminative Codebooks for Scalable Landmark Classification

CVPR 2013

www | pdf | sup


Detecting and Reconstructing 3D Mirror Symmetric Objects

ECCV 2012

www | pdf



Multiple View Object Cosegmentation using Appearance and Stereo Cues

ECCV 2012

www | pdf | supp | dataset



Real-time Image-based 6-DOF Localization in Large-Scale Environments

CVPR 2012

www | pdf | video | poster


Image-Based Rendering for Scenes with Reflections


www | pdf | video


Structure from motion for scenes with large duplicate structures

CVPR 2011

www | pdf | datasets


A linear approach to structure from motion

RMLE – ECCV workshop 2010

www | supplementary


Piecewise Planar Stereo for Image-based Rendering

ICCV 2009

www | pdf | video


Interactive 3D Architectural Modeling from Unordered Photo Collections


SIGGRAPH Asia 2008

www | pdf | supp





Conference Program Committee

  • ACM Multimedia Conference 2016.
  • IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2009 — 2017.
  • British Machine Vision Conference (BMVC) 2017.
  • 3D Processing, Visualization and Transmission (3DPVT 2012, 3DV 2013, 2014, 2015).
  • Asian Conference on Computer Vision (ACCV) 2009, 2010, 2012, 2014, 2016.
  • European Conference on Computer Vision (ECCV) 2008, 2010, 2012, 2014, 2016.
  • IEEE International Conference on Computer Vision (ICCV) 2009, 2011, 2013, 2015.
  • Indian Conference on Vision, Graphics and Image Processing (ICVGIP) 2010, 2012, 2014, 2016.

Workshop Program Committee

  • Workshop on Performance Metrics for Correspondence Problems (CVPR 2015).
  • Ground Truth – What is a good dataset ? (CVPR 2013 Workshop).
  • Workshop on Unsolved Problems in Optic Flow and Stereo Estimation (ECCV 2012).
  • Consumer Depth Cameras for Computer Vision (ECCV 2012 Workshop).
  • Vision and Graphics Computing for Multimedia Communications (ICME 2011 Workshop).
  • Reconstruction and Modeling of Large-Scale 3D Virtual Environments (ECCV 2010Workshop).
  • Computer Vision on GPUs (CV-GPU) (ECCV 2010 Workshop).
  • Dynamic 3D Imaging (DAGM 2009 Workshop).
  • Time of Flight Camera based Computer Vision (TOF{CV), (CVPR 2008 Workshop).


  • SIGGRAPH 2008–2017, SIGGRAPH Asia 2009–2012, 2016
  • EuroGraphics 2012, 2014, 2015, 2016
  • ICRA 2015, 2016
  • IROS 2016
  • ACM Transaction on Graphics (ToG)
  • International Journal of Computer Vision (IJCV)
  • IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI)
  • IEEE Transactions on Visualization and Computer Graphics (TVCG)
  • IEEE Transactions of Computational Imaging (TCI)
  • Computer Vision and Image Understanding (CVIU)
  • Journal of Visual Communication and Image Representation (JVCI)
  • Machine Vision and Applications (MVA)
  • Image and Visual Computing (IVC)
  • IEEE Pervasive Computing
  • Optics



  • CVPR 2017 Tutorial: Geometric and Semantic 3D Reconstruction
  • 3DV 2016 Tutorial: Semantic and Structured 3D Modeling


coming soon …


coming soon …