Portrait of Sing Bing Kang

Sing Bing Kang

Principal Researcher

About

I’m a member of the Cognition Group at Microsoft Research. My main research interests are image and video enhancement, and image-based modeling and rendering.

I’ve co-edited two books: “Panoramic Vision: Sensors, Theory, and Applications” (with R. Benosman) and “Emerging Topics in Computer Vision” (with G. Medioni). I’ve also co-authored two books: “Image-Based Rendering” (with H.-Y. Shum and S.-C. Chan) and “Image-Based Modeling of Plants and Trees” (with L. Quan).

I’m proud to be involved with Microsoft Pix (shipped on iOS July 27, 2016). Pix is among TIME’s top 50 apps (#36) in 2016.

Projects

Learning to be a depth camera for close-range human capture and interaction

Established: July 14, 2014

We present a machine learning technique for estimating absolute, per-pixel depth using any conventional monocular 2D camera, with minor hardware modifications. Our approach targets close-range human capture and interaction where dense 3D estimation of hands and faces is desired. We use hybrid classification-regression forests to learn how to map from near infrared intensity images to absolute, metric depth in real-time. We demonstrate a variety of human computer interaction scenarios.  

Image Composite Editor

Established: December 3, 2008

What is Image Composite Editor? Image Composite Editor (ICE) is an advanced panoramic image stitcher created by the Microsoft Research Interactive Visual Media Group. Given a set of overlapping photographs of a scene shot from a single camera location, the app creates a high-resolution panorama that seamlessly combines the original images. ICE can also create a panorama from a panning video, including stop-motion action overlaid on the background. Finished panoramas can be shared with friends…

A Flexible New Technique for Camera Calibration

Established: December 2, 1999

We propose a flexible new technique to easily calibrate a camera. It is well suited for use without specialized knowledge of 3D geometry or computer vision. The technique only requires the camera to observe a planar pattern shown at a few (at least two) different orientations. Either the camera or the planar pattern can be freely moved. The motion need not be known. Radial lens distortion is modeled. The proposed procedure consists of a closed-form…

Publications

2016

2015

2014

2013

2012

2011

2010

2009

Human Video Textures
Matthew Flagg, Atsushi Nakazawa, Qiushuang Zhang, Sing Bing Kang, Young Kee Ryu, Irfan Essa, James Rehg, in Symposium on Interactive 3D Graphics and Games (I3D), February 1, 2009, View abstract

2008

2007

2006

Stylizing 2.5-D video
Noah Snavely, Charles Lawrence Zitnick, Sing Bing Kang, Michael Cohen, in International Symposium on Non-Photorealistic Animation and Rendering, June 1, 2006, View abstract

2005

2004

2003

2002

2001

2000

1999

1998

1997

1996

1995

1994

1993

1992

1991

1989

1988

Projects

Downloads

Time-Mapping Matlab Code

June 2014

    Click the icon to access this download

  • Website

Converting 2-D Video to 3-D

July 2012

    Click the icon to access this download

  • Website

Other

Chairs

  • Workshop co-chair, Int’l Conf. on Computer Vision, Venice, Italy, Oct. 2017.
  • Area chair, IEEE Conf. on Computer Vision and Pattern Recognition, June 2017.
  • Area chair, Int’l Conf. on Computer Vision, Sydney, Australia, Dec. 2013.
  • Track chair (Computer & Robot Vision), Int’l Conf. on Pattern Recognition, Tsukuba Science City, Japan, Nov. 2012.
  • Area chair, European Conf. on Computer Vision, Florence, Italy, Oct. 2012.
  • Program board member, Int’l Conf. on Computer Vision, Barcelona, Spain, Nov. 2011.
  • Area chair, IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, CA, June 2010.
  • Program co-chair, IEEE Conf. on Computer Vision and Pattern Recognition, Miami, FL, June 2009.
  • Program co-chair, Asian Conf. on Computer Vision, Tokyo, Japan, Nov. 2007.
  • Area chair, IEEE Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, June 2007.
  • Area chair, European Conf. on Computer Vision, Graz, Austria, May 2006.
  • Area chair, IEEE Conf. on Computer Vision and Pattern Recognition, Washington, DC, June-July 2004.
  • Area chair, European Conf. on Computer Vision, Prague, Czech Republic, May 2004.
  • Area chair, Int’l Conf. on Computer Vision, Nice, France, Oct. 2003.
  • Short courses co-chair, Int’l Conf. on Computer Vision, Nice, France, Oct. 2003.
  • Short courses chair, IEEE Conf. on Computer Vision and Pattern Recognition, Kauai, HI, Dec. 2001.

SIGGRAPH/SIGGRAPH Asia Papers Committees

  • SIGGRAPH, Los Angeles, Aug. 2015.
  • SIGGRAPH Asia, Shenzhen, Dec. 2014.
  • SIGGRAPH Asia, Hong Kong, Nov. 2013.
  • SIGGRAPH, Los Angeles, Aug. 2012.
  • SIGGRAPH Asia, Hong Kong, Dec. 2011.
  • SIGGRAPH, Los Angeles, July 2010.
  • SIGGRAPH, New Orleans, Aug. 2009.
  • SIGGRAPH Asia, Singapore, Dec. 2008.
  • SIGGRAPH, San Diego, Aug. 2007.

Conference/Workshop Technical Committees

  • International Conf. on 3D Imaging (IC3D), Liege, Belgium, December 2012.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, June 2012.
  • International Conf. on 3D Imaging (IC3D), Liege, Belgium, December 2011.
  • International Conf. on Computational Photography, Pittsburgh, April 2011.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Colorado Springs, June 2011.
  • Digital Image Processing and Analysis (DIPA), Tucson, AZ, June 2010.
  • IEEE Workshop on Applications of Computer Vision, Snowbird, UT, Dec. 2009.
  • European Conf. on Computer Vision, Marseille, France, Oct. 2008.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Anchorage, AK, June 2008.
  • European Conf. on Visual Media Production (CVMP), London, UK, Nov. 2007.
  • Pacific Graphics, Maui, HI, Oct.-Nov. 2007.
  • 3-D Digital Imaging and Modeling (3DIM), Montreal, Canada, Aug. 2007.
  • Int’l Conf. on 3D Digital Imaging and Modeling, Montreal, Canada, Aug. 2007.
  • European Conf. on Visual Media Production, London, UK, Nov. 2006.
  • Pacific Graphics, Taipei, Taiwan, Oct. 2006.
  • Symp. on 3D Data Processing, Visualization, and Transmission, Chapel Hill, NC, June 2006.
  • IEEE Conf. on Computer Vision and Pattern Recognition, New York, NY, June 2006.
  • Computer Graphics International, Hangzhou, China, June 2006.
  • Asian Conf. on Computer Vision, Hyderabad, India, Jan. 2006.
  • OMNIVIS, Beijing, China, Oct. 2005.
  • Int’l Conf. on Computer Vision, Beijing, China, Oct. 2005.
  • European Conf. on Visual Media Production, London, UK, Nov. 2005.
  • IEEE Workshop on Vision for Human-Computer Interaction (in conjunction with CVPR’05), San Diego, CA, June 2005.
  • IEEE Conf. on Computer Vision and Pattern Recognition, San Diego, CA, June 2005.
  • Int’l Conf. on 3D Digital Imaging and Modeling, Ottawa, Ontario, Canada, June 2005.
  • IAPR Conf. on Machine Vision Applications, Tsukuba Science City, Japan, May 2005.
  • Workshop on Applications of Computer Vision, Breckenridge, CO, Jan. 2005.
  • Int’l Conf. on Pattern Recognition, Cambridge, UK, Aug. 2004.
  • Int’l Conf. on Visual Media Production, London, UK, Mar. 2004.
  • Asian Conf. on Computer Vision, Jeju Island, Korea, Jan. 2004.
  • Int’l Conf. on 3D Digital Imaging and Modeling, Banff, Alberta, Canada, Oct. 2003.
  • IEEE Int’l Conf. on Image Processing, Barcelona, Spain, Sept. 2003.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Madison, WI, June 2003.
  • SPIE Videometrics VIII, Santa Clara, CA, Jan. 2003.
  • IAPR Workshop on Machine Vision Applications, Nara, Japan, Dec. 2002.
  • AAAI-02, Edmonton, Canada, July 2002.
  • Workshop on Omnidirectional Vision, Copenhagen, Denmark, June 2, 2002.
  • European Conf. on Computer Vision, Copenhagen, Denmark, May/June 2002.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Kauai, Hawaii, Dec. 2001.
  • Int’l Conf. on 3D Digital Imaging and Modeling, Quebec City, Canada, May 2001.
  • SPIE Videometrics and Optical Methods for 3D Shape Measurement VII, San Jose, Jan. 2001.
  • IAPR Workshop on Machine Vision Applications, Univ. of Tokyo, Tokyo, Japan, Nov. 2000.
  • IEEE Conf. on Computer Vision and Pattern Recognition, Hilton Head Island, NC, June 2000.
  • Workshop on Omnidirectional Vision, Hilton Head Island, NC, June 2000.
  • IEEE Conf. on Computer Vision and Pattern Recognition, San Francisco, June 1996.

Editorial Boards/Workshops/Tutorials/Miscellaneous

  • IEEE Trans. On Pattern Analysis and Machine Intelligence, Associate Editor-in-Chief, 2010-2014.
  • IPSJ Trans. On Computer Vision and Applications, Advisory Board member, 2012-present.
  • Series editor, Advances in Computer Vision and Pattern Recognition, Springer-Verlag, 2011-present.
  • Award Committee Chair, ACCV 2012.
  • Guest co-editor, special section on award-winning papers from CVPR 2009, IEEE Trans. On Pattern Analysis and Machine Intelligence, Dec. 2011 (vol. 33, no. 2).
  • Guest co-editor-in-chief, special MIRU2010 issue, IPSJ Trans. On Computer Vision and Applications, 2011.
  • IEEE Trans. On Pattern Analysis and Machine Intelligence (CVPR 2009 special issue), Associate Editor, 2009-present.
  • IEEE Trans. On Pattern Analysis and Machine Intelligence, Associate Editor, 2007-2010.
  • Co-organizer of IEEE International Workshop on Fundamental Advances in Computer Vision, Sept. 2009 (in conjunction with ICCV09).
  • Papers Advisory Board member, SIGGRAPH Asia 2009.
  • IPSJ Trans. On Computer Vision and Applications, Associate co-Editor-in-Chief, 2008-2012.
  • Co-editor of International Journal of Computer Vision (ACCV07 special issue), 2008.
  • Papers Advisory Board member, SIGGRAPH Asia 2008.
  • Organizing committee member, MIRU International Workshop on Computer Vision, Hiroshima, Japan, July 29, 2007.
  • Co-instructor, Vision for Graphics, in conjunction with Int’l Conf. on Computer Vision, Beijing, China, Oct. 2005.
  • Co-organizer, Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, in conjunction with Int’l Conf. on Computer Vision, Nice, France, Oct. 2003.

Thesis Committees

  • Can Chen, Light Field Stereo: Theory, Algorithm and Application, U Delaware, to defend 2016.
  • Kevin Karsch, Inverse Rendering Techniques for Physically Grounded Image Editing, UIUC, Feb. 2015.
  • Matthias Grundmann, Computational Video: Post-processing Methods for Stabilization, Retargeting and Segmentation, Georgia Tech., defended Feb. 2013.
  • Matt Flagg, Capture, Analysis and Synthesis of Photorealistic Crowds, Georgia Tech., defended Aug. 2010.
  • Grant Schindler, Unlocking the Urban Photographic Record through 4D Scene Modeling, Georgia Tech., defended Apr. 2010.
  • Youngbae Hwang, Statistical Image Noise Modeling for Computer Vision Applications, Korea Advanced Institute of Science and Technology (KAIST), defended Dec. 2008.
  • Eric Bennett, Computational Video Enhancement, University of North Carolina at Chapel Hill, defended Mar. 2007.
  • Antonio Haro, Example Based Processing for Image and Video Synthesis, Georgia Institute of Technology, defended Sept. 2003.
  • Huong Quynh Dinh, Applications of Variational Implicit Surface Reconstruction, Georgia Institute of Technology, defended May 2002.
  • George Paul, Kinematics of Objects in Contact Using Dual Vectors and its Applications, Carnegie Mellon University, defended Nov. 1997.
  • Joao P. Felix da Silva, Computer Based Three-Dimensional Facial Character Animation: A Comparison of Two Fundamental Techniques, The University of the Arts, Graduate Industrial Design Dept., defended June 1997 (Master’s).

Interns Supervised/Co-supervised

  • Tae-Hyun Oh, KAIST, 2016.
  • Wei-Sheng (Jason) Lai, UC Merced, 2016.
  • Rasool Fakoor, University of Texas at Arlington, 2016.
  • Utkarsh Sinha, CMU (Masters), 2016.
  • Eric Huang, CMU (Masters), 2016.
  • Zhile Ren, Brown, 2015.
  • Nikhil Naik, MIT, 2014.
  • Feng Zhou, CMU, 2013.
  • Armand Joulin, ENS/INRIA, 2012.
  • Eduardo Gastal, UFRGS, Brazil, 2012.
  • Jia-Bin Huang, UIUC, 2012.
  • Yong Seok Heo, Seoul National University, 2012.
  • Kevin Karsch, UIUC, 2011.
  • Sung Ju Hwang, University of Texas at Austin, 2011.
  • Priyam Chatterjee, UC Santa Cruz, 2010.
  • Juan Caicedo Rueda, National University of Colombia, Bogota, Colombia, 2010.
  • Yunpeng Li, Cornell, 2009.
  • Kalyan Sunkavalli, Harvard, 2009.
  • Taeg Sang Cho, MIT, 2009.
  • Sanjeev Jagannatha Koppal, CMU, 2008.
  • Ben Ward, University of Adelaide, 2008.
  • Sashi Kumar Penta, UNC, 2007.
  • Jiading Gai, Notre Dame, 2007.
  • Shengyang Dai, Northwestern University, 2007.
  • Pravin Bhat, University of Washington, 2006.
  • Ce Liu, MIT, 2005.
  • Alejandro Troccoli, Columbia University, 2005.
  • Vaibhav Vaish, Stanford, 2004.
  • Noah Snavely, University of Washington, 2004.
  • Sam Hasinoff, University of Toronto, 2003.
  • Yanghai Tsin, Carnegie Mellon University, 2002.
  • Rahul Swaminathan, Columbia University, 2001.
  • Hiroshi Kawasaki, University of Tokyo, 2000.
  • Jinxiang Chai, Carnegie Mellon University, 2000.
  • Huong Quynh Dinh, Georgia Institute of Technology, 1998.
  • Pavan Desikan, Duke University, 1997.
  • David DiFranco, Massachusetts Institute of Technology, 1997, 1998.
  • Behzad Dariush, Ohio State University, 1996.
  • Andrew Johnson, Carnegie Mellon University, 1995, 1996.

Awards/Honors

  • IEEE Fellow, class of 2012.
  • Most influential paper over the decade” award, MVA 2011.
  • Outstanding reviewer award, CVPR 2008.
  • King-Sun Fu Memorial Best IEEE Transaction on Robotics and Automation Paper award, 1998.
  • IEEE Computer Society Outstanding Paper Award, CVPR 1991.

3D Video Dataset

This data includes a sequence of 100 images captured from 8 cameras showing the breakdancing and ballet scenes from the paper “High-quality video view interpolation using a layered representation”, Zitnick et al., SIGGRAPH 2004.