Immersive Visual Communication with Depth

June 15, 2011
Minh N. Do | University of Illinois at Urbana-Champaign

In this talk I will present some of our recent efforts in exploring the recent emerging of low-cost and fast depth cameras to advance visual communication. First, we will discuss a 3D propagation algorithm that allows efficient integration of multiple color and depth cameras in synthesizing novel views. We will show how the quality of novel view rendering can be quantitatively analyzed using the scene and sensor parameters. We will also present a novel approach for improving the resolution and quality of a depth video given its corresponding high-resolution color video. Next, we will discuss the parallelization of free-viewpoint rendering algorithms in GPU architectures. Finally, we will show experiments with synthetic and real data sets to demonstrate the potential of the proposed approach for immersive communication.

Joint work with Ha Nguyen, Quang Nguyen, Sanjay Patel, Dongbo Min, and Jiangbo Lu

Speaker Details

Minh N. Do is an Associate Professor in the Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign. His research interests include image and multi-dimensional signal processing, wavelets and multiscale geometric analysis, computational imaging, and visual information representation. He received a Silver Medal from the 32nd International Mathematical Olympiad in 1991, a University Medal from the University of Canberra in 1997, a Doctorate Award from the EPFL in 2001, a CAREER Award from the National Science Foundation in 2003, and a Young Author Best Paper Award from IEEE in 2008. He was named a Beckman Fellow at the Center for Advanced Study, UIUC, in 2006, and received of a Xerox Award for Faculty Research from the College of Engineering, UIUC, in 2007. He is an Associate Editor of the IEEE Transactions on Image Processing, and a member of the IEEE Technical Committees on Signal Processing Theory and Methods, and on Image, Video, and Multidimensional Signal Processing. He is a co-founder and CTO of Nuvixa Inc., a spin-off from UIUC to commercialize depth-based visual communication.