From textons to parts: Local image features for texture and object recognition


December 12, 2005


Svetlana Lazebnik


Beckman Institute, University of Illinois


Joint work with Jean Ponce at UIUC, and Cordelia Schmid, Jianguo Zhang, and Marcin Marszalek at INRIA Rhone-Alpes.

The key to success in many visual recognition tasks is designing the right low-level image features and combining them into rich and discriminative representations of the classes of interest. My talk will focus on representations based on local invariant features. First, I will discuss a bag-of-features approach originally designed for the problem of recognizing images of textured surfaces under perspective distortions and non-rigid deformations. Though this approach has sufficient descriptive power for modeling textures, it seems ill suited for modeling objects because it ignores spatial relations and makes no distinction between object features and clutter. However, in a recent large-scale comparative evaluation, we have shown that bags of features, combined with an appropriate SVM kernel, can be surprisingly effective for object categization in the presence of substantial clutter and intra-class variation. I will close by describing ongoing efforts to develop a more “structured” alternative to bags of features for object recognition, namely, a representation based on semi-local parts, or groups of features characterized by stable appearance and geometric layout.


Svetlana Lazebnik

Svetlana Lazebnik has received the B.S. degree in computer science from DePaul University in Chicago, IL, in 2000 and the M.S. degree in computer science from the University of Illinois at Urbana- Champaign (UIUC) in 2002. She has completed her Ph.D. thesis, entitled “Local, Semi-Local and Global Models for Texture, Object and Scene Recognition,” at UIUC in the spring of 2006. This work was co-supervised by Prof. Jean Ponce at UIUC and Dr. Cordelia Schmid at INRIA Rhone-Alpes.In July of 2007, Svetlana has joined the Computer Science department at the University of North Carolina at Chapel Hill as an assistant professor. Her research interests include computer vision, object and scene recognition, and machine learning.