Psychophysical studies ,  show that we can recognize objects using fragments of outline contour alone. This paper proposes a new automatic visual recognition system based only on local contour features, capable of localizing objects in space and scale. The system ﬁrst builds a class-speciﬁc codebook of local fragments of contour using a novel formulation of chamfer matching. These local fragments allow recognition that is robust to within class variation, pose changes, and articulation. Boosting combines these fragments into a cascaded sliding-window classiﬁer, and mean shift is used to select strong responses as a ﬁnal set of detections. We show how learning can be performed iteratively on both training and test sets to boot-strap an improved classiﬁer. We compare with other methods based on contour and local descriptors in our detailed evaluation over 17 challenging categories, and obtain highly competitive results. The results conﬁrm that contour is indeed a powerful cue for multi-scale and multiclass visual object recognition.