In this paper we propose a novel classiﬁcation based framework for ﬁnding a small number of images that summarize a given concept. Our method exploits metadata information available with the images to get category information using Latent Dirichlet Allocation. Using this category information for each image, we solve the underlying classiﬁcation problem by building a sparse classiﬁer model for each concept. We demonstrate that the images that specify the sparse model form a good summary. In particular, our summary satisﬁes important properties such as likelihood, diversity and balance in both visual and semantic sense. Furthermore, the framework allows users to specify desired distributions over categories to create personalized summaries. Experimental results on seven broad query types show that the proposed method performs better than state-of-the-art methods.