Density models are a popular tool for building classifiers. When using density models to build a classifier, one typically learns a separate density modelf or each class of interest. These density models are then combined to make a classifier through the use of Bayes’ rule utilizing the prior distribution over the classes. In this paper, we provide a discriminative method for choosing among alternative density models for each class to improve classification accuracy.