What is Minimum Description Classification?
Minimum description is an information theory based approach to supervised pattern recognition which handles complex data distributions well. Its unifying theme is data analysis based on minimizing the amount of information necessary to describe a set of observations (2). Based on comparison of probability distributions, minimum description is consistent with both maximum likelihood estimation and the time honored philosophy of the simplest explanation being the best. It also lends itself to simple geometrical interpretations.
