An Information Theoretic Perspective on Multiple Classifier Systems

  title={An Information Theoretic Perspective on Multiple Classifier Systems},
  author={Gavin Brown},
This paper examines the benefits that information theory can bring to the study of multiple classifier systems. We discuss relationships between the mutual information and the classification error of a predictor. We proceed to discuss how this concerns ensemble systems, by showing a natural expansion of the ensemble mutual information into “accuracy” and “diversity” components. This natural derivation of a diversity term is an alternative to previous attempts to artificially define a term. The… CONTINUE READING
Highly Cited
This paper has 53 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.


Publications citing this paper.

53 Citations

Citations per Year
Semantic Scholar estimates that this publication has 53 citations based on the available data.

See our FAQ for additional information.


Publications referenced by this paper.

Similar Papers

Loading similar papers…