Classifier Ensembles with a Random Linear Oracle


We propose a combined fusion-selection approach to classifier ensemble design. Each classifier in the ensemble is replaced by a miniensemble of a pair of subclassifiers with a random linear oracle to choose between the two. It is argued that this approach encourages extra diversity in the ensemble while allowing for high accuracy of the individual ensemble members. Experiments were carried out with 35 data sets from UCI and 11 ensemble models. Each ensemble model was examined with and without the oracle. The results showed that all ensemble methods benefited from the new approach, most markedly so random subspace and bagging. A further experiment with seven real medical data sets demonstrates the validity of these findings outside the UCI data collection

DOI: 10.1109/TKDE.2007.1016

8 Figures and Tables

Citations per Year

123 Citations

Semantic Scholar estimates that this publication has 123 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Kuncheva2007ClassifierEW, title={Classifier Ensembles with a Random Linear Oracle}, author={Ludmila I. Kuncheva and Juan Jos{\'e} Rodr{\'i}guez Diez}, journal={IEEE Transactions on Knowledge and Data Engineering}, year={2007}, volume={19} }