Consensus group stable feature selection


Stability is an important yet under-addressed issue in feature selection from high-dimensional and small sample data. In this paper, we show that stability of feature selection has a strong dependency on sample size. We propose a novel framework for stable feature selection which first identifies consensus feature groups from subsampling of training samples, and then performs feature selection by treating each consensus feature group as a single entity. Experiments on both synthetic and real-world data sets show that an algorithm developed under this framework is effective at alleviating the problem of small sample size and leads to more stable feature selection results and comparable or better generalization performance than state-of-the-art feature selection algorithms. Synthetic data sets and algorithm source code are available at

DOI: 10.1145/1557019.1557084

Extracted Key Phrases

6 Figures and Tables

Citations per Year

128 Citations

Semantic Scholar estimates that this publication has 128 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@inproceedings{Loscalzo2009ConsensusGS, title={Consensus group stable feature selection}, author={Steven Loscalzo and Lei Yu and Chris H. Q. Ding}, booktitle={KDD}, year={2009} }