Ensemble methods : a review

  title={Ensemble methods : a review},
  author={Matteo R{\'e} and Giorgio Valentini},
1 Ensemble methods: a review 3 Matteo Re and Giorgio Valentini 1. 

Tables from this paper

Combining models in discrete discriminant analysis

Resumo da comunicacao em poster apresentada em International Conference on Trends and Perspectives in Linear Statistical Inference (LinStat'2010), Tomar, Portugal, 27-31 July, 2010

Towards a Transparent Deep Ensemble Method Based on Multiagent Argumentation

This paper presents a new deep ensemble method based on argumentation that combines machine learning algorithms with a multiagent system in order to explain the results of classification and to allow injecting prior knowledge.

Other Ensemble Approaches

This chapter describes several new fields, beside the feature selection preprocessing step (the theme of this book), in which ensembles have been successfully used, and the first attempts for applying the ensemble paradigm to the relatively new field of quantification are described.

A weighted voting framework for classifiers ensembles

A probabilistic framework for classifier combination is proposed, which gives rigorous optimality conditions (minimum classification error) for four combination methods: majority vote, weighted majorityVote, recall combiner and the naive Bayes combiner, revealing that there is no definitive best combiner among the four candidates.

PAC-Bayesian Theorems for Multiview Learning

A general PAC-Bayesian theory for multiview learning with more than two views is proposed and derived allowing to consider different relations between empirical and true risks by taking into account a notion of diversity of the voters and views.

Stance Detection Based on Ensembles of Classifiers

The method of constructing ensembles proposed in this paper, which is based on a cross-validation procedure, makes it possible to optimize the parameters of the base classifiers, evaluate the effectiveness of each combination of classifiers included in the set, and select the optimal combination.



Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems

This volume, written by leading researchers, presents methods of combining neural nets to improve their performance and suggests ways to improve the quality of these nets.

Stochastic discrimination

  • E. Kleinberg
  • Mathematics
    Annals of Mathematics and Artificial Intelligence
  • 2005
A general method is introduced for separating points in multidimensional spaces through the use of stochastic processes, called Stochastic discrimination.

Ensemble selection from libraries of models

A method for constructing ensembles from libraries of thousands of models using forward stepwise selection to be optimized to performance metric such as accuracy, cross entropy, mean precision, or ROC Area is presented.

Classification by Pairwise Coupling

A strategy for polychotomous classification that involves estimating class probabilities for each pair of classes, and then coupling the estimates together is discussed, similar to the Bradley-Terry method for paired comparisons.

Focused Ensemble Selection: A Diversity-Based Method for Greedy Ensemble Selection

Experimental comparison of the proposed method, dubbed Focused Ensemble Selection (FES), against state-of-the-art greedy ensemble selection methods shows that it leads to small ensembles with high predictive performance.

Ensemble Methods for Classification in Cheminformatics

We describe the application of ensemble methods to binary classification problems on two pharmaceutical compound data sets. Several variants of single and ensembles models of k-nearest neighbors

When Networks Disagree: Ensemble Methods for Hybrid Neural Networks

Experimental results show that the ensemble method dramatically improves neural network performance on difficult real-world optical character recognition tasks.

A Survey: Clustering Ensembles Techniques

The clustering ensembles combine multiple partitions generated by different clustering algorithms into a single clustering solution, representation of multiple partitions, its challenges and present taxonomy of combination algorithms.

Nonlinear independent component analysis using ensemble learning: Theory

A nonlinear version of independent component analysis is presented, using a multi-layer perceptron network and the distributions of sources are modelled by mixtures of Gaussians to estimate the posterior probability of all the unknown parameters.