A Game-Theoretic Approach to Weighted Majority Voting for Combining SVM Classifiers

@inproceedings{Georgiou2006AGA,
  title={A Game-Theoretic Approach to Weighted Majority Voting for Combining SVM Classifiers},
  author={Harris V. Georgiou and Michael E. Mavroforakis and Sergios Theodoridis},
  booktitle={ICANN},
  year={2006}
}
A new approach from the game-theoretic point of view is proposed for the problem of optimally combining classifiers in dichotomous choice situations. The analysis of weighted majority voting under the viewpoint of coalition gaming, leads to the existence of analytical solutions to optimal weights for the classifiers based on their prior competencies. The general framework of weighted majority rules (WMR) is tested against common rank-based and simple majority models, as well as two soft-output… 

A game-theoretic framework for classifier ensembles using weighted majority voting with local accuracy estimates

TLDR
Experiments indicate that this new adaptive WMR model, employing local accuracy estimators and the analytically computed optimal weights outperform all the other simple combination rules.

Collective decision efficiency and optimal voting mechanisms: A comprehensive overview for multi-classifier models

TLDR
A new game-theoretic approach for combining multiple classifiers is proposed, and a fully adaptive version of WMRs is proposed as a statistically invariant way of adjusting the design process of the optimal WMR to the arbitrary non-symmetrical properties of the underlying feature space.

A Markov Random Field Model for Combining Optimum-Path Forest Classifiers Using Decision Graphs and Game Strategy Approach

TLDR
This paper proposes a framework to combine classifiers using a decision graph under a random field model and a game strategy approach to obtain the final decision, encouraging the combination of OPF ensembles and the framework to design multiple classifier systems.

A Dataset-Level Geometric Framework for Ensemble Classifiers

TLDR
A group of properties of Majority voting and weighted majority voting formally under a dataset-level geometric framework is presented, which compares and contrast the effect of the number of component classifiers on these two types of ensemble schemes.

Optimising weights for heterogeneous ensemble of classifiers with differential evolution

TLDR
This paper proposes the use of Differential Evolution algorithm for adjustment of voting-weights of base classifiers used in a heterogeneous ensemble of classifiers (HEoC), and uses the average Matthews Correlation Coefficient, calculated over 10-fold cross-validation, as the quality measure of an ensemble.

Games People Play Conflicts, mechanisms and collective decision-making in expert committees

In this paper, a gentle introduction to Game Theory is presented in the form of basic concepts and examples. Minimax and Nash's theorem are introduced as the formal de nitions for optimal strategies

Games people play: An overview of strategic decision-making theory in conflict situations

Last updated: June 15, 2015 Abstract — In this paper, a gentle introduction to Game Theory is presented in the form of basic concepts and examples. Minimax and Nash's theorem are introduced as the

Elements of Game Theory - Part I: Foundations, acts and mechanisms

In this paper, a gentle introduction to Game Theory is presented in the form of basic concepts and examples. Minimax and Nash's theorem are introduced as the formal definitions for optimal strategies

Robust Intra-Class Distance-Based Approach for Multimodal Biometric Game Theory-Based Rank-Level Fusion of Ear, Palmprint and Signature

TLDR
An innovative verification framework based on game theory-based rank-level fusion of the high frequency information of ear images and combination of dynamic information of online signatures with the texture information of palmprint image is proposed.

References

SHOWING 1-10 OF 21 REFERENCES

The Network of Weighted Majority Rules and Weighted Majority Games

Abstract The network organizes in space the weighted majority rules (WMR) and weighted majority games (WMG). The WMRs are the potentially optimal decision rules in uncertain dichotomous choice

Optimizing group judgmental accuracy in the presence of interdependencies

AbstractConsider a group of people confronted with a dichotomous choice (for example, a yes or no decision). Assume that we can characterize each person by a probability, pi, of making the ‘better’

Leave One Out Error, Stability, and Generalization of Voting Combinations of Classifiers

TLDR
Novel bounds on the stability of combinations of any classifiers are derived that can be used to formally show that, for example, bagging increases the Stability of unstable learning machines.

The Optimal Decision Rule for Fixed-Size Committees in Dichotomous Choice Situations: The General Result

This paper presents a general pairwise choice framework and derives the optimal decision rule for fixed-size committees. The main result generalizes a number of earlier results in the subject.

A geometric approach to Support Vector Machine (SVM) classification

TLDR
The notion of "reduced convex hull" is employed and supported by a set of new theoretical results that allow existing geometric algorithms to be directly and practically applied to solve not only separable, but also nonseparable classification problems both accurately and efficiently.

An Introduction to Support Vector Machines and Other Kernel-based Learning Methods

TLDR
This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory, and will guide practitioners to updated literature, new applications, and on-line software.

A novel SVM Geometric Algorithm based on Reduced Convex Hulls

TLDR
This work exploits recent results in reduced convex hulls (RCH) and applies them to a nearest point algorithm (NPA) leading to an elegant and efficient solution to the general SVM classification task.

Support Vector Machine (SVM) classification through geometry

TLDR
In this paper a new geometric algorithm is presented, applied and compared with other non-geometric algorithms for the non-separable case.

Statistical Pattern Recognition: A Review

TLDR
The objective of this review paper is to summarize and compare some of the well-known methods used in various stages of a pattern recognition system and identify research topics and applications which are at the forefront of this exciting and challenging field.