Support vector machines: hype or hallelujah?

  title={Support vector machines: hype or hallelujah?},
  author={Kristin P. Bennett and Colin Campbell},
  journal={SIGKDD Explor.},
Support Vector Machines (SVMs) and related kernel methods have become increasingly popular tools for data mining tasks such as classification, regression, and novelty detection. The goal of this tutorial is to provide an intuitive explanation of SVMs from a geometric perspective. The classification problem is used to investigate the basic concepts behind SVMs and to examine their strengths and weaknesses from a data mining perspective. While this overview is not comprehensive, it does provide… 

Figures from this paper

Support vector machines for classification: a statistical portrait.

This chapter aims to provide an introduction to the support vector machine, covering from the basic concept of the optimal separating hyperplane to its nonlinear generalization through kernels.

Support Vector Machines with Applications

This paper is intended as an introduction to SVMs and their applications, emphasizing their key features, and some algorithmic extensions and illustrative real-world applications of SVMs are shown.

Support Vector Machines

Support Vector Machines (SVMs) are a relatively new generation of techniques for classification and regression problems. These are based on Statistical Learning Theory having its origins in Machine

Support Vector Machines * The Interface to libsvm in package e 1071

“Hype or Hallelujah?” is the provocative title used by Bennett & Campbell (2000) in an overview of Support Vector Machines (SVM). SVMs are currently a hot topic in the machine learning community,

Pattern classification by goal programming and support vector machines

This paper compares conventional methods such as SVMs and GP with the proposed multi-objective programming formulation considering surplus variables through several examples.

Support Vector Machines ∗ The Interface to libsvm in package

Far from being a panacea, SVMs yet represent a powerful technique for general (nonlinear) classification , regression and outlier detection with an intuitive model representation.

Support Vector Machines * the Interface to Libsvm in Package E1071 Basic Concept

Far from being a panacea, SVMs yet represent a powerful technique for general (nonlinear) classification , regression and outlier detection with an intuitive model representation.

Supervised classification and mathematical optimization

Support Vector Machines and Document Classification

This paper presents automatic Text categorization using SVM, a comparatively new technique with a very solid mathematical foundation for solving a variety of ‘learning from examples’ problem and gives high performance in practical applications.

Strengths and Weaknesses of Support Vector Machines Within Marketing Data Analysis

To answer this question both strengths and weaknesses of support vector machines in marketing data analysis are investigated exemplarily with special attention to the problem of selecting appropriate kernel functions and determining the belonging parameters.



Support Vector Regression Machines

This work compares support vector regression (SVR) with a committee regression technique (bagging) based on regression trees and ridge regression done in feature space and expects that SVR will have advantages in high dimensionality space because SVR optimization does not depend on the dimensionality of the input space.

Support vector machines for spam categorization

The use of support vector machines in classifying e-mail as spam or nonspam is studied by comparing it to three other classification algorithms: Ripper, Rocchio, and boosting decision trees, which found SVM's performed best when using binary features.

Text Categorization with Support Vector Machines: Learning with Many Relevant Features

This paper explores the use of Support Vector Machines (SVMs) for learning text classifiers from examples. It analyzes the particular properties of learning with text data and identifies why SVMs are

Reducing the run-time complexity of Support Vector Machines

This paper presents two relevant results: a) the use of SVM itself as a regression tool to approximate the decision surface with a user-speciied accuracy; and b) a reformulation of the training problem that yields the exact same decision surface using a smaller number of basis functions.

Bounds on Error Expectation for Support Vector Machines

It is proved that the value of the span is always smaller (and can be much smaller) than the diameter of the smallest sphere containing the support vectors, used in previous bounds.

Advances in kernel methods: support vector learning

Support vector machines for dynamic reconstruction of a chaotic system, Klaus-Robert Muller et al pairwise classification and support vector machines, Ulrich Kressel.

New Support Vector Algorithms

A new class of support vector algorithms for regression and classification that eliminates one of the other free parameters of the algorithm: the accuracy parameter in the regression case, and the regularization constant C in the classification case.

Advances in Large Margin Classifiers

This book provides an overview of recent developments in large margin classifiers, examines connections with other methods, and identifies strengths and weaknesses of the method, as well as directions for future research.

An Introduction to Support Vector Machines and Other Kernel-based Learning Methods

This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory, and will guide practitioners to updated literature, new applications, and on-line software.

The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines

This paper proposes an adaptation of the Adatron algorithm for clas-siication with kernels in high dimensional spaces that can find a solution very rapidly with an exponentially fast rate of convergence towards the optimal solution.