# Support vector machines: hype or hallelujah?

@article{Bennett2000SupportVM, title={Support vector machines: hype or hallelujah?}, author={Kristin P. Bennett and Colin Campbell}, journal={SIGKDD Explor.}, year={2000}, volume={2}, pages={1-13} }

Support Vector Machines (SVMs) and related kernel methods have become increasingly popular tools for data mining tasks such as classification, regression, and novelty detection. The goal of this tutorial is to provide an intuitive explanation of SVMs from a geometric perspective. The classification problem is used to investigate the basic concepts behind SVMs and to examine their strengths and weaknesses from a data mining perspective. While this overview is not comprehensive, it does provide… Expand

#### 670 Citations

Support vector machines for classification: a statistical portrait.

- Computer Science, Medicine
- Methods in molecular biology
- 2010

This chapter aims to provide an introduction to the support vector machine, covering from the basic concept of the optimal separating hyperplane to its nonlinear generalization through kernels. Expand

Support Vector Machines with Applications 1

- 2006

Support vector machines (SVMs) appeared in the early nineties as optimal margin classifiers in the context of Vapnik’s statistical learning theory. Since then SVMs have been successfully applied to… Expand

Support Vector Machines with Applications

- Mathematics
- 2006

Support vector machines (SVMs) appeared in the early nineties as optimal margin classiers in the context of Vapnikis statistical learning theory. Since then SVMs have been successfully applied to… Expand

Support Vector Machines

- Computer Science
- 2004

Support Vector Machines (SVMs) are a relatively new generation of techniques for classification and regression problems. These are based on Statistical Learning Theory having its origins in Machine… Expand

Support Vector Machines * The Interface to libsvm in package e 1071

- 2001

“Hype or Hallelujah?” is the provocative title used by Bennett & Campbell (2000) in an overview of Support Vector Machines (SVM). SVMs are currently a hot topic in the machine learning community,… Expand

Pattern classification by goal programming and support vector machines

- Mathematics, Computer Science
- Comput. Manag. Sci.
- 2004

This paper compares conventional methods such as SVMs and GP with the proposed multi-objective programming formulation considering surplus variables through several examples. Expand

Support Vector Machines ∗ The Interface to libsvm in package

- 2001

" Hype or Hallelujah? " is the provocative title used by Bennett & Campbell (2000) in an overview of Support Vector Machines (SVM). SVMs are currently a hot topic in the machine learning community,… Expand

Support Vector Machines * the Interface to Libsvm in Package E1071 Basic Concept

" Hype or Hallelujah? " is the provocative title used by Bennett & Campbell (2000) in an overview of Support Vector Machines (SVM). SVMs are currently a hot topic in the machine learning community,… Expand

Provably fast training algorithms for support vector machines

- Mathematics, Computer Science
- Proceedings 2001 IEEE International Conference on Data Mining
- 2001

This work presents a randomized algorithm for training SVMs in dual formulation and with kernels for which an upper bound on the expected running time that is quasilinear on the number of data points is formally proved. Expand

Supervised classification and mathematical optimization

- Mathematics, Computer Science
- Comput. Oper. Res.
- 2013

It is shown that many different areas of mathematical optimization play a central role in off-the-shelf supervised classification methods, and mathematical optimization turns out to be extremely useful to address important issues in classification. Expand

#### References

SHOWING 1-10 OF 105 REFERENCES

Support Vector Regression Machines

- Computer Science
- NIPS
- 1996

This work compares support vector regression (SVR) with a committee regression technique (bagging) based on regression trees and ridge regression done in feature space and expects that SVR will have advantages in high dimensionality space because SVR optimization does not depend on the dimensionality of the input space. Expand

Support vector machines for spam categorization

- Computer Science, Medicine
- IEEE Trans. Neural Networks
- 1999

The use of support vector machines in classifying e-mail as spam or nonspam is studied by comparing it to three other classification algorithms: Ripper, Rocchio, and boosting decision trees, which found SVM's performed best when using binary features. Expand

Text Categorization with Support Vector Machines: Learning with Many Relevant Features

- Computer Science
- ECML
- 1998

This paper explores the use of Support Vector Machines (SVMs) for learning text classifiers from examples. It analyzes the particular properties of learning with text data and identifies why SVMs are… Expand

Reducing the run-time complexity of Support Vector Machines

- Computer Science
- 1998

This paper presents two relevant results: a) the use of SVM itself as a regression tool to approximate the decision surface with a user-speciied accuracy; and b) a reformulation of the training problem that yields the exact same decision surface using a smaller number of basis functions. Expand

Bounds on Error Expectation for Support Vector Machines

- Computer Science, Medicine
- Neural Computation
- 2000

It is proved that the value of the span is always smaller (and can be much smaller) than the diameter of the smallest sphere containing the support vectors, used in previous bounds. Expand

New Support Vector Algorithms

- Medicine, Computer Science
- Neural Computation
- 2000

A new class of support vector algorithms for regression and classification that eliminates one of the other free parameters of the algorithm: the accuracy parameter in the regression case, and the regularization constant C in the classification case. Expand

Advances in Large Margin Classifiers

- Computer Science
- 2000

This book provides an overview of recent developments in large margin classifiers, examines connections with other methods, and identifies strengths and weaknesses of the method, as well as directions for future research. Expand

An Introduction to Support Vector Machines and Other Kernel-based Learning Methods

- Computer Science, Mathematics
- 2000

This is the first comprehensive introduction to Support Vector Machines (SVMs), a new generation learning system based on recent advances in statistical learning theory, and will guide practitioners to updated literature, new applications, and on-line software. Expand

The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines

- Computer Science
- ICML
- 1998

This paper proposes an adaptation of the Adatron algorithm for clas-siication with kernels in high dimensional spaces that can find a solution very rapidly with an exponentially fast rate of convergence towards the optimal solution. Expand

Comparing support vector machines with Gaussian kernels to radial basis function classifiers

- Computer Science
- IEEE Trans. Signal Process.
- 1997

The results show that on the United States postal service database of handwritten digits, the SV machine achieves the highest recognition accuracy, followed by the hybrid system, and the SV approach is thus not only theoretically well-founded but also superior in a practical application. Expand