Multicategory Support Vector Machines

@article{Lee2004MulticategorySV,
  title={Multicategory Support Vector Machines},
  author={Yoonkyung Lee and Yi Lin and Grace Wahba},
  journal={Journal of the American Statistical Association},
  year={2004},
  volume={99},
  pages={67 - 81}
}
Two-category support vector machines (SVM) have been very popular in the machine learning community for classification problems. Solving multicategory problems by a series of binary classifiers is quite common in the SVM paradigm; however, this approach may fail under various circumstances. We propose the multicategory support vector machine (MSVM), which extends the binary SVM to the multicategory case and has good theoretical properties. The proposed method provides a unifying framework when… Expand
Cloud Classification of Satellite Radiance Data by Multicategory Support Vector Machines
TLDR
The proposed MSVM in addition provides a unifying framework when there are either equal or unequal misclassification costs, and when there is a possibly nonrepresentative training set. Expand
Ensemble Approaches of Support Vector Machines for Multiclass Classification
TLDR
Two novel ensemble approaches are presented: probabilistic ordering of one-vs-rest (OVR) SVMs with naive Bayes classifier and multiple decision templates of OVR SVMs. Expand
A New Multiclass Support Vector Machine
TLDR
A new multiclass Support Vector Machine (SVM) is presented, which can be used to find the optimal decision boundaries in a multiclass classification problem, and it is believed that the proposed method provides a promising new way of looking at multiclass Classification problems. Expand
The consistency of multicategory support vector machines
TLDR
The goal of classification is to construct a classifier with small misclassification error, and the consistency of MSVMs is established under a mild condition, where the universal consistency holds true if the reproducing kernel Hilbert space is dense in C norm. Expand
A New Multiclass Support Vector Machine An Approach Using Iterative Majorization and Huber Hinge Errors
A new multiclass Support Vector Machine (SVM) is presented, which can be used to find the optimal decision boundaries in a multiclass classification problem. In the multiclass classification problemExpand
Support vector machines: A distance-based approach to multi-class classification
  • Wissam Aoudi, A. Barbar
  • Mathematics
  • 2016 IEEE International Multidisciplinary Conference on Engineering Technology (IMCET)
  • 2016
One of the main tasks sought after with machine learning is classification. Support vector machines are one of the widely used machine learning algorithms for data classification. SVMs are by defaultExpand
Support Vector Machines for Unbalanced Multicategory Classification
Classification is a very important research topic and its applications are various, because data can be easily obtained in these days. Among many techniques of classification the support vectorExpand
Reinforced Angle-Based Multicategory Support Vector Machines
  • Chong Zhang, Yufeng Liu, Junhui Wang, H. Zhu
  • Mathematics, Medicine
  • Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America
  • 2016
TLDR
It is proved that RAMSVMs can enjoy Fisher consistency, and it is shown that the RAMSVM can be implemented using the very efficient coordinate descent algorithm on its dual problem, using an angle-based prediction rule with k − 1 functions directly. Expand
Multiclass Approaches for Support Vector Machine Based Land Cover Classification
  • M. Pal
  • Computer Science
  • ArXiv
  • 2008
TLDR
Results from this study conclude the usefulness of One vs. One multi class approach in term of accuracy and computational cost over other multi class approaches. Expand
Support Vector Machine Implementations for Classification & Clustering
TLDR
Benefits of theinternal-SVM approach, along with further refinements to the internal-multiclass SVM algorithms that offer significant improvement in training time without sacrificing accuracy are described. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 154 REFERENCES
Cloud Classification of Satellite Radiance Data by Multicategory Support Vector Machines
TLDR
The proposed MSVM in addition provides a unifying framework when there are either equal or unequal misclassification costs, and when there is a possibly nonrepresentative training set. Expand
Multicategory Classification by Support Vector Machines
TLDR
This work investigates how two-class discrimination methods can be extended to the multiclass case, and shows how the linear programming (LP) and quadratic programming (QP) approaches based on Vapnik's Support Vector Machine (SVM) can be combined to yield two new approaches to theMulticlass problem. Expand
Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers
TLDR
A general method for combining the classifiers generated on the binary problems is proposed, and a general empirical multiclass loss bound is proved given the empirical loss of the individual binary learning algorithms. Expand
Support vector machines for multi-class pattern recognition
TLDR
A formulation of the SVM is proposed that enables a multi-class pattern recognition problem to be solved in a single optimisation and a similar generalization of linear programming machines is proposed. Expand
Introduction to Support Vector Machines
TLDR
Support Vector Machines (SVM’s) are intuitive, theoretically wellfounded, and have shown to be practically successful. Expand
Classification of Multiple Cancer Types by Multicategory Support Vector Machines Using Gene Expression Data
TLDR
The Multicategory SVM is introduced, which is a recently proposed extension of the binary SVM, and applied to multiclass cancer diagnosis problems, which renders the MSVM a viable alternative to other classification methods. Expand
Statistical Properties and Adaptive Tuning of Support Vector Machines
TLDR
An approach to adaptively tuning the smoothing parameter(s) in the SVMs is described, based on the generalized approximate cross validation (GACV), which is an easily computable proxy of the GCKL. Expand
From Margins to Probabilities in Multiclass Learning Problems
TLDR
A new decoding function is proposed that combines the margins through an estimate of their class conditional probabilities, which leads to good estimates of kernel parameters and the corresponding classifiers attain high accuracy. Expand
SSVM: A Smooth Support Vector Machine for Classification
TLDR
Smoothing methods are applied here to generate and solve an unconstrained smooth reformulation of the support vector machine for pattern classification using a completely arbitrary kernel, which converges globally and quadratically. Expand
CHARACTERIZING THE SOLUTION PATH OF MULTICATEGORY SUPPORT VECTOR MACHINES
An algorithm for tting the entire regularization path of the support vector machine (SVM) was recently proposed by Hastie et al. (2004). It allows eectiv e computation of solutions and greatlyExpand
...
1
2
3
4
5
...