The Nature of Statistical Learning Theory

@inproceedings{Vapnik2000TheNO,
  title={The Nature of Statistical Learning Theory},
  author={Vladimir Naumovich Vapnik},
  booktitle={Statistics for Engineering and Information Science},
  year={2000}
}
  • V. Vapnik
  • Published in
    Statistics for Engineering…
    2000
  • Computer Science
Setting of the learning problem consistency of learning processes bounds on the rate of convergence of learning processes controlling the generalization ability of learning processes constructing learning algorithms what is important in learning theory?. 

Introduction to Statistical Learning Theory

TLDR
This tutorial introduces the techniques that are used to obtain results in the form of so-called error bounds in statistical learning theory.

The key theorem of learning theory about examples corrupted by noise

TLDR
This work gives the key theorem when the outputs are corrupted by noise, i.e. noise-free case, and investigates the conditions for consistency of the learning processes based on the empirical risk minimization induction principle.

The bounds of learning processes on possibility space

TLDR
The bounds of the learning processes on possibility space are discussed, the rate of relative uniform convergence is estimated, and the relation between the rates of convergence and the capacity of a set of function is pointed out.

Foundations of Statistical Learning and Model Selection

What the reader should know to understand this chapter \(\bullet \) Basic notions of machine learning. \(\bullet \) Notions of calculus. \(\bullet \) Chapter 5.

Bounds on the rate of uniform convergence of learning processes with equality-expect noise samples on quasi-probability space

TLDR
The bounds on the rate of uniform convergence of learning processes when samples are corrupted by equality-expect noise on quasi-probability space are dealt with.

Online Methods in Learning Theory

TLDR
Predictive error bounds for the Bayes mixture and MDL with respect to a countable model class are presented and how assertions and improvements might be obtained for active learning are discussed.

Qualitative Robustness of Bootstrap Approximations for Kernel Based Methods

The finite sample distribution of many nonparametric methods from statistical learning theory is unknown because the distribution P from which the data were generated is unknown and because there

Statistical learning theory

TLDR
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.

Statistical Learning Theory

TLDR
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.

Learning Theory and Support Vector Machines - a primer

TLDR
A brief introduction to the fundamentals of statistical learning theory, in particular the difference between empirical and structural risk minimization, including one of its most prominent implementations, i.e. the Support Vector Machine.
...

References

SHOWING 1-10 OF 72 REFERENCES

Statistical learning theory

TLDR
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.

Statistical Decision Theory and Bayesian Analysis

An overview of statistical decision theory, which emphasizes the use and application of the philosophical ideas and mathematical structure of decision theory. The text assumes a knowledge of basic

Subset Selection in Regression

8. Subset Selection in Regression (Monographs on Statistics and Applied Probability, no. 40). By A. J. Miller. ISBN 0 412 35380 6. Chapman and Hall, London, 1990. 240 pp. £25.00.

Statistical predictor identification

In a recent paper by the present author [1] a simple practical procedure of predictor identification has been proposed. It is the purpose of this paper to provide a theoretical and empirical basis of

Contributions to Mathematical Statistics

Contributions to Mathematical StatisticsBy Prof. R. A. Fisher. (Wiley Publications in Statistics.) Pp. xvii + 658. (New York: John Wiley and Sons, Inc.; London: Chapman and Hall, Ltd., 1950.) 60s.

Vapnik-Chervonenkis bounds for generalization

The authors review the Vapnik and Chervonenkis theorem as applied to the problem of generalization. By combining some of the technical modifications proposed in the literature they derive tighter

Projection Pursuit Regression

Abstract A new method for nonparametric multiple regression is presented. The procedure models the regression surface as a sum of general smooth functions of linear combinations of the predictor

Classification into two Multivariate Normal Distributions with Different Covariance Matrices

Linear procedures for classifying an observation as coming from one of two multivariate normal distributions are studied in the case that the two distributions differ both in mean vectors and

On the Length of Programs for Computing Finite Binary Sequences

TLDR
An application to the problem of defining a patternless sequence is proposed in terms of the concepts here developed to study the use of Turing machines for calculating finite binary sequences.
...