Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition

Abstract

This paper develops the separating capacities of families of nonlinear decision surfaces by a direct application of a theorem in classical combinatorial geometry. It is shown that a family of surfaces having d degrees of freedom has a natural separating capacity of 2d pattern vectors, thus extending and unifying results of Winder and others on the pattern-separating capacity of hyperplanes. Applying these ideas to the vertices of a binary n-cube yields bounds on the number of spherically, quadratically, and, in general, nonlinearly separable Boolean functions of n variables. It is shown that the set of all surfaces which separate a dichotomy of an infinite, random, separable set of pattern vectors can be characterized, on the average, by a subset of only 2d extreme pattern vectors. In addition, the problem of generalizing the classifications on a labeled set of pattern points to the classification of a new point is defined, and it is found that the probability of ambiguous generalization is large unless the number of training patterns exceeds the capacity of the set of separating surfaces. I. DEFINITIONS AND HISTORY OF FUNCTIONCOUNTING THEOREMS C ONSIDER a set of patterns represented by a set of vectors in a d-dimensional Euclidean space Ed. A homogeneous linear threshold function fw: Ed-{ -1, 0, 1 } is defined in terms of a parameter or weight vector w for every vector x in this space:

DOI: 10.1109/PGEC.1965.264137

4 Figures and Tables

050100'76'79'83'87'91'95'99'03'07'11'15
Citations per Year

1,428 Citations

Semantic Scholar estimates that this publication has 1,428 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Cover1965GeometricalAS, title={Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition}, author={Thomas M. Cover}, journal={IEEE Trans. Electronic Computers}, year={1965}, volume={14}, pages={326-334} }