Multilayer feedforward networks are universal approximators
@article{Hornik1989MultilayerFN, title={Multilayer feedforward networks are universal approximators}, author={Kurt Hornik and Maxwell B. Stinchcombe and Halbert L. White}, journal={Neural Networks}, year={1989}, volume={2}, pages={359-366} }
17,525 Citations
Approximation capabilities of multilayer feedforward networks
- Computer ScienceNeural Networks
- 1991
Multilayer Feedforward Networks with a Non-Polynomial Activation Function Can Approximate Any Function
- Computer ScienceNeural Networks
- 1993
Neural networks for localized approximation
- Computer Science
- 1994
We prove that feedforward artificial neural networks with a single hidden layer and an ideal sigmoidal response function cannot provide localized approximation in a Euclidean space of dimension…
Neural networks with a continuous squashing function in the output are universal approximators
- Computer Science, MathematicsNeural Networks
- 2000
A constructive method for multivariate function approximation by multilayer perceptrons
- Computer ScienceIEEE Trans. Neural Networks
- 1992
It is shown how to construct a perceptron with two hidden layers for multivariate function approximation, which can perform function approximation in the same manner as networks based on Gaussian potential functions, by linear combination of local functions.
Constructive Approximation of Discontinuous Functions by Neural Networks
- Computer ScienceNeural Processing Letters
- 2007
A constructive proof that a real, piecewise continuous function can be almost uniformly approximated by single hidden-layer feedforward neural networks (SLFNNs) is given.
Function approximation using a partition of the input space
- Computer Science, Mathematics[Proceedings 1992] IJCNN International Joint Conference on Neural Networks
- 1992
It is shown that a simple geometric proof of this theorem can be extended to networks of units using a smooth output function, and a recent result on the approximation of polynomials by fixed size networks is improved.
Generalization and Approximation Capabilities of Multilayer Networks
- Computer ScienceNeural Computation
- 1993
The theory allows one to specify a finite discrete set of training data and a network structure that generalizes and approximates any given continuous mapping between sets of contours on a plane within any given permissible error.
NEURAL NETWORKS FOR OPTIMAL APPROXIMATION OF SMOOTH
- Mathematics, Computer Science
- 1996
We prove that neural networks with a single hidden layer are capable of providing an optimal order of approximation for functions assumed to possess a given number of derivatives, if the activation…
References
SHOWING 1-10 OF 25 REFERENCES
Universal approximation using feedforward networks with non-sigmoid hidden layer activation functions
- Computer ScienceInternational 1989 Joint Conference on Neural Networks
- 1989
Multilayer feedforward networks possess universal approximation capabilities by virtue of the presence of intermediate layers with sufficiently many parallel processors; the properties of the intermediate-layer activation function are not so crucial.
There exists a neural network that does not make avoidable mistakes
- Computer ScienceIEEE 1988 International Conference on Neural Networks
- 1988
The authors show that a multiple-input, single-output, single-hidden-layer feedforward network with (known) hardwired connections from input to hidden layer, monotone squashing at the hidden layer…
Approximation by superpositions of a sigmoidal function
- Computer ScienceMath. Control. Signals Syst.
- 1989
In this paper we demonstrate that finite linear combinations of compositions of a fixed, univariate function and a set of affine functionals can uniformly approximate any continuous function ofn real…
Nonlinear dynamics of artificial neural systems
- Computer Science
- 1987
It is shown that there are many powerful techniques for reducing the number of spurious terms, and that the high order approach has many advantages over a cascaded slab approach in certain problem areas.
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations
- Computer Science
- 1986
The fundamental principles, basic mechanisms, and formal analyses involved in the development of parallel distributed processing (PDP) systems are presented in individual chapters contributed by…
On the Representation of Continuous Functions of Several Variables as Superpositions of Continuous Functions of one Variable and Addition
- Mathematics
- 1991
The aim of this paper is to present a brief proof of the following theorem: Theorem. For any integer n ≥ 2 there are continuous real functions ψ p q (x) on the closed unit interval E 1 = [0;1] such…
Principles of mathematical analysis
- Mathematics
- 1964
Chapter 1: The Real and Complex Number Systems Introduction Ordered Sets Fields The Real Field The Extended Real Number System The Complex Field Euclidean Spaces Appendix Exercises Chapter 2: Basic…