On the Computational Power of Neural Nets

@inproceedings{Siegelmann1992OnTC,
  title={On the Computational Power of Neural Nets},
  author={Hava T. Siegelmann and Eduardo D. Sontag},
  booktitle={COLT},
  year={1992}
}
This paper deals with finite networks which consist of interconnections of synchronously evolving processors. Each processor updates its state by applying a “sigmoidal” scalar nonlinearity to a linear combination of the previous states of all units. We prove that one may simulate all Turing Machines by rational nets. In particular, one can do this in linear time, and there is a net made up of about 1,000 processors which computes a universal partial-recursive function. Products (high order nets… CONTINUE READING