Estimates of Storage Capacity of Multilayer Perceptron with Threshold Logic Hidden Units

@article{Kowalczyk1997EstimatesOS,
  title={Estimates of Storage Capacity of Multilayer Perceptron with Threshold Logic Hidden Units},
  author={Adam Kowalczyk},
  journal={Neural networks : the official journal of the International Neural Network Society},
  year={1997},
  volume={10 8},
  pages={1417-1433}
}
We estimate the storage capacity of multilayer perceptron with n inputs, h(1) threshold logic units in the first hidden layer and 1 output. We show that if the network can memorize 50% of all dichotomies of a randomly selected N-tuple of points of R(n) with probability 1, then N</=2(nh(1)+1), while at 100% memorization N</=nh(1)+1. Furthermore, if the… CONTINUE READING