Development of low entropy coding in a recurrent network.

@article{Harpur1996DevelopmentOL,
  title={Development of low entropy coding in a recurrent network.},
  author={George Francis Harpur and Richard W. Prager},
  journal={Network},
  year={1996},
  volume={7 2},
  pages={277-84}
}
In this paper we present an unsupervised neural network which exhibits competition between units via inhibitory feedback. The operation is such as to minimize reconstruction error, both for individual patterns, and over the entire training set. A key difference from networks which perform principal components analysis, or one of its variants, is the ability to converge to non-orthogonal weight values. We discuss the network's operation in relation to the twin goals of maximizing information… CONTINUE READING