Maximum Entropy Connections: Neural Networks

@inproceedings{Mackay1991MaximumEC,
  title={Maximum Entropy Connections: Neural Networks},
  author={David J. C. Mackay},
  year={1991}
}
Maximum entropy estimation of probability distributions constitutes a theoretical foundation for the Hopfield associative memory. Subject to knowledge of the first and second order statistics of a collection of binary variables, the maximum entropy distribution is the exponential of a Hopfield network’s energy. In a special case, an explicit expression for the connection strengths in this maximum entropy net is given; this converges exactly to Hopfield’s covariance prescription in the limit of… CONTINUE READING

Similar Papers

Citations

Publications citing this paper.
SHOWING 1-10 OF 15 CITATIONS

Bayesian retrieval in associative memories with storage errors

  • IEEE Trans. Neural Networks
  • 1998
VIEW 4 EXCERPTS
CITES METHODS & BACKGROUND
HIGHLY INFLUENCED

Efficient Associative Computation with Discrete Synapses

  • Neural Computation
  • 2016
VIEW 1 EXCERPT
CITES METHODS

Distributed associative memory

VIEW 2 EXCERPTS
CITES METHODS