Probability Density Estimation Using Entropy Maximization

  title={Probability Density Estimation Using Entropy Maximization},
  author={Gad Miller and David Horn},
  journal={Neural Computation},
We propose a method for estimating probability density functions and conditional density functions by training on data produced by such distributions. The algorithm employs new stochastic variables that amount to coding of the input, using a principle of entropy maximization. It is shown to be closely related to the maximum likelihood approach. The encoding step of the algorithm provides an estimate of the probability distribution. The decoding step serves as a generative mode, producing an… CONTINUE READING


Publications citing this paper.
Showing 1-10 of 10 extracted citations


Publications referenced by this paper.
Showing 1-9 of 9 references

Nonlinear neurons in the low noise

  • manuscript. Nadal, J.-P, N. Parga
  • 1994

Nonlinear neurons in the low noise limit : a factorial code maximizes information transfer

  • J.-P. Nadal, N. Parga
  • Network
  • 1994
1 Excerpt

Similar Papers

Loading similar papers…