## Generative models for discovering sparse distributed representations.

- G E Hinton, Z Ghahramani
- Philosophical transactions of the Royal Society…
- 1997

A simple but powerful modiication of the standard Gaussian distribution is studied. The variables of the rectiied Gaussian are constrained to be nonnegative, enabling the use of nonconvex energy functions. Two multimodal examples, the competitive and cooperative distributions, illustrate the representational power of the rectiied Gaussian. Since the… (More)