Highly Influenced

# Nets with Unreliable Hidden Nodes Learn Error-Correcting Codes

@inproceedings{Judd1992NetsWU, title={Nets with Unreliable Hidden Nodes Learn Error-Correcting Codes}, author={J. Stephen Judd and Paul W. Munro}, booktitle={NIPS}, year={1992} }

- Published in NIPS 1992

In a multi-layered neural network, anyone of the hidden layers can be viewed as computing a distributed representation of the input. Several "encoder" experiments have shown that when the representation space is small it can be fully used. But computing with such a representation requires completely dependable nodes. In the case where the hidden nodes are noisy and unreliable, we find that error correcting schemes emerge simply by using noisy units during training; random errors injected duringâ€¦Â CONTINUE READING