Reducing the dimensionality of data with neural networks.


High-dimensional data can be converted to low-dimensional codes by training a multilayer neural network with a small central layer to reconstruct high-dimensional input vectors. Gradient descent can be used for fine-tuning the weights in such "autoencoder" networks, but this works well only if the initial weights are close to a good solution. We describe an effective way of initializing the weights that allows deep autoencoder networks to learn low-dimensional codes that work much better than principal components analysis as a tool to reduce the dimensionality of data.

Extracted Key Phrases

Citations per Year

5,399 Citations

Semantic Scholar estimates that this publication has 5,399 citations based on the available data.

See our FAQ for additional information.

Cite this paper

@article{Hinton2006ReducingTD, title={Reducing the dimensionality of data with neural networks.}, author={Geoffrey E. Hinton and Ruslan Salakhutdinov}, journal={Science}, year={2006}, volume={313 5786}, pages={504-7} }