Learning multiple layers of representation

  title={Learning multiple layers of representation},
  author={Geoffrey E. Hinton},
  journal={Trends in Cognitive Sciences},
  • Geoffrey E. Hinton
  • Published 2007
  • Psychology, Medicine
  • Trends in Cognitive Sciences
  • To achieve its impressive performance in tasks such as speech perception or object recognition, the brain extracts multiple levels of representation from the sensory input. Backpropagation was the first computationally efficient model of how neural networks could learn multiple layers of representation, but it required labeled training data and it did not work well in deep networks. The limitations of backpropagation learning can now be overcome by using multilayer neural networks that contain… CONTINUE READING
    765 Citations

    Figures and Topics from this paper.

    Learning Representations from Deep Networks Using Mode Synthesizers
    • 1
    • PDF
    Autonomous Learning of Representations
    • 2
    • PDF
    Modeling language and cognition with deep unsupervised learning: a tutorial overview
    • 52
    • Highly Influenced
    • PDF
    Learning Deep Visual Representations
    • 3
    • PDF
    Vector LIDA
    • 6
    • PDF
    A review on advances in deep learning
    • Soniya, S. Paul, L. Singh
    • Computer Science
    • 2015 IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI)
    • 2015
    • 27
    Contributions to Deep Learning Models
    Deep Learning in Kernel Machines
    Deep learning models of biological visual information processing
    • 2
    • Highly Influenced
    • PDF
    Learning Paired-Associate Images with an Unsupervised Deep Learning Architecture


    A multi-layer sparse coding network learns contour coding from natural images
    • 172
    • PDF
    Reducing the Dimensionality of Data with Neural Networks
    • 11,520
    • PDF
    Scaling learning algorithms towards AI
    • 967
    • PDF
    A Fast Learning Algorithm for Deep Belief Nets
    • 11,239
    • PDF
    Unsupervised Learning of Image Transformations
    • 201
    • PDF