Representation Learning: A Review and New Perspectives

  title={Representation Learning: A Review and New Perspectives},
  author={Yoshua Bengio and Aaron C. Courville and P. Vincent},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  • Yoshua Bengio, Aaron C. Courville, P. Vincent
  • Published 2013
  • Computer Science, Mathematics, Medicine
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind the data. Although specific domain knowledge can be used to help design representations, learning with generic priors can also be used, and the quest for AI is motivating the design of more powerful representation-learning algorithms implementing such priors… CONTINUE READING
    6,743 Citations
    A Modular Theory of Feature Learning
    • 4
    • PDF
    An Overview on Data Representation Learning: From Traditional Feature Learning to Recent Deep Learning
    • 70
    • Highly Influenced
    • PDF
    The Role of the Information Bottleneck in Representation Learning
    • 17
    Sparse, hierarchical and shared-factors priors for representation learning
    • PDF
    Autonomous Learning of Representations
    • 2
    • PDF
    Relation-Guided Representation Learning
    • 3
    • PDF
    Representational learning for sonar ATR
    • J. C. Isaacs
    • Engineering, Computer Science
    • Defense + Security Symposium
    • 2014
    • 7
    Deep Dimension Reduction for Supervised Representation Learning
    • PDF


    Unsupervised and Transfer Learning Challenge: a Deep Learning Approach
    • 193
    • PDF
    Deep Learning of Representations for Unsupervised and Transfer Learning
    • Yoshua Bengio
    • Computer Science
    • ICML Unsupervised and Transfer Learning
    • 2012
    • 839
    • PDF
    Sparse Feature Learning for Deep Belief Networks
    • 742
    • PDF
    The Manifold Tangent Classifier
    • 226
    • PDF
    Extracting and composing robust features with denoising autoencoders
    • 4,281
    • PDF
    Understanding Representations Learned in Deep Architectures
    • 85
    • PDF
    Why Does Unsupervised Pre-training Help Deep Learning?
    • 1,268
    • PDF
    Large-Scale Learning of Embeddings with Reconstruction Sampling
    • 41
    • PDF
    A Generative Process for sampling Contractive Auto-Encoders
    • 65
    On deep generative models with applications to recognition
    • 196
    • PDF