Representation Learning: A Review and New Perspectives

@article{Bengio2013RepresentationLA,
  title={Representation Learning: A Review and New Perspectives},
  author={Yoshua Bengio and Aaron C. Courville and P. Vincent},
  journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year={2013},
  volume={35},
  pages={1798-1828}
}
  • Yoshua Bengio, Aaron C. Courville, P. Vincent
  • Published 2013
  • Computer Science, Mathematics, Medicine
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
    • The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind the data. Although specific domain knowledge can be used to help design representations, learning with generic priors can also be used, and the quest for AI is motivating the design of more powerful representation-learning algorithms implementing such priors… CONTINUE READING
    View on IEEE
    arxiv.org
    6,743 Citations
    Highly Influencial Citations
    365
    Background Citations
    3,575
    Methods Citations
    1,055
    Results Citations
    34

    Supplemental Code

    Github Repo
    Via Papers with Code
    saromanov/godownload
    Download files as in wget :file_folder:
    5 Stars • 1 Forks
    Explore Further
    Discover more papers related to the topics discussed in this paper
    6,743 Citations
    Citation Type

    Citation Type

    A Modular Theory of Feature Learning
    • 4
    • PDF
    An Overview on Data Representation Learning: From Traditional Feature Learning to Recent Deep Learning
    • 70
    • Highly Influenced
    • PDF
    The Role of the Information Bottleneck in Representation Learning
    • 17
    Sparse, hierarchical and shared-factors priors for representation learning
    • PDF
    Learning deep representations by mutual information estimation and maximization
    • 534
    • PDF
    An analysis on the use of autoencoders for representation learning: fundamentals, learning task case studies, explainability and challenges
    • 4
    • PDF
    Autonomous Learning of Representations
    • 2
    • PDF
    Relation-Guided Representation Learning
    • 3
    • PDF
    Representational learning for sonar ATR
    • J. C. Isaacs
    • Engineering, Computer Science
    • Defense + Security Symposium
    • 2014
    • 7
    Deep Dimension Reduction for Supervised Representation Learning
    • PDF

    References

    SHOWING 1-10 OF 284 REFERENCES
    Unsupervised and Transfer Learning Challenge: a Deep Learning Approach
    • 193
    • PDF
    Deep Learning of Representations for Unsupervised and Transfer Learning
    • Yoshua Bengio
    • Computer Science
    • ICML Unsupervised and Transfer Learning
    • 2012
    • 839
    • PDF
    Sparse Feature Learning for Deep Belief Networks
    • 742
    • PDF
    The Manifold Tangent Classifier
    • 226
    • PDF
    Extracting and composing robust features with denoising autoencoders
    • 4,281
    • PDF
    Understanding Representations Learned in Deep Architectures
    • 85
    • PDF
    Why Does Unsupervised Pre-training Help Deep Learning?
    • 1,268
    • PDF
    Large-Scale Learning of Embeddings with Reconstruction Sampling
    • 41
    • PDF
    A Generative Process for sampling Contractive Auto-Encoders
    • 65
    On deep generative models with applications to recognition
    • 196
    • PDF