Deep learning in neural networks: An overview

@article{Schmidhuber2015DeepLI,
  title={Deep learning in neural networks: An overview},
  author={J. Schmidhuber},
  journal={Neural networks : the official journal of the International Neural Network Society},
  year={2015},
  volume={61},
  pages={
          85-117
        }
}
  • J. Schmidhuber
  • Published 2015
  • Computer Science, Medicine
  • Neural networks : the official journal of the International Neural Network Society
In recent years, deep artificial neural networks (including recurrent ones) have won numerous contests in pattern recognition and machine learning. This historical survey compactly summarizes relevant work, much of it from the previous millennium. Shallow and Deep Learners are distinguished by the depth of their credit assignment paths, which are chains of possibly learnable, causal links between actions and effects. I review deep supervised learning (also recapitulating the history of… Expand
Deep Reinforcement Learning: An Overview
A Shallow Introduction to Deep Neural Networks
A Tutorial on Deep Neural Networks for Intelligent Systems
Deep learning and Its Development
Recent Advances in Deep Learning: An Overview
Neural network models and deep learning
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 1,173 REFERENCES
Co-evolving recurrent neurons learn deep memory POMDPs
Neural Networks: Tricks of the Trade
Adaptive dropout for training deep neural networks
Unsupervised Learning Procedures for Neural Networks
  • S. Becker
  • Computer Science
  • Int. J. Neural Syst.
  • 1991
A Learning Algorithm for Continually Running Fully Recurrent Neural Networks
Learning long-term dependencies with gradient descent is difficult
Forecasting with Recurrent Neural Networks: 12 Tricks
...
1
2
3
4
5
...