Corpus ID: 7509837

Three Classes of Deep Learning Architectures and Their Applications: A Tutorial Survey

  title={Three Classes of Deep Learning Architectures and Their Applications: A Tutorial Survey},
  author={L. Deng},
  • L. Deng
  • Published 2012
  • Computer Science
  • In this invited paper, my overview material on the same topic as presented in the plenary overview session of APSIPA-2011 and the tutorial material presented in the same conference (Deng, 2011) are expanded and updated to include more recent developments in deep learning. [...] Key Method Three representative deep architectures --deep auto-encoder, deep stacking network, and deep neural network (pre-trained with deep belief network) --one in each of the three classes, are presented in more detail. Next…Expand Abstract
    96 Citations
    A Study on Deep Learning Architecture and Their Applications
    A hybrid Deep Boltzmann Functional Link Network for classification problems
    • PDF
    Vanishing Gradient Mitigation with Deep Learning Neural Network Optimization
    • H. Tan, K. Lim
    • Computer Science
    • 2019 7th International Conference on Smart Computing & Communications (ICSCC)
    • 2019
    • 8
    Survey on deep learning methods in human action recognition
    • 29
    Deep Learning in Kernel Machines
    An Evaluation of Deep Learning Miniature Concerning in Soft Computing
    • 2
    A comprehensive classification of deep learning libraries
    • 5
    • PDF
    Performance Evaluation of Deep Learning frameworks on Computer Vision problems
    • 1
    Recent Deep Learning Techniques, Challenges and Its Applications for Medical Healthcare System: A Review
    • 13


    An Overview of Deep-Structured Learning for Information Processing
    • 40
    • Highly Influential
    • PDF
    Use of kernel deep convex networks and end-to-end learning for spoken language understanding
    • 96
    • Highly Influential
    • PDF
    Representation Learning: A Review and New Perspectives
    • 6,756
    • Highly Influential
    • PDF
    On optimization methods for deep learning
    • 768
    • PDF
    Why Does Unsupervised Pre-training Help Deep Learning?
    • 1,271
    • Highly Influential
    • PDF
    Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier]
    • 846
    • PDF
    Scalable stacking and learning for building deep architectures
    • L. Deng, Dong Yu, John C. Platt
    • Computer Science
    • 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
    • 2012
    • 182
    • Highly Influential
    • PDF
    Deep stacking networks for information retrieval
    • L. Deng, X. He, Jianfeng Gao
    • Computer Science
    • 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
    • 2013
    • 69
    • Highly Influential
    • PDF
    Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion
    • 4,670
    • Highly Influential
    • PDF
    A deep architecture with bilinear modeling of hidden representations: Applications to phonetic recognition
    • 43
    • Highly Influential
    • PDF