Scalable stacking and learning for building deep architectures

@article{Deng2012ScalableSA,
  title={Scalable stacking and learning for building deep architectures},
  author={L. Deng and Dong Yu and John C. Platt},
  journal={2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  year={2012},
  pages={2133-2136}
}
  • L. Deng, Dong Yu, John C. Platt
  • Published 2012
  • Computer Science
  • 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Deep Neural Networks (DNNs) have shown remarkable success in pattern recognition tasks. [...] Key Method The DSN provides a method of stacking simple processing modules in buiding deep architectures, with a convex learning problem in each module. Additional fine tuning further improves the DSN, while introducing minor non-convexity. Full learning in the DSN is batch-mode, making it amenable to parallel training over many machines and thus be scalable over the potentially huge size of the training data…Expand
187 Citations
Parallel Training for Deep Stacking Networks
  • 24
  • PDF
Stacking-based deep neural network: Deep analytic network on convolutional spectral histogram features
  • C. Low, A. Teoh
  • Computer Science
  • 2017 IEEE International Conference on Image Processing (ICIP)
  • 2017
  • 9
  • PDF
Visual Representation and Classification by Learning Group Sparse Deep Stacking Network
  • 13
  • Highly Influenced
Tensor Deep Stacking Networks
  • 132
  • PDF
Deep stacking networks for information retrieval
  • L. Deng, X. He, Jianfeng Gao
  • Computer Science
  • 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
  • 2013
  • 72
  • PDF
Parallel Training of Deep Networks with Local Updates
  • PDF
Partitioning Large Scale Deep Belief Networks Using Dropout
  • PDF
On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
  • 3
  • PDF
A deep architecture with bilinear modeling of hidden representations: Applications to phonetic recognition
  • 45
  • PDF
Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification
  • 7
  • Highly Influenced
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 16 REFERENCES
Deep Convex Net: A Scalable Architecture for Speech Pattern Classification
  • 142
  • PDF
A deep architecture with bilinear modeling of hidden representations: Applications to phonetic recognition
  • 45
  • PDF
Learning Deep Architectures for AI
  • 6,586
  • PDF
Towards deeper understanding: Deep convex networks for semantic utterance classification
  • 107
  • PDF
Investigation of full-sequence training of deep belief networks for speech recognition
  • 212
  • PDF
Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition
  • 2,498
  • PDF
Boosting attribute and phone estimation accuracies with deep neural networks for detection-based speech recognition
  • 74
  • PDF
The Cascade-Correlation Learning Architecture
  • 2,853
  • PDF
Deep Boltzmann Machines
  • 1,837
  • PDF
Gradient-based learning applied to document recognition
  • 28,166
  • PDF
...
1
2
...