Scalable stacking and learning for building deep architectures

@article{Deng2012ScalableSA,
  title={Scalable stacking and learning for building deep architectures},
  author={L. Deng and Dong Yu and John C. Platt},
  journal={2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  year={2012},
  pages={2133-2136}
}
  • L. Deng, Dong Yu, John C. Platt
  • Published 2012
  • Computer Science
  • 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Deep Neural Networks (DNNs) have shown remarkable success in pattern recognition tasks. [...] Key Method The DSN provides a method of stacking simple processing modules in buiding deep architectures, with a convex learning problem in each module. Additional fine tuning further improves the DSN, while introducing minor non-convexity. Full learning in the DSN is batch-mode, making it amenable to parallel training over many machines and thus be scalable over the potentially huge size of the training data…Expand
187 Citations
Parallel Training for Deep Stacking Networks
Stacking-based deep neural network: Deep analytic network on convolutional spectral histogram features
  • C. Low, A. Teoh
  • Computer Science
  • 2017 IEEE International Conference on Image Processing (ICIP)
  • 2017
Visual Representation and Classification by Learning Group Sparse Deep Stacking Network
Tensor Deep Stacking Networks
Deep stacking networks for information retrieval
  • L. Deng, X. He, Jianfeng Gao
  • Computer Science
  • 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
  • 2013
Parallel Training of Deep Networks with Local Updates
Partitioning Large Scale Deep Belief Networks Using Dropout
On Distributed Deep Network for Processing Large-Scale Sets of Complex Data
A deep architecture with bilinear modeling of hidden representations: Applications to phonetic recognition
Stacking-Based Deep Neural Network: Deep Analytic Network for Pattern Classification
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 16 REFERENCES
Deep Convex Net: A Scalable Architecture for Speech Pattern Classification
A deep architecture with bilinear modeling of hidden representations: Applications to phonetic recognition
Learning Deep Architectures for AI
Towards deeper understanding: Deep convex networks for semantic utterance classification
Investigation of full-sequence training of deep belief networks for speech recognition
Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition
Boosting attribute and phone estimation accuracies with deep neural networks for detection-based speech recognition
The Cascade-Correlation Learning Architecture
Deep Boltzmann Machines
Gradient-based learning applied to document recognition
...
1
2
...