Bridgeout: Stochastic Bridge Regularization for Deep Neural Networks
@article{Khan2018BridgeoutSB, title={Bridgeout: Stochastic Bridge Regularization for Deep Neural Networks}, author={Najeeb Khan and J. Shah and I. Stavness}, journal={IEEE Access}, year={2018}, volume={6}, pages={42961-42970} }
A major challenge in training deep neural networks is <italic>overfitting</italic>, i.e. inferior performance on unseen test examples compared to performance on training examples. To reduce overfitting, stochastic regularization methods have shown superior performance compared to deterministic weight penalties on a number of image recognition tasks. Stochastic methods, such as Dropout and Shakeout, in expectation, are equivalent to imposing a ridge and elastic-net penalty on the model… Expand
Figures, Tables, and Topics from this paper
8 Citations
Adaptive Low-Rank Factorization to regularize shallow and deep neural networks
- Computer Science, Mathematics
- ArXiv
- 2020
- PDF
Filter Bank Regularization of Convolutional Neural Networks
- Computer Science, Mathematics
- ArXiv
- 2019
- PDF
Theory of adaptive SVD regularization for deep neural networks
- Computer Science, Medicine
- Neural Networks
- 2020
- 4
Sparseout: Controlling Sparsity in Deep Networks
- Computer Science, Mathematics
- Canadian Conference on AI
- 2019
- 1
- PDF
Multi-Layered Basis Pursuit Algorithms for Classification of MR Images of Knee ACL Tear
- Computer Science
- IEEE Access
- 2020
Regularized Deep Networks in Intelligent Transportation Systems: A Taxonomy and a Case Study
- Computer Science
- ArXiv
- 2019
- 2
- PDF
References
SHOWING 1-10 OF 45 REFERENCES
Shakeout: A New Regularized Deep Neural Network Training Scheme
- Computer Science
- AAAI
- 2016
- 40
- Highly Influential
Dropout: a simple way to prevent neural networks from overfitting
- Computer Science
- J. Mach. Learn. Res.
- 2014
- 21,834
- Highly Influential
- PDF
ImageNet classification with deep convolutional neural networks
- Computer Science
- Commun. ACM
- 2012
- 61,159
- PDF
Improving deep neural networks for LVCSR using rectified linear units and dropout
- Computer Science
- 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
- 2013
- 1,011
- PDF
Deep Residual Learning for Image Recognition
- Computer Science
- 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
- 2016
- 62,797
- PDF
Dropout Training as Adaptive Regularization
- Computer Science, Mathematics
- NIPS
- 2013
- 417
- Highly Influential
- PDF