Corpus ID: 17299272

Neural Network Regularization via Robust Weight Factorization

@article{Rudy2014NeuralNR,
  title={Neural Network Regularization via Robust Weight Factorization},
  author={Jan Rudy and Weiguang Ding and D. Im and Graham W. Taylor},
  journal={ArXiv},
  year={2014},
  volume={abs/1412.6630}
}

Jan Rudy, Weiguang Ding, +1 author Graham W. Taylor

Published 2014

Mathematics, Computer Science

ArXiv

Regularization is essential when training large neural networks. As deep neural networks can be mathematically interpreted as universal function approximators, they are effective at memorizing sampling noise in the training data. This results in poor generalization to unseen data. Therefore, it is no surprise that a new regularization technique, Dropout, was partially responsible for the now-ubiquitous winning entry to ImageNet 2012 by the University of Toronto. Currently, Dropout (and related… CONTINUE READING

View PDF on arXiv

Save to Library

Create Alert

Cite

Launch Research Feed