• Computer Science
  • Published in J. Mach. Learn. Res. 2014

Dropout: a simple way to prevent neural networks from overfitting

@article{Srivastava2014DropoutAS,
  title={Dropout: a simple way to prevent neural networks from overfitting},
  author={Nitish Srivastava and Geoffrey E. Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov},
  journal={J. Mach. Learn. Res.},
  year={2014},
  volume={15},
  pages={1929-1958}
}
Deep neural nets with a large number of parameters are very powerful machine learning systems. However, overfitting is a serious problem in such networks. Large networks are also slow to use, making it difficult to deal with overfitting by combining the predictions of many different large neural nets at test time. Dropout is a technique for addressing this problem. The key idea is to randomly drop units (along with their connections) from the neural network during training. This prevents units… CONTINUE READING

Citations

Publications citing this paper.
SHOWING 1-10 OF 10,500 CITATIONS

A Multi-View Deep Learning Framework for EEG Seizure Detection

  • IEEE Journal of Biomedical and Health Informatics
  • 2019
VIEW 5 EXCERPTS
HIGHLY INFLUENCED

A Platform Agnostic Dual-Strand Hate Speech Detector

VIEW 5 EXCERPTS
CITES BACKGROUND & RESULTS
HIGHLY INFLUENCED

Cascading: Association Augmented Sequential Recommendation

Xu Chen, Kenan Cui, Ya Zhang, Yanfeng Wang
  • ArXiv
  • 2019
VIEW 13 EXCERPTS
CITES METHODS
HIGHLY INFLUENCED

Deep learning for time series classification: a review

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Detection of Rogue RF Transmitters using Generative Adversarial Nets

  • 2019 IEEE Wireless Communications and Networking Conference (WCNC)
  • 2019
VIEW 5 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2000
2019

CITATION STATISTICS

  • 1,192 Highly Influenced Citations

  • Averaged 2,956 Citations per year from 2017 through 2019

References

Publications referenced by this paper.
SHOWING 1-10 OF 32 REFERENCES

Acoustic Modeling Using Deep Belief Networks

  • IEEE Transactions on Audio, Speech, and Language Processing
  • 2012
VIEW 3 EXCERPTS

Convolutional neural networks applied to house numbers digit classification

  • Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012)
  • 2012
VIEW 3 EXCERPTS
HIGHLY INFLUENTIAL

Best practices for convolutional neural networks applied to visual document analysis

  • Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings.
  • 2003
VIEW 2 EXCERPTS
HIGHLY INFLUENTIAL