Dropout (neural networks)

Known as: Dropout, Dropout training 
Dropout is a regularization technique for reducing overfitting in neural networks by preventing complex co-adaptations on training data. It is a very… (More)
Wikipedia

Papers overview

Semantic Scholar uses AI to extract papers important to this topic.
Highly Cited
2017
Highly Cited
2017
We explore a recently proposed Variational Dropout technique that provided an elegant Bayesian interpretation to Gaussian Dropout… (More)
  • figure 1
  • table 1
  • table 2
  • figure 2
  • figure 3
Is this relevant?
Highly Cited
2016
Highly Cited
2016
Recurrent neural networks (RNNs) stand at the forefront of many recent developments in deep learning. Yet a major difficulty with… (More)
  • figure 1
  • table 1
  • figure 2
  • figure 3
  • figure 4
Is this relevant?
Highly Cited
2014
Highly Cited
2014
Deep neural nets with a large number of parameters are very powerful machine learning systems. However, overfitting is a serious… (More)
  • figure 1
  • figure 2
  • figure 3
  • table 1
  • table 2
Is this relevant?
Highly Cited
2013
Highly Cited
2013
Recently, pre-trained deep neural networks (DNNs) have outperformed traditional acoustic models based on Gaussian mixture models… (More)
  • table 1
  • table 2
Is this relevant?
Highly Cited
2013
Highly Cited
2013
We introduce DropConnect, a generalization of Dropout (Hinton et al., 2012), for regularizing large fully-connected layers within… (More)
  • figure 1
  • table 1
  • table 2
  • figure 2
  • table 3
Is this relevant?
Highly Cited
2013
Highly Cited
2013
We introduce a simple and effective method for regularizing large convolutional neural networks. We replace the conventional… (More)
  • figure 1
  • figure 2
  • figure 3
  • table 1
  • figure 4
Is this relevant?
Highly Cited
2013
Highly Cited
2013
Improving Neural Networks with Dropout Nitish Srivastava Master of Science Graduate Department of Computer Science University of… (More)
  • figure 2.1
  • figure 2.3
  • table 2.1
  • table 2.2
  • table 2.3
Is this relevant?
Highly Cited
2013
Highly Cited
2013
Recently, a new acoustic model based on deep neural networks (DNN) has been introduced. While the DNN has generated significant… (More)
  • table 1
  • table 3
  • table 2
  • table 4
Is this relevant?
Highly Cited
2012
Highly Cited
2012
We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC… (More)
  • figure 1
  • figure 2
  • figure 3
  • table 2
  • figure 4
Is this relevant?
Highly Cited
2012
Highly Cited
2012
When a large feedforward neural network is trained on a small training set, it typically performs poorly on held-out test data… (More)
  • figure 1
  • figure 2
  • figure 3
  • figure 4
  • figure 5
Is this relevant?