Corpus ID: 5201925

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling

@article{Chung2014EmpiricalEO,
  title={Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling},
  author={J. Chung and Çaglar G{\"u}lçehre and Kyunghyun Cho and Yoshua Bengio},
  journal={ArXiv},
  year={2014},
  volume={abs/1412.3555}
}
In this paper we compare different types of recurrent units in recurrent neural networks (RNNs. [...] Key Result Also, we found GRU to be comparable to LSTM.Expand
5,757 Citations
Memory visualization for gated recurrent neural networks in speech recognition
The Statistical Recurrent Unit
Investigating gated recurrent neural networks for acoustic modeling
Simplified minimal gated unit variations for recurrent neural networks
  • Joel Heck, F. Salem
  • Computer Science, Mathematics
  • 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS)
  • 2017
Residual Recurrent Neural Networks for Learning Sequential Representations
Simplified gating in long short-term memory (LSTM) recurrent neural networks
  • Yuzhen Lu, F. Salem
  • Computer Science, Mathematics
  • 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS)
  • 2017
Sequence Modeling using Gated Recurrent Neural Networks
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 22 REFERENCES
Learning long-term dependencies with gradient descent is difficult
Advances in optimizing recurrent networks
Speech recognition with deep recurrent neural networks
Sequence to Sequence Learning with Neural Networks
Generating Sequences With Recurrent Neural Networks
Supervised Sequence Labelling with Recurrent Neural Networks
  • A. Graves
  • Computer Science
  • Studies in Computational Intelligence
  • 2008
On the difficulty of training recurrent neural networks
Learning Recurrent Neural Networks with Hessian-Free Optimization
Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks
...
1
2
3
...