Corpus ID: 17048224

Recurrent neural network based language model

@inproceedings{Mikolov2010RecurrentNN,
  title={Recurrent neural network based language model},
  author={Tomas Mikolov and M. Karafi{\'a}t and L. Burget and J. Cernock{\'y} and S. Khudanpur},
  booktitle={INTERSPEECH},
  year={2010}
}
A new recurrent neural network based language model (RNN LM) with applications to speech recognition is presented. Results indicate that it is possible to obtain around 50% reduction of perplexity by using mixture of several RNN LMs, compared to a state of the art backoff language model. Speech recognition experiments show around 18% reduction of word error rate on the Wall Street Journal task when comparing models trained on the same amount of data, and around 5% on the much harder NIST RT05… Expand
4,341 Citations
Recurrent Neural Network Based Language Modeling in Meeting Recognition
  • 125
  • PDF
Comparison of feedforward and recurrent neural network language models
  • 113
  • PDF
An improved recurrent neural network language model with context vector features
  • J. Zhang, Dan Qu, Z. Li
  • Computer Science
  • 2014 IEEE 5th International Conference on Software Engineering and Service Science
  • 2014
  • 3
Feed forward pre-training for recurrent neural network language models
  • 6
  • Highly Influenced
  • PDF
Large Scale Hierarchical Neural Network Language Models
  • 27
  • PDF
LSTM Neural Networks for Language Modeling
  • 1,277
  • PDF
Multiple parallel hidden layers and other improvements to recurrent neural network language modeling
  • D. Caseiro, A. Ljolje
  • Computer Science
  • 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
  • 2013
  • 3
Deep Neural Network Language Models
  • 170
  • Highly Influenced
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 21 REFERENCES
Training Neural Network Language Models on Very Large Corpora
  • 125
  • PDF
Hierarchical Probabilistic Neural Network Language Model
  • 872
  • PDF
Neural network based language models for highly inflective languages
  • 79
  • PDF
Adaptive Importance Sampling to Accelerate Training of a Neural Probabilistic Language Model
  • 170
  • PDF
Self-supervised discriminative training of statistical language models
  • 35
  • PDF
A Neural Probabilistic Language Model
  • 4,928
  • PDF
Learning long-term dependencies with gradient descent is difficult
  • 5,162
  • PDF
The 2005 AMI System for the Transcription of Speech in Meetings
  • 77
  • PDF
The AMI System for the Transcription of Speech in Meetings
  • 86
  • PDF
Fast Text Compression with Neural Networks
  • 48
  • Highly Influential
  • PDF
...
1
2
3
...