Empirical Evaluation and Combination of Advanced Language Modeling Techniques

@inproceedings{Mikolov2011EmpiricalEA,
  title={Empirical Evaluation and Combination of Advanced Language Modeling Techniques},
  author={Tomas Mikolov and Anoop Deoras and Stefan Kombrink and Luk{\'a}s Burget and Jan Cernock{\'y}},
  booktitle={INTERSPEECH},
  year={2011}
}
We present results obtained with several advanced language modeling techniques, including class based model, cache model, maximum entropy model, structured language model, random forest language model and several types of neural network based language models. We show results obtained after combining all these models by using linear interpolation. We conclude that for both small and moderately sized tasks, we obtain new state of the art results with combination of models, that is significantly… CONTINUE READING

Similar Papers

Citations

Publications citing this paper.
SHOWING 1-10 OF 184 CITATIONS, ESTIMATED 99% COVERAGE

Temporal kernel neural network language model

  • 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
  • 2013
VIEW 4 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Theano: new features and speed improvements

VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Character-Aware Neural Language Models

VIEW 12 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Diverse Embedding Neural Network Language Models

VIEW 4 EXCERPTS
CITES BACKGROUND & METHODS
HIGHLY INFLUENCED

Real-time one-pass decoding with recurrent neural network language model for speech recognition

  • 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2014
VIEW 5 EXCERPTS
CITES BACKGROUND
HIGHLY INFLUENCED

Factored Language Model based on Recurrent Neural Network

  • COLING
  • 2012
VIEW 9 EXCERPTS
CITES RESULTS, BACKGROUND & METHODS
HIGHLY INFLUENCED

FILTER CITATIONS BY YEAR

2011
2019

CITATION STATISTICS

  • 19 Highly Influenced Citations

  • Averaged 20 Citations per year over the last 3 years

References

Publications referenced by this paper.
SHOWING 1-10 OF 22 REFERENCES

Extensions of recurrent neural network language model

  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
VIEW 5 EXCERPTS
HIGHLY INFLUENTIAL

Structured Output Layer neural network language model

  • 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
  • 2011
VIEW 3 EXCERPTS

Neural network based language models for highly inflective languages

  • 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
  • 2009
VIEW 1 EXCERPT

Continuous space language models

  • Computer Speech & Language
  • 2007
VIEW 1 EXCERPT