Decoding with Large-Scale Neural Language Models Improves Translation

  title={Decoding with Large-Scale Neural Language Models Improves Translation},
  author={Ashish Vaswani and Yinggong Zhao and Victoria Fossum and David Chiang},
We explore the application of neural language models to machine translation. We develop a new model that combines the neural probabilistic language model of Bengio et al., rectified linear units, and noise-contrastive estimation, and we incorporate it into a machine translation system both by reranking k-best lists and by direct integration into the decoder. Our large-scale, large-vocabulary experiments across four language pairs show that our neural language model improves translation quality… CONTINUE READING
Highly Influential
This paper has highly influenced 31 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 202 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.
144 Citations
23 References
Similar Papers


Publications citing this paper.
Showing 1-10 of 144 extracted citations

203 Citations

Citations per Year
Semantic Scholar estimates that this publication has 203 citations based on the available data.

See our FAQ for additional information.

Similar Papers

Loading similar papers…