Implicit Distortion and Fertility Models for Attention-based Encoder-Decoder NMT Model

@article{Feng2016ImplicitDA,
  title={Implicit Distortion and Fertility Models for Attention-based Encoder-Decoder NMT Model},
  author={Shi Feng and Shujie Liu and Mu Li and Ming Zhou},
  journal={CoRR},
  year={2016},
  volume={abs/1601.03317}
}
Neural machine translation has shown very promising results lately. Most NMT models follow the encoder-decoder framework. To make encoder-decoder models more flexible, attention mechanism was introduced to machine translation and also other tasks like speech recognition and image captioning. We observe that the quality of translation by attention-based encoder-decoder can be significantly damaged when the alignment is incorrect. We attribute these problems to the lack of distortion and… CONTINUE READING
Highly Cited
This paper has 37 citations. REVIEW CITATIONS
Recent Discussions
This paper has been referenced on Twitter 10 times over the past 90 days. VIEW TWEETS
25 Citations
23 References
Similar Papers

Citations

Publications citing this paper.
Showing 1-10 of 25 extracted citations

References

Publications referenced by this paper.
Showing 1-10 of 23 references

Similar Papers

Loading similar papers…