Deliberation Networks: Sequence Generation Beyond One-Pass Decoding

  title={Deliberation Networks: Sequence Generation Beyond One-Pass Decoding},
  author={Yingce Xia and Fei Tian and Lijun Wu and Jianxin Lin and Tao Qin and Nenghai Yu and Tie-Yan Liu},
The encoder-decoder framework has achieved promising progress for many sequence generation tasks, including machine translation, text summarization, dialog system, image captioning, etc. Such a framework adopts an one-pass forward process while decoding and generating a sequence, but lacks the deliberation process: A generated sequence is directly used as final output without further polishing. However, deliberation is a common behavior in human’s daily life like reading news and writing papers… CONTINUE READING
Highly Cited
This paper has 30 citations. REVIEW CITATIONS

From This Paper

Figures, tables, results, and topics from this paper.

Key Quantitative Results

  • On the WMT 2014 English-to-French translation task, our model establishes a new state-of-the-art BLEU score of 41.5.


Publications citing this paper.
Showing 1-10 of 23 extracted citations

Similar Papers

Loading similar papers…