Discourse-Aware Neural Rewards for Coherent Text Generation

  title={Discourse-Aware Neural Rewards for Coherent Text Generation},
  author={Antoine Bosselut and Asli Çelikyilmaz and Xiaodong He and Jianfeng Gao and Po-Sen Huang and Yejin Choi},
In this paper, we investigate the use of discourse-aware rewards with reinforcement learning to guide a model to generate long, coherent text. In particular, we propose to learn neural rewards to model cross-sentence ordering as a means to approximate desired discourse structure. Empirical results demonstrate that a generator trained with the learned reward produces more coherent and less repetitive text than models trained with crossentropy or with reinforcement learning with commonly used… CONTINUE READING

From This Paper

Topics from this paper.


Publications referenced by this paper.
Showing 1-10 of 31 references

Similar Papers

Loading similar papers…