Differentiable lower bound for expected BLEU score

@article{Zhukov2017DifferentiableLB,
  title={Differentiable lower bound for expected BLEU score},
  author={Vlad Zhukov and Maksim Kretov},
  journal={ArXiv},
  year={2017},
  volume={abs/1712.04708}
}
In natural language processing tasks performance of the models is often measured with some non-differentiable metric, such as BLEU score. To use efficient gradient-based methods for optimization, it is a common workaround to optimize some surrogate loss function. This approach is effective if optimization of such loss also results in improving target metric. The corresponding problem is referred to as loss-evaluation mismatch. In the present work we propose a method for calculation of… CONTINUE READING
5
Twitter Mentions

References

Publications referenced by this paper.

Similar Papers