A Challenge Set Approach to Evaluating Machine Translation

Abstract

Neural machine translation represents an exciting leap forward in translation quality. But what longstanding weaknesses does it resolve, and which remain? We address these questions with a challenge set approach to translation evaluation and error analysis. A challenge set consists of a small set of sentences, each hand-designed to probe a system’s capacity… (More)
View Slides

3 Figures and Tables

Topics

  • Presentations referencing similar topics