Exploring Gap Filling as a Cheaper Alternative to Reading Comprehension Questionnaires when Evaluating Machine Translation for Gisting

@inproceedings{Forcada2018ExploringGF,
  title={Exploring Gap Filling as a Cheaper Alternative to Reading Comprehension Questionnaires when Evaluating Machine Translation for Gisting},
  author={M. Forcada and Carolina Scarton and Lucia Specia and B. Haddow and Alexandra Birch},
  booktitle={WMT},
  year={2018}
}
A popular application of machine translation (MT) is gisting: MT is consumed as is to make sense of text in a foreign language. Evaluation of the usefulness of MT for gisting is surprisingly uncommon. The classical method uses reading comprehension questionnaires (RCQ), in which informants are asked to answer professionally-written questions in their language about a foreign text that has been machine-translated into their language. Recently, gap-filling (GF), a form of cloze testing, has been… Expand

Figures, Tables, and Topics from this paper

Informative Manual Evaluation of Machine Translation Output

References

SHOWING 1-10 OF 40 REFERENCES
A Reading Comprehension Corpus for Machine Translation Evaluation
Quiz-Based Evaluation of Machine Translation
Does post-editing increase usability? A study with Brazilian Portuguese as target language
...
1
2
3
4
...