Corpus ID: 17848183

Perception vs. reality: measuring machine translation post-editing productivity

@inproceedings{Gaspari2014PerceptionVR,
  title={Perception vs. reality: measuring machine translation post-editing productivity},
  author={Federico Gaspari and Antonio Toral and Sudip Kumar Naskar and Declan Groves and Andy Way},
  booktitle={AMTA},
  year={2014}
}
This paper presents a study of user-perceived vs real machine translation (MT) post-editing effort and productivity gains, focusing on two bidirectional language pairs: English—German and English—Dutch. Twenty experienced media professionals post-edited statistical MT output and also manually translated comparative texts within a production environment. The paper compares the actual post-editing time against the users’ perception of the effort and time required to post-edit the MT output to… Expand
Quantifying the Effect of Machine Translation in a High-Quality Human Translation Production Process
TLDR
The results show that while the usage of MT leads to productivity gains on average, this is not the case for all translators, and the two technical effort indicators used in this study show weak correlations with post-editing time. Expand
Cognitive Effort in Post-Editing of Machine Translation
TLDR
This thesis presents an empirical study that examines MT post-editing by contrasting the cognitive effort required by this activity with a number of its key elements, including characteristics of the source text and of the MT output, post-edsitors’ individual traits, and the quality of the post-edited text assessed by human evaluators. Expand
Translation vs Post-editing of NMT Output: Measuring effort in the English-Greek language pair
Machine Translation (MT) has been increasingly used in industrial translation production scenarios thanks to the development of Neural Machine Translation (NMT) models and the improvement of MTExpand
Translation Methods and Experience: A Comparative Analysis of Human Translation and Post-editing with Students and Professional Translators
TLDR
A better understanding is aimed of the differences between human translation and post-editing for newspaper articles and how they are performed by students as well as professionals so that pitfalls can be determined and translator training can be adapted accordingly. Expand
Translation Quality and Effort: Options versus Post-editing
TLDR
This paper directly compares two common assistance types – selection from lists of translation options, and postediting of machine translation output produced by Google Translate – across two significantly different subject domains for Chinese-to-English translation. Expand
Translators’ perceptions of literary post-editing using statistical and neural machine translation
TLDR
An experiment using statistical and neural MT systems to translate literature and six professional translators with experience of literary translation produced English-to-Catalan translations under three conditions: translation from scratch, neural MT post-editing, and statistical MT post -editing. Expand
Machine translation and Welsh: analysing free statistical machine translation for the professional translation of an under-researched language pair
TLDR
A key-logging study carried out to test the benefits of post-editing Machine Translation for the professional translator within a hypothetico-deductive framework finds little difference in quality between the translated and post-edited texts, and that both sets of texts were acceptable according to accuracy and fidelity. Expand
MMPE: A Multi-Modal Interface for Post-Editing Machine Translation
TLDR
MMPE is presented, the first prototype to combine traditional input modes with pen, touch, and speech modalities for PE of MT, and the results of an evaluation suggest that pen and touch interaction are suitable for deletion and reordering tasks, while they are of limited use for longer insertions. Expand
Post-editing for Professional Translators: Cheer or Fear?
Currently, post-editing of machine translation (MT) has been introduced as a regular practice in the translation workflow, especially since the good results in quality obtained by neural MT (NMT).Expand
A Satisfaction Survey on the Human Translation Outcomes and Machine Translation Post-Editing Outcomes
  • Junghee Hong, Il Jae Lee
  • 2021
This cross-sectional survey research carried out with the inquisitive agenda on satisfaction of the translation outcomes as performed by human translation and (machine translation) post-editing. TheExpand
...
1
2
3
...

References

SHOWING 1-10 OF 21 REFERENCES
Productivity and quality in MT post-editing
TLDR
Results suggest that translators have higher productivity and quality when using machinetranslated output than when processing fuzzy matches from translation memories, and technical experience seems to have an impact on productivity but not on quality. Expand
Post-editing time as a measure of cognitive effort
TLDR
This paper presents two experiments investigating the connection between post-editing time and cognitive effort, and examines whether sentences with long and short post-edsiting times involve edits of different levels of difficulty. Expand
Comparing human perceptions of post-editing effort with post-editing operations
TLDR
An experiment is described aimed at studying the relationship between technical post-editing effort and cognitive post-EDiting effort by comparing cases where the edit distance and a manual score reflecting perceived effort differ. Expand
Machine Translation Infrastructure and Post-editing Performance at Autodesk
TLDR
The Moses-based infrastructure developed and use as a productivity tool for the localisation of software documentation and user interface strings at Autodesk into twelve languages is presented and a strong correlation between the amount of editing applied to the raw MT output by the translators and their productivity gain is indicated. Expand
A Productivity Test of Statistical Machine Translation Post-Editing in a Typical Localisation Context
TLDR
A Productivity Test of Statistical Machine Translation Post-Editing in a Typical Localisation Context and results show a productivity increase for each participant, with significant variance across inviduals. Expand
Post-editing of Machine Translation: Processes and Applications
TLDR
This volume is a compilation of work by researchers, developers and practitioners of post-editing, presented at two recent events on post-EDiting, and partly due to the increasing quality of machine translation output, but also to the availability of free, reliable software for both machine translation and post-edsiting. Expand
To post-edit or not to post-edit? Estimating the benefits of MT post-editing for a European organization
TLDR
An ongoing large-scale machine translation post-editing evaluation campaign is described the purpose of which is to estimate the business benefits from the use of machine translation for the European Parliament. Expand
A Study of Translation Edit Rate with Targeted Human Annotation
TLDR
A new, intuitive measure for evaluating machine-translation output that avoids the knowledge intensiveness of more meaning-based approaches, and the labor-intensiveness of human judgments is examined, which indicates that HTER correlates with human judgments better than HMETEOR and that the four-reference variants of TER and HTER correlate withhuman judgments as well as—or better than—a second human judgment does. Expand
Assessing post-editing efficiency in a realistic translation environment
TLDR
It is found that post-editing reduces translation time significantly, although considerably less than reported in isolated experiments, and it is argued that overall assessments of post-Editing efficiency should be based on a realistic translation environment. Expand
Source Text Characteristics and Technical and Temporal Post-Editing Effort: What is Their Relationship
This paper focuses on the relationship between source text characteristics (ambiguity, complexity and style compliance) and machine-translation post-editing effort (both temporal and technical).Expand
...
1
2
3
...