Findings of the 2014 Workshop on Statistical Machine Translation

@inproceedings{Bojar2014FindingsOT,
  title={Findings of the 2014 Workshop on Statistical Machine Translation},
  author={Ondrej Bojar and Christian Buck and Christian Federmann and Barry Haddow and Philipp Koehn and Johannes Leveling and Christof Monz and Pavel Pecina and Matt Post and Herve Saint-Amand and Radu Soricut and Lucia Specia and Ales Tamchyna},
  booktitle={WMT@ACL},
  year={2014}
}
This paper presents the results of the WMT14 shared tasks, which included a standard news translation task, a separate medical translation task, a task for run-time estimation of machine translation quality, and a metrics task. This year, 143 machine translation systems from 23 institutions were submitted to the ten translation directions in the standard translation task. An additional 6 anonymized systems were included, and were then evaluated both automatically and manually. The quality… 

Findings of the 2015 Workshop on Statistical Machine Translation

This paper presents the results of the WMT15 shared tasks, which included a standard news translation task, a metrics task, a tuning task, a task for run-time estimation of machine translation

Findings of the 2016 Conference on Machine Translation

This paper presents the results of the WMT16 shared tasks, which included five machine translation (MT) tasks (standard news, IT-domain, biomedical, multimodal, pronoun), three evaluation tasks

Findings of the 2016 Conference on Machine Translation (WMT16)

This paper presents the results of the WMT16 shared tasks, which included five machine translation (MT) tasks (standard news, IT-domain, biomedical, multimodal, pronoun), three evaluation tasks

Findings of the WMT 2018 Shared Task on Quality Estimation

The WMT18 shared task on Quality Estimation is reported, i.e. the task of predicting the quality of the output of machine translation systems at various granularity levels: word, phrase, sentence and document.

Findings of the Third Workshop on Neural Generation and Translation

The research trends of papers presented in the proceedings are summarized and the results of the two shared tasks 1) efficient neural machine translation (NMT) and 2) document generation and translation (DGT) are described.

Findings of the Second Workshop on Neural Machine Translation and Generation

The results of the workshop’s shared task on efficient neural machine translation are described, where participants were tasked with creating MT systems that are both accurate and efficient.

Measures of Machine Translation Quality

An annotation experiment is conducted and a manual evaluation method in which annotators rank only translations of short segments instead of whole sentences is proposed, which results in easier and more efficient annotation.

Machine Translation and Monolingual Postediting: The AFRL WMT-14 System

The AFRL statistical MT system and the improvements that were developed during the WMT14 evaluation campaign are described and the efforts to make use of monolingual English speakers to correct the output of machine translation are described.

A technical reading in statistical and neural machines translation (SMT & NMT)

A survey of the state of the art of statistical machine translation and neural machine translation is presented, where the context of the current research studies is described, and the main strengths and limitations of the two approaches are reviewed.

Evaluating Machine Translation Quality Using Short Segments Annotations

A manual evaluation method is proposed for machine translation (MT), in which annotators rank only translations of short segments instead of whole sentences, which results in an easier and more efficient annotation.
...

References

SHOWING 1-10 OF 114 REFERENCES

Findings of the 2013 Workshop on Statistical Machine Translation

We present the results of the WMT13 shared tasks, which included a translation task, a task for run-time estimation of machine translation quality, and an unofficial metrics task. This year, 143

Findings of the 2012 Workshop on Statistical Machine Translation

A large-scale manual evaluation of 103 machine translation systems submitted by 34 teams was conducted, which used the ranking of these systems to measure how strongly automatic metrics correlate with human judgments of translation quality for 12 evaluation metrics.

Findings of the 2009 Workshop on Statistical Machine Translation

A large-scale manual evaluation of 87 machine translation systems and 22 system combination entries is conducted, which used the ranking of these systems to measure how strongly automatic metrics correlate with human judgments of translation quality, for more than 20 metrics.

Findings of the 2011 Workshop on Statistical Machine Translation

The WMT11 shared tasks, which included a translation task, a system combination task, and a task for machine translation evaluation metrics, show how strongly automatic metrics correlate with human judgments of translation quality for 21 evaluation metrics.

Experiments in Medical Translation Shared Task at WMT 2014

Dublin City University’s (DCU) submission to the WMT 2014 Medical Summary task is described and results on the test data set in the French to English translation direction are reported.

Further Meta-Evaluation of Machine Translation

This paper analyzes the translation quality of machine translation systems for 10 language pairs translating between Czech, English, French, German, Hungarian, and Spanish and uses the human judgments of the systems to analyze automatic evaluation metrics for translation quality.

Combining Domain Adaptation Approaches for Medical Text Translation

A number of simple and effective techniques to adapt statistical machine translation systems in the medical domain and these systems achieve the best BLEU scores for Czech-English, EnglishGerman, French-English language pairs and the second best Blemish scores for reminding pairs are explored.

The CMU Machine Translation Systems at WMT 2014

Inventions include: a label coarsening scheme for syntactic tree-to-tree translation, a host of new discriminative features, several modules to create “synthetic translation options” that can generalize beyond what is directly observed in the training data, and a method of combining the output of multiple word aligners to uncover extra phrase pairs and grammar rules.

Machine Translation of Medical Texts in the Khresmoi Project

The participation of the Charles University team in the WMT 2014 Medical Translation Task is presented, with a primary goal to set up a baseline for both its subtasks and for all translation directions.

Exploring Consensus in Machine Translation for Quality Estimation

The use of consensus among Machine Translation (MT) systems for the WMT14 Quality Estimation shared task is presented by comparing the MT system output against several alternative machine translations using standard evaluation metrics.
...