Choosing the Best MT Programs for CLIR Purposes - Can MT Metrics Be Helpful?

@inproceedings{Kettunen2009ChoosingTB,
  title={Choosing the Best MT Programs for CLIR Purposes - Can MT Metrics Be Helpful?},
  author={Kimmo Kettunen},
  booktitle={ECIR},
  year={2009}
}
This paper describes usage of MT metrics in choosing the best candidates for MT-based query translation resources. Our main metrics is METEOR, but we also use NIST and BLEU. Language pair of our evaluation is English German, because MT metrics still do not offer very many language pairs for comparison. We evaluated translations of CLEF 2003 topics of four different MT programs with MT metrics and compare the metrics evaluation results to results of CLIR runs. Our results show, that for long… CONTINUE READING