FBK: Machine Translation Evaluation and Word Similarity metrics for Semantic Textual Similarity

@inproceedings{Souza2012FBKMT,
  title={FBK: Machine Translation Evaluation and Word Similarity metrics for Semantic Textual Similarity},
  author={Jos{\'e} Guilherme Camargo de Souza and Matteo Negri and Yashar Mehdad},
  booktitle={SemEval@NAACL-HLT},
  year={2012}
}
This paper describes the participation of FBK in the Semantic Textual Similarity (STS) task organized within Semeval 2012. Our approach explores lexical, syntactic and semantic machine translation evaluation metrics combined with distributional and knowledge-based word similarity metrics. Our best model achieves 60.77% correlation with human judgements (Mean score) and ranked 20 out of 88 submitted runs in the Mean ranking, where the average correlation across all the sub-portions of the test… CONTINUE READING

Similar Papers

Figures, Tables, and Topics from this paper.

Explore Further: Topics Discussed in This Paper

Citations

Publications citing this paper.
SHOWING 1-4 OF 4 CITATIONS

LEPOR: An Augmented Machine Translation Evaluation Metric

  • ArXiv
  • 2017
VIEW 1 EXCERPT
CITES METHODS
HIGHLY INFLUENCED

Measuring short Text Semantic Similarity using multiple measurements

  • 2013 International Conference on Machine Learning and Cybernetics
  • 2013
VIEW 1 EXCERPT
CITES METHODS

References

Publications referenced by this paper.
SHOWING 1-10 OF 30 REFERENCES

A Study of Translation Edit Rate with Targeted Human Annotation

Matthew G. Snover, Nitin Madnani, Bonnie Dorr, Richard Schwartz
  • Association for Machine Translation in the Americas
  • 2006
VIEW 1 EXCERPT