Automatic Evaluation of Robustness and Degradation in Tagging and Parsing

  title={Automatic Evaluation of Robustness and Degradation in Tagging and Parsing},
  author={Johnny Bigert and Ola Knutsson and Jonas Sj{\"o}bergh},
We address the topic of automatic evaluation of robustness and performance degradation in parsing systems. We focus on one aspect of robustness, namely ill-formed sentences and the impact of spelling errors on the different components of a parsing system. We propose an automated framework to evaluate robustness, where ill-formed and noisy data is introduced using an automatic tool and fed to the parsing system. With increasing levels of noise, the performance of a system will inevitably degrade… CONTINUE READING
Highly Cited
This paper has 19 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.


Publications referenced by this paper.
Showing 1-10 of 19 references

Missplel and AutoEval: Two generic tools for automatic evaluation

  • Bigert
  • In Proceedings of Nodalida
  • 2003

Introduction to the CoNLL-2000 shared task: Chunking

  • Tjong Kim Sang, Buchholz 00 E. Tjong Kim Sang, S. Buchholz
  • In Proceedings of CoNLL2000 and LLL-2000,
  • 2000

Johansson-Kokkinakis. A cascaded finitestate parser for syntactic analysis of Swedish

  • S. D. Kokkinakis
  • In Proceedings of the 9th EACL,
  • 1999
1 Excerpt

Similar Papers

Loading similar papers…