On ' Deep Evaluation ' for Individual Computational Grammars and for Cross-Framework Comparison

@inproceedings{Hellan2007OnD,
  title={On ' Deep Evaluation ' for Individual Computational Grammars and for Cross-Framework Comparison},
  author={Lars Hellan and Emily M. Bender},
  year={2007}
}
A rather difficult point in grammar engineering evaluation is how to test and compare for analytic adequacy. A test design for 'deep' grammars is here proposed, where a parse is considered valid only if the assignment of syntactic and semantic structures that it displays obey certain conditions. The set of grammatical sentences in the test suite is construed as leaf types in a construction ontology, where the top types introduce the discriminants according to which constructions are categorized… CONTINUE READING