Comparing MUCK-II And MUC-3: Assessing The Difficulty Of Different Tasks

@inproceedings{Hirschman1991ComparingMA,
  title={Comparing MUCK-II And MUC-3: Assessing The Difficulty Of Different Tasks},
  author={Lynette Hirschman},
  year={1991}
}
The natural language community has made impressive progress in evaluation over the last four years . However, as the evaluations become more sophisticated and more ambitious, a fundamental proble m emerges: how to compare results across changing evaluation paradigms . When we change domain , task, and scoring procedures, as has been the case from MUCK-I to MUCK-II to MUC-3, we los e comparability of results . This makes it difficult to determine whether the field has made progress sinc e the… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.

Explore Further: Topics Discussed in This Paper

Similar Papers

Loading similar papers…