Retrieval evaluation with incomplete information

@inproceedings{Buckley2004RetrievalEW,
  title={Retrieval evaluation with incomplete information},
  author={Chris Buckley and Ellen M. Voorhees},
  booktitle={SIGIR},
  year={2004}
}
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents within a test collection have been identified and are present in the collection). We show that current evaluation measures are not robust to substantially incomplete relevance judgments. A new measure is introduced that is both highly correlated with existing measures when complete judgments are available and more robust… CONTINUE READING
Highly Influential
This paper has highly influenced 73 other papers. REVIEW HIGHLY INFLUENTIAL CITATIONS
Highly Cited
This paper has 752 citations. REVIEW CITATIONS

From This Paper

Figures, tables, results, connections, and topics extracted from this paper.
440 Extracted Citations
1 Extracted References
Similar Papers

Citing Papers

Publications influenced by this paper.
Showing 1-10 of 440 extracted citations

752 Citations

050'05'08'11'14'17
Citations per Year
Semantic Scholar estimates that this publication has 752 citations based on the available data.

See our FAQ for additional information.

Referenced Papers

Publications referenced by this paper.

Evaluation, chapter 7. Butterworths, 2 edition

  • C. J. van Rijsbergen
  • 1979
Highly Influential
5 Excerpts

Similar Papers

Loading similar papers…