Variations in Relevance Assessments and the Measurement of Retrieval Effectiveness

Abstract

The purpose of this article is to bring attention to the problem of variations in relevance assessments and the effects that these may have on measures of retrieval effectiveness. Through an analytical review of the literature, I show that despite known wide variations in relevance assessments in experimental test collections, their effects on the… (More)
DOI: 10.1002/(SICI)1097-4571(199601)47:1%3C37::AID-ASI4%3E3.0.CO;2-3

Topics

5 Figures and Tables

Statistics

02040'97'99'01'03'05'07'09'11'13'15'17
Citations per Year

371 Citations

Semantic Scholar estimates that this publication has 371 citations based on the available data.

See our FAQ for additional information.

Slides referencing similar topics