Is Intent-Aware Expected Reciprocal Rank Sufficient to Evaluate Diversity?

  title={Is Intent-Aware Expected Reciprocal Rank Sufficient to Evaluate Diversity?},
  author={Teerapong Leelanupab and Guido Zuccon and Joemon M. Jose},
In this paper we define two models of users that require diversity in search results; these models are theoretically grounded in the notion of intrinsic and extrinsic diversity. We then examine Intent-Aware Expected Reciprocal Rank (ERR-IA), one of the official measures used to assess diversity in TREC 2011-12, with respect to the proposed user models. By analyzing ranking preferences as expressed by the user models and those estimated by ERR-IA, we investigate whether ERR-IA assesses document… CONTINUE READING

From This Paper

Figures, tables, and topics from this paper.


Publications referenced by this paper.
Showing 1-3 of 3 references

Probability of Relevance: A Unification of two Competing Models for Document Retrieval

  • S. E. Robertson, M. Maron, W. Cooper
  • Information technology: research and development
  • 1982
Highly Influential
1 Excerpt

Similar Papers

Loading similar papers…