Optimized interleaving for online retrieval evaluation

  title={Optimized interleaving for online retrieval evaluation},
  author={Filip Radlinski and Nick Craswell},
  booktitle={WSDM '13},
  • Filip Radlinski, Nick Craswell
  • Published in WSDM '13 2013
  • Computer Science
  • Interleaving is an online evaluation technique for comparing the relative quality of information retrieval functions by combining their result lists and tracking clicks. A sequence of such algorithms have been proposed, each being shown to address problems in earlier algorithms. In this paper, we formalize and generalize this process, while introducing a formal model: We identify a set of desirable properties for interleaving, then show that an interleaving algorithm can be obtained as the… CONTINUE READING
    67 Citations
    Probabilistic Multileave for Online Retrieval Evaluation
    • 28
    • PDF
    Multileaved Comparisons for Fast Online Evaluation
    • 56
    • Highly Influenced
    • PDF
    How does the sensitivity of multileaving methods compare to that of interleaving methods ?
    • Highly Influenced
    • PDF
    Aggregated Search and Interleaving Methods: A survey
    Generalized Team Draft Interleaving
    • 11
    • Highly Influenced
    • PDF
    Predicting Search Satisfaction Metrics with Interleaved Comparisons
    • 31
    • PDF
    Lerot: an online learning to rank framework
    • 43
    • PDF