Optimized interleaving for online retrieval evaluation

@inproceedings{Radlinski2013OptimizedIF,
  title={Optimized interleaving for online retrieval evaluation},
  author={Filip Radlinski and Nick Craswell},
  booktitle={WSDM '13},
  year={2013}
}
  • Filip Radlinski, Nick Craswell
  • Published in WSDM '13 2013
  • Computer Science
  • Interleaving is an online evaluation technique for comparing the relative quality of information retrieval functions by combining their result lists and tracking clicks. A sequence of such algorithms have been proposed, each being shown to address problems in earlier algorithms. In this paper, we formalize and generalize this process, while introducing a formal model: We identify a set of desirable properties for interleaving, then show that an interleaving algorithm can be obtained as the… CONTINUE READING
    66 Citations
    Probabilistic Multileave for Online Retrieval Evaluation
    • 27
    • PDF
    Multileaved Comparisons for Fast Online Evaluation
    • 55
    • Highly Influenced
    • PDF
    Aggregated Search and Interleaving Methods: A survey
    Generalized Team Draft Interleaving
    • 10
    • Highly Influenced
    • PDF
    Predicting Search Satisfaction Metrics with Interleaved Comparisons
    • 30
    • PDF
    Lerot: an online learning to rank framework
    • 43
    • PDF