Large-scale validation and analysis of interleaved search evaluation

@article{Chapelle2012LargescaleVA,
  title={Large-scale validation and analysis of interleaved search evaluation},
  author={Olivier Chapelle and Thorsten Joachims and Filip Radlinski and Yisong Yue},
  journal={ACM Trans. Inf. Syst.},
  year={2012},
  volume={30},
  pages={6:1-6:41}
}
  • Olivier Chapelle, Thorsten Joachims, +1 author Yisong Yue
  • Published 2012
  • Computer Science
  • ACM Trans. Inf. Syst.
  • Interleaving is an increasingly popular technique for evaluating information retrieval systems based on implicit user feedback. While a number of isolated studies have analyzed how this technique agrees with conventional offline evaluation approaches and other online techniques, a complete picture of its efficiency and effectiveness is still lacking. In this paper we extend and combine the body of empirical evidence regarding interleaving, and provide a comprehensive analysis of interleaving… CONTINUE READING

    Citations

    Publications citing this paper.
    SHOWING 1-10 OF 156 CITATIONS

    Predicting Search Satisfaction Metrics with Interleaved Comparisons

    VIEW 8 EXCERPTS
    CITES METHODS, BACKGROUND & RESULTS

    Fidelity, Soundness, and Efficiency of Interleaved Comparison Methods

    VIEW 14 EXCERPTS
    CITES METHODS, BACKGROUND & RESULTS
    HIGHLY INFLUENCED

    On caption bias in interleaving experiments

    VIEW 6 EXCERPTS
    CITES METHODS, BACKGROUND & RESULTS

    FILTER CITATIONS BY YEAR

    2011
    2020

    CITATION STATISTICS

    • 20 Highly Influenced Citations

    • Averaged 14 Citations per year from 2018 through 2020