Multi-armed bandits for adjudicating documents in pooling-based evaluation of information retrieval systems

@article{Losada2017MultiarmedBF,
  title={Multi-armed bandits for adjudicating documents in pooling-based evaluation of information retrieval systems},
  author={David E. Losada and Javier Parapar and Alvaro Barreiro},
  journal={Inf. Process. Manage.},
  year={2017},
  volume={53},
  pages={1005-1025}
}
Evaluating Information Retrieval systems is crucial to making progress in search technologies. Evaluation is often based on assembling reference collections consisting of documents, queries and relevance judgments done by humans. In large-scale environments, exhaustively judging relevance becomes infeasible. Instead, only a pool of documents is judged for relevance. By selectively choosing documents from the pool we can optimize the number of judgments required to identify a given number of… CONTINUE READING
Recent Discussions
This paper has been referenced on Twitter 13 times over the past 90 days. VIEW TWEETS
7 Citations
53 References
Similar Papers

References

Publications referenced by this paper.

Similar Papers

Loading similar papers…