Assessing efficiency–effectiveness tradeoffs in multi-stage retrieval systems without using relevance judgments

  title={Assessing efficiency–effectiveness tradeoffs in multi-stage retrieval systems without using relevance judgments},
  author={C. Clarke and J. Culpepper and A. Moffat},
  journal={Information Retrieval Journal},
  • C. Clarke, J. Culpepper, A. Moffat
  • Published 2016
  • Computer Science
  • Information Retrieval Journal
  • Large-scale retrieval systems are often implemented as a cascading sequence of phases—a first filtering step, in which a large set of candidate documents are extracted using a simple technique such as Boolean matching and/or static document scores; and then one or more ranking steps, in which the pool of documents retrieved by the filter is scored more precisely using dozens or perhaps hundreds of different features. The documents returned to the user are then taken from the head of the final… CONTINUE READING
    23 Citations

    Figures, Tables, and Topics from this paper.

    Dynamic Cutoff Prediction in Multi-Stage Retrieval Systems
    • 28
    • PDF
    Dynamic Trade-Off Prediction in Multi-Stage Retrieval Systems
    • 1
    • PDF
    Query Driven Algorithm Selection in Early Stage Retrieval
    • 20
    • PDF
    Efficient and Effective Tail Latency Minimization in Multi-Stage Retrieval Systems
    • 1
    • PDF
    Fast Bag-Of-Words Candidate Selection in Content-Based Instance Retrieval Systems
    • 1
    • PDF
    Efficient Cost-Aware Cascade Ranking in Multi-Stage Retrieval
    • 38
    • PDF
    Accelerated Query Processing Via Similarity Score Prediction
    • 5
    • PDF
    Measuring the Effectiveness of Selective Search Index Partitions without Supervision
    • 1
    • PDF
    Pretrained Transformers for Text Ranking: BERT and Beyond
    • 2
    • PDF


    Cumulated gain-based evaluation of IR techniques
    • 2,207
    • PDF
    A cascade ranking model for efficient ranked retrieval
    • 145
    • PDF
    Rank-biased precision for measurement of retrieval effectiveness
    • 456
    • PDF
    The whens and hows of learning to rank for web search
    • 104
    • PDF
    Time-based calibration of effectiveness measures
    • 178
    • PDF
    Document Prioritization for Scalable Query Processing
    • 7
    Efficient query evaluation using a two-level retrieval process
    • 378
    • Highly Influential
    • PDF
    Optimization strategies for complex queries
    • 115
    • PDF