Evaluating the retrieval effectiveness of web search engines using a representative query sample

  title={Evaluating the retrieval effectiveness of web search engines using a representative query sample},
  author={D. Lewandowski},
  journal={Journal of the Association for Information Science and Technology},
  • D. Lewandowski
  • Published 2015
  • Computer Science
  • Journal of the Association for Information Science and Technology
  • Search engine retrieval effectiveness studies are usually small scale, using only limited query samples. Furthermore, queries are selected by the researchers. We address these issues by taking a random representative sample of 1,000 informational and 1,000 navigational queries from a major German search engine and comparing Google's and Bing's results based on this sample. Jurors were found through crowdsourcing, and data were collected using specialized software, the Relevance Assessment Tool… CONTINUE READING
    59 Citations

    Topics from this paper.

    Evaluating the effectiveness of Web search engines on results diversification
    • 2
    • PDF
    Does it matter which search engine is used? A user study using post‐task relevance judgments
    • 3
    • PDF
    Similarity based Automatic Web Search Engine Evaluation
    • 3
    Information Retrieval of Distributed Databases A Case Study: Search Engines Systems
    • S. Alahmadi
    • Computer Science
    • 2018 1st International Conference on Computer Applications & Information Security (ICCAIS)
    • 2018
    • 1
    A review on web search engines' automatic evaluation methods and how to select the evaluation method
    • 3


    Coverage, relevance, and ranking: The impact of query operators on Web search engine results
    • 131
    • PDF
    The retrieval effectiveness of search engines on navigational queries
    • 36
    • PDF
    Deriving query intents from web search engine queries
    • 27
    • PDF
    The Retrieval Effectiveness of Web Search Engines: Considering Results Descriptions
    • 92
    • PDF
    Measuring Search Engine Quality
    • 211
    • PDF
    A study of results overlap and uniqueness among major Web search engines
    • 145
    • PDF
    Automatic performance evaluation of Web search engines
    • 78
    • PDF
    What Users See - Structures in Search Engine Results Pages
    • 112
    • PDF
    Search En-gines for the World Wide Web: A Compara-tive Study and Evaluation Methodology
    • 176
    • PDF