Measuring search engine bias

@article{Mowshowitz2005MeasuringSE,
  title={Measuring search engine bias},
  author={Abbe Mowshowitz and Akira Kawaguchi},
  journal={Inf. Process. Manag.},
  year={2005},
  volume={41},
  pages={1193-1205}
}

Figures and Tables from this paper

Evaluation Metrics for Measuring Bias in Search 1 Engine Results 2

Novel web search bias evaluation measures are proposed which take into account the rank and relevance, as well as the ideological bias (conservative or liberal) and test the framework on two popular search engines.

Position Paper: A Study of Web Search Engine Bias and its Assessment

The results show that the content bias and indexical bias are both influential in the bias assessment, and they complement each other to provide a panoramic view with the two-dimensional representation.

Evaluating the performance and neutrality/bias of search engines

This paper proposes a definition for a consensual relevance of a page with respect to a keyword, from a set of search engines, and implements this model, which is implemented, and presents an analysis of the results.

An Investigation of Biases in Web Search Engine Query Suggestions

Applying this framework on a set of person-related query suggestions shows first insights into the influence search engines can have on the query process of users that seek out information on politicians.

On the Orthogonality of Bias and Utility in Ad hoc Retrieval

The findings of this paper are significant as they are among the first to show that decrease in bias does not necessarily need to come at the cost of reduced utility.

Dear search engine: what's your opinion about...?: sentiment analysis for semantic enrichment of web search results

This paper extracts sentiment metadata from web pages, compares opinions expressed in the top results to those in other retrieved results to examine whether the top-ranked pages are a good sample of all results from an opinion perspective.

Analyzing the content emphasis of web search engines

PAWS is presented, a platform for analyzing differences among Web search engines, and it is found that the engines emphasize particular news sites, and that they also favor pages containing their company's advertisements, as opposed to competitor advertisements.

Search engines’ responses to several search feature selections

The authors investigated the impact of the advanced search features of three common search engines on retrieval result performance: Yahoo, Google, and Live Search to shed light on how search engines react to different types of search features in terms of retrieval effectiveness.

Evaluating search engines and defining a consensus implementation

This paper looks at the results of several search engines for a sample of keywords, and defines for each keyword the visibility of a page based on its ranking over all search engines, which allows to define a score of the search engine for a keyword, and then its average score over all keywords.
...

References

SHOWING 1-10 OF 32 REFERENCES

Assessing bias in search engines

Web Search Engines

This review looks briefly at the history of World Wide Web search engine development, considers the current state of affairs, and reflects on the future. Networked discovery tools have evolved along

Finding Information on the World Wide Web: The Retrieval Effectiveness of Search Engines

Quality dimensions of Internet search engines

The customer expectations identified in this paper will be of great help not only to the designers for improving the search engines, but also to the users for selecting suitable ones.

Architecture of a metasearch engine that supports user information needs

This paper describes a metasearch engine architecture that considers the user's information need for each decision, and combines several powerful approaches together in a single general purpose metAsearch engine.

Searching the world wide Web

The coverage and recency of the major World Wide Web search engines was analyzed, yielding some surprising results, including a lower bound on the size of the indexable Web of 320 million pages.

From E-Sex to E-Commerce: Web Search Changes

Analysis of three data sets culled from more than one million queries submitted by more than 200,000 users of the Excite Web search engine shows that public Web searching is evolving in certain directions.

Precision Among Internet Search Engines: An Earth Sciences Case Study

  • Lisa A. Wishard
  • Computer Science
    Issues in Science and Technology Librarianship
  • 1998
Three representative queries related to the earth sciences were used to evaluate the precision of 37 Internet search engines and indicated that Go2, InfoMine, and Argus Clearinghouse had the highest precision for catalog type search engines.

The Web as a Graph: Measurements, Models, and Methods

This paper describes two algorithms that operate on the Web graph, addressing problems from Web search and automatic community discovery, and proposes a new family of random graph models that point to a rich new sub-field of the study of random graphs, and raises questions about the analysis of graph algorithms on the Internet.

Bias on the web

When it comes to measuring bias on the Web, there is clearly strength in numbers (of search engines, that is).