Bias and Reciprocity in Online Reviews: Evidence From Field Experiments on Airbnb

  title={Bias and Reciprocity in Online Reviews: Evidence From Field Experiments on Airbnb},
  author={Andrey Fradkin and Elena Grewal and David Holtz and Matthew Pearson},
  journal={Proceedings of the Sixteenth ACM Conference on Economics and Computation},
Reviews and other evaluations are used by consumers to decide what goods to buy and by firms to choose whom to trade with, hire, or promote. However, because potential reviewers are not compensated for submitting reviews and may have reasons to omit relevant information in their reviews, reviews may be biased. We use the setting of Airbnb to study the determinants of reviewing behavior, the extent to which reviews are biased, and whether changes in the design of reputation systems can reduce… 

Incentives Can Reduce Bias in Online Reviews

Online reviews are a powerful means of propagating the reputations of products, services, and even employers. However, existing research suggests that online reviews often suffer from selection bias

Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb

Many online reputation systems operate by asking volunteers to write reviews for free. As a result, a large share of buyers do not review, and those who do review are self-selected. This can cause

Reviews and Self-selection Bias with Operational Implications

Reviews for products and services written by previous consumers have become an influential input to the purchase decision of customers. Many service businesses monitor the reviews closely for

A panel for lemons? Positivity bias, reputation systems and data quality on MTurk

The purpose of this paper is to investigate how the effectiveness of systems for ensuring cooperation in online transactions is impacted by a positivity bias in the evaluation of the work that is

Incentives Increase Relative Positivity of Review Content and Enjoyment of Review Writing

A series of controlled experiments examine how the strategy of incentivizing reviews influences consumers’ expressions of positivity. Incentivized (vs. unincentivized) reviews contained a greater

Channels of Impact: User Reviews When Quality is Dynamic and Managers Respond

It is shown that reviewing activity and particularly negative reviewing is indeed stimulated by managerial response, and that managers respond more and in more detail to negative reviews, than previously thought.

Herding, Learning and Incentives for Online Reviews

We investigate the role of consumer herding and learning on the design of incentives for online customer reviews. Herding occurs when consumers are drawn to a product that appears to be popular

Do Employers Learn from Public, Subjective, Performance Reviews?

Much of the new “gig economy” relies on reputation systems to reduce problems of asymmetric information. In most cases, these reputation systems function well by soliciting unbiased feedback from

Review credibility as a safeguard against fakery: the case of Amazon

  • W. Jabr
  • Business
    Eur. J. Inf. Syst.
  • 2022
ABSTRACT Online reviews remain a reliable source for customers when making purchase decisions. Yet, the pervasiveness of fake reviews jeopardises this reliability and questions the quality of this

An Economic Analysis of Rebates Conditional on Positive Reviews

In the prevailing e-commerce environment, conditional rebates have emerged as a common business practice on leading online platforms such as Taobao. Because rebates are only offered to purchasing



Promotional Reviews: An Empirical Investigation of Online Review Manipulation

Online reviews could, in principle, greatly improve consumers' ability to evaluate products. However, the authenticity of online user reviews remains a concern; firms have an incentive to manufacture

Reviews, Reputation, and Revenue: The Case of Yelp.Com

Do online consumer reviews affect restaurant demand? I investigate this question using a novel dataset combining reviews from the website and restaurant data from the Washington State

Online Product Opinions: Incidence, Evaluation, and Evolution

Through simulations, this research empirically model the individual's decision to provide a product rating and investigates factors that influence this decision, and illustrates how the evolution of posted product opinions is shaped by the underlying customer base.

The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias

This study offers a method that allows users of feedback mechanisms where both partners of a bilateral exchange are allowed to report their satisfaction to “see through” the distortions introduced by reporting bias and derive unbiased estimates of the underlying distribution of privately observed outcomes.

Online Word of Mouth and Product Quality Disagreement

Studies of online word of mouth have frequently posited ― but never systematically conceptualized and explored ― that the level of disagreement between existing product reviews can impact the volume

The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment

We argue that reputation mechanisms used by platform markets suffer from two problems. First, buyers may draw conclusions about the quality of the platform from single transactions, causing a

Money Talks: Rebate Mechanisms in Reputation System Design

This work combines theory with a laboratory experiment to study the effect of a seller precommitment mechanism: Sellers have an option to commit by providing a rebate to reduce the buyer's feedback reporting cost before making purchasing decisions, and predicts that this mechanism induces noncooperative sellers to cooperate in the listed-price market.

From Lemon Markets to Managed Markets: The Evolution of eBay’s Reputation System∗

Asymmetric information potentially leads to adverse selection, market inefficiency, and possibly market failure. To mitigate these problems, market designers rely on different policies. Some adopt

The Value of Feedback: An Analysis of Reputation System

Online markets, as established by many authors, are prone to asymmetric information problems. Despite this observation, many online markets have thrived and grown over time primarily due to user

Eliciting Informative Feedback: The Peer-Prediction Method

A scoring system is devised that induces honest reporting of feedback and proves to be a Nash equilibrium, which can be scaled to induce appropriate effort by raters and can be extended to handle sequential interaction and continuous signals.