Understanding user behavior in online feedback reporting

  title={Understanding user behavior in online feedback reporting},
  author={Arjun Talwar and Radu Jurca and Boi Faltings},
  booktitle={EC '07},
Online reviews have become increasingly popular as a way to judge the quality of various products and services. Previous work has demonstrated that contradictory reporting and underlying user biases make judging the true worth of a service difficult. In this paper, we investigate underlying factors that influence user behavior when reporting feedback. We look at two sources of information besides numerical ratings: linguistic evidence from the textual comment accompanying a review, and patterns… 

Figures and Tables from this paper

Reporting incentives and biases in online review forums
Underlying factors that influence users when reporting feedback are investigated, showing that groups of users who discuss a certain feature at length are more likely to agree in their ratings and that the median may be a better way to summarize the ratings.
User reputation in a comment rating environment
A novel bias-smoothed tensor model is proposed and empirically show that the model significantly outperforms a number of alternatives based on Yahoo! News, Yahoo! Buzz and Epinions datasets.
On Information Distortions in Online Ratings
This paper considers a model with heterogeneous customers who buy a product of unknown quality and focuses on two different informational settings, under which conditions, customers can recover the true quality of the product based on the feedback they observe.
What Determines Consumers' Ratings of Service Providers? An Exploratory Study of Online Traveler Reviews
Online reviews are important sources of information for travelers. However, existing academic understanding of these popular information sources in the tourism and hospitality domain is relatively
Information Processing on Online Review Platforms
It is found that while severe health inspection results lead to changes of online review star ratings, information processing depends on the current environment and the importance of considering the risk of deceptive behavior.
Star Quality: Aggregating Reviews to Rank Products and Merchants
Statistics- and heuristic- based models for estimating the true quality of a product or merchant are explored, and the performance of these estimators on the task of ranking pairs of objects is surprisingly similar.
Estimating feature ratings through an effective review selection approach
This paper proposes a novel approach to accurately estimate feature ratings of products, and selects user reviews that extensively discuss specific features of the products (called specialized reviews), using information distance of reviews on the features.
Understanding deja reviewers
A mixed-method study of deja reviewers, latecomers who echo what other people said, finds that roughly 10-15% of reviews substantially resemble previous ones, and interviews reviewers to understand their motives.
Rating Determinants Factored in E-Commerce Decision- Making
The user-generated content (UGC) Web sites are gaining popularity for a wide range of media content, such as news, blogs, forums, and open-source software. Instead of relying on information on
Online ratings: Convergence towards a positive perspective?
This paper analyzes data obtained from a popular restaurant review website, and presents several models of increasing sophistication for the dynamics of the review ratings the authors observe.


Exploring the value of online product reviews in forecasting sales: The case of motion pictures
This study shows that the addition of online product review metrics to a benchmark model that includes prerelease marketing, theater availability and professional critic reviews substantially increases its forecasting accuracy; the forecasting accuracy of the best model outperforms that of several previously published models.
Extracting Product Features and Opinions from Reviews
Opine is introduced, an unsupervised information-extraction system which mines reviews in order to build a model of important product features, their evaluation by reviewers, and their relative quality across products.
The Nature and Role of Feedback Text Comments in Online Marketplaces: Implications for Trust Building, Price Premiums, and Seller Differentiation
Evidence of extraordinary past seller behavior contained in the sellers' feedback text comments creates price premiums for reputable sellers by engendering buyer's trust in the seller's benevolence and credibility (controlling for the impact of numerical ratings).
Mining and summarizing customer reviews
This research aims to mine and to summarize all the customer reviews of a product, and proposes several novel techniques to perform these tasks.
Reputation premiums in electronic peer-to-peer markets: analyzing textual feedback and network structure
This paper is the first attempt to integrate econometric methods and text and link mining techniques towards a more complete analysis of the information captured by reputation systems, and it presents new evidence of the importance of their effective and judicious design.
A Multi-Level Examination of the Impact of Social Identities on Economic Transactions in Electronic Markets
Three of the most important uses of the Internet today are as an economic marketplace, as a forum for social interaction, and as a source of information. In this paper, we explore how these three
Mining the peanut gallery: opinion extraction and semantic classification of product reviews
This work develops a method for automatically distinguishing between positive and negative reviews and draws on information retrieval techniques for feature extraction and scoring, and the results for various metrics and heuristics vary depending on the testing situation.
Return on Reputation in Online Auction Markets
This research develops an assurances framework to assess the effect of a seller’s feedback “reputation” on the closing price of an online auction. The framework treats bidders as if they were
Comparative Experiments on Sentiment Classification for Online Product Reviews
A series of experiments with different machine learning algorithms are discussed in order to experimentally evaluate various trade-offs, using approximately 100K product reviews from the web.
Self-selection, slipping, salvaging, slacking, and stoning: the impacts of negative feedback at eBay
Analysis of usage history for a large panel of eBay sellers suggests that both seller and buyer behavior change in response to changes in a seller's feedback profile, and that buyers appear to be more willing to give negative feedback to sellers who have recently received other negative feedback.