• Corpus ID: 14205897

Identifying expertise and using it to extract the Wisdom of the Crowds

  title={Identifying expertise and using it to extract the Wisdom of the Crowds},
  author={David V. Budescu and Eva Chen},
The "wisdom of the crowds" refers to the ability of statistical aggregates based on multiple opinions to outperform individuals, including experts, in various prediction and estimation tasks. For example, crowds have been shown to be effective at forecasting outcomes of future events. We seek to improve the quality of such aggregates by eliminating poor performing individuals, if we can identify them. We propose a new measure of contribution to assess the judges' performance relative to the… 

Aggregating multiple probability intervals to improve calibration

It is demonstrated that collective probability intervals obtained by several heuristics can reduce the typical overconfidence of the individual estimates.

A universal method for evaluating the quality of aggregators

We propose a new method to facilitate comparison of aggregated forecasts based on different aggregation, elicitation and calibration methods. Aggregates are evaluated by their relative position on

Investor Communication in Crowdfunding: A Qualitative-Empirical Study

Prior research shows that investor communication reduces information asymmetries between companies and investors. So far, little is known about the role of investor communication in crowdfunding.

Investor communication in equity-based crowdfunding: a qualitative-empirical study

Purpose - – This study’s aim is to investigate the role of investor communication in equity-based crowdfunding. The study explores whether and how investor communication can reduce information

Learning While Deciding in Groups

Groups are used to make many important societal decisions. Similar to individuals, by paying attention to the information available during the decision processes and the consequences of the

Shoot the Horse and Build a Better Barn Door: Exploring the Potential for a Superforecasting Methodology to Strengthen the DHS Leadership Selection Process

Over the course of several years, the Department of Homeland Security (DHS) has worked diligently to improve the quality of its leaders. Such efforts have focused almost exclusively on initiating or



Intuitive Biases in Choice vs. Estimation: Implications for the Wisdom of Crowds

Although researchers have documented instances of crowd wisdom, it is important to know whether some kinds of judgments may lead the crowd astray, whether crowds’ judgments improve with feedback over

Aggregating Large Sets of Probabilistic Forecasts by Weighted Coherent Adjustment

A new algorithm is proposed for combining probabilistic assessments from a large pool of judges, with the goal of efficiently implementing the coherent approximation principle (CAP) while weighing judges by their credibility.

How social influence can undermine the wisdom of crowd effect

This work demonstrates by experimental evidence that even mild social influence can undermine the wisdom of crowd effect in simple estimation tasks.

The Wisdom of Crowds with Communication

A Bayesian version of a Thurstonian model is introduced to show how each subject combines their individual, private knowledge with the previous individual’s ordering in a serial fashion and shows that individuals can produce estimates in the shared information condition that are better for aggregating than independent estimates.

The Wisdom of Many in One Mind

The conditions under which dialectical bootstrapping fosters accuracy are derived and an empirical demonstration that its benefits go beyond reliability gains is provided.

The wisdom of ignorant crowds: Predicting sport outcomes by mere recognition

It is concluded that aggregating across individual ignorance spawns collective wisdom, and the use of recognition for forecasting in sports and the performance of the collective recognition heuristic is compared to two benchmarks.

The wisdom of the crowd playing The Price Is Right

The results of the Price Is Right game show are used to highlight the usefulness of models of cognition and decision-making in studying the wisdom of the crowd, which are often approached only from non-psychological statistical perspectives.

Forecasting elections with mere recognition from small, lousy samples : a comparison of collective recognition, wisdom of crowds, and representative polls

It seems that wisdom-of-crowds-forecasts are able to draw on the benefits of recognition while at the same time avoiding its downsides, such as lack of discrimination among very famous parties or recognition caused by factors unrelated to electoral success.

Tapping into the Wisdom of the Crowd—with Confidence

The subjective confidence of individuals in groups can be a valid predictor of accuracy in decision-making tasks and the value of individual confidence in group decision- making is explored.

Confidence in aggregation of expert opinions.