Measuring the Crowd Within

  title={Measuring the Crowd Within},
  author={Edward Vul and Harold Pashler},
  journal={Psychological Science},
  pages={645 - 647}
Psychological Science, Short Report, 2008. 19, 645-647. (in press version): This manuscript may differ from the final published version Measuring the crowd within: probabilistic representations within individuals. EDWARD VUL Massachusetts Institute of Technology HAROLD PASHLER University of California, San Diego A crowd often possesses better information than do the individuals it comprises. For example, if people are asked to guess the weight of a prize- winning ox (Galton, 1907), the error of… 
The Wisdom of Crowds with Communication
A Bayesian version of a Thurstonian model is introduced to show how each subject combines their individual, private knowledge with the previous individual’s ordering in a serial fashion and shows that individuals can produce estimates in the shared information condition that are better for aggregating than independent estimates.
Extending the wisdom of crowds: How to harness the wisdom of the inner crowd
The wisdom-of-crowds effect describes how aggregating judgments of multiple individuals can lead to a more accurate judgment than that of the typical—or even best—individual. We investigated when
When is a crowd wise?
The results demonstrate that crowd wisdom is highly robust: one would need to nearly deterministically select only a highly skilled judge before an individual's judgment could be expected to be more accurate than a simple averaging of the crowd.
The wisdom of the inner crowd in three large natural experiments.
Large, real-world guessing competition datasets are used to test whether accuracy can be improved by aggregating repeated estimates by the same individual, and it is found that estimates do improve, but substantially less than with between-person aggregation.
The wisdom of the inner crowd in three large natural experiments
The authors use large, real-world guessing competition datasets to test whether accuracy can be improved by aggregating repeated estimates by the same individual, and find that estimates do improve, but substantially less than with between-person aggregation.
The Motor Wisdom of the Crowd
Wisdom of the Crowd is the aggregation of many individual estimates to obtain a better collective one. This effect has an enormous potential from the social point of view, as it means that a decision
The Wisdom of Many in One Mind
The conditions under which dialectical bootstrapping fosters accuracy are derived and an empirical demonstration that its benefits go beyond reliability gains is provided.
Using Bayesian Cognitive Models in Wisdom of the Crowd Applications
This dissertation shows how cognitive models can be a powerful tool in accounting for individual differences and biases as well as in helping generate better crowd decisions, and implements two prominent cognitive models of categorization into a Bayesian framework and applies them to existing category learning data sets.
Integration of Social Information by Human Groups
A mathematical model is developed that postulates a cognitive process in which people first decide whether to take into account peer guesses, and if so, to move in the direction of these guesses, which closely approximates the distribution of guess movements.


The wisdom of crowds : why the many are smarter than the few
In this landmark work, NEW YORKER columnist James Surowiecki explores a seemingly counter-intuitive idea that has profound implications. Decisions taken by a large group, even if the individuals
The effects of averaging subjective probability estimates between and within judges.
Two studies test 3 predictions regarding averaging that follow from theorems based on a cognitive model of the judges and idealizations of the judgment situation, showing the extent to which they hold as the information conditions depart from the ideal and as J increases.
Evaluating and Combining Subjective Probability Estimates
This paper concerns the evaluation and combination of subjective probability estimates for categorical events. We argue that the appropriate criterion for evaluating individual and combined estimates
Improving Reliability of Judgmental Forecasts
Five principles can improve reliability in judgmental forecasting: Organize and present information in a form that clearly emphasizes relevant information, limit the amount of information used, and require justification of forecasts.
Combining forecasts: A review and annotated bibliography
Bayesian inference with probabilistic population codes
This work argues that the Poisson-like variability observed in cortex reduces a broad class of Bayesian inference to simple linear combinations of populations of neural activity, and demonstrates that these results hold for arbitrary probability distributions over the stimulus, for tuning curves of arbitrary shape and for realistic neuronal variability.
Principles of forecasting : a handbook for researchers and practitioners
The author’s aim is to contribute to the public understanding of forecasting and its role in the private sector by promoting awareness of the importance of informed consent in the decision-making process.
Probabilistic inference in human semantic memory
Multiple explanation: A consider-an-alternative strategy for debiasing judgments.
Previous research has suggested that an effective strategy for debiasing judgments is to have participants consider the opposite. The present research proposes that considering any plausible
Bayesian models of object perception