The Ballot-Box

  title={The Ballot-Box},
  author={Francis Sir Galton},
I INFERRED that many non-experts were among the competitors, (1) because they were too numerous (about 800) to be mostly experts; (2) because of the abnormally wide vagaries of judgment at either end of the scale; (3) because of the prevalence of a sporting instinct, such as leads persons who know little about horses to bet on races. But I have no facts whereby to test the truth of my inference. It would be of service in future competitions if a line headed “Occupation” were inserted in the… Expand
The wisdom of the inner crowd in three large natural experiments
The authors use large, real-world guessing competition datasets to test whether accuracy can be improved by aggregating repeated estimates by the same individual, and find that estimates do improve, but substantially less than with between-person aggregation. Expand
Extraction of Information from Crowdsourcing: Experimental Test Employing Bayesian, Maximum Likelihood, and Maximum Entropy Methods
A crowdsourcing experiment in which viewers (the “crowd”) of a British Broadcasting Corporation (BBC) television show submitted estimates of the number of coins in a tumbler was shown in anExpand
A Demonstration of the Benefits of Aggregation in an Analytic Task
Described herein is an easily done exercise that demonstrates the benefits of aggregated analysis. It might be employed by instructors of intelligence analysis as an exercise in the classroom, or byExpand
Wisdom of Microcrowds in Evaluating Solutions to Esoteric Engineering Problems
A multitude of studies in economics, psychology, political and social sciences have demonstrated the wisdom of crowds (WoC) phenomenon, where the collective estimate of a group can be more accurateExpand
Sequential sampling, magnitude estimation, and the wisdom of crowds
Abstract Sir Francis Galton (Galton, 1907) conjectured the psychological process of magnitude estimation caused the curious distribution of judgments he observed at Plymouth in 1906. However, afterExpand
The Curious Anomaly of Skewed Judgment Distributions and Systematic Error in the Wisdom of Crowds
  • U. Nash
  • Psychology, Medicine
  • PloS one
  • 2014
The augmented quincunx (AQ) model of sequential and probabilistic cue categorization by neurons of judges is introduced, which predicts that judgment variance correlates positively with collective error, thereby challenging what is commonly believed about how diversity and collective intelligence relate. Expand
On Identifying Human Capital: Flawed Knowledge Leads to Faulty Judgments of Expertise by Individuals and Groups
Abstract Purpose To thrive, any individual, organization, or society needs to separate true from false expertise. This chapter provides a selective review of research examining self and socialExpand
Equality bias impairs collective decision-making across cultures
It is found that people show a strong equality bias: they weight each other’s opinion equally regardless of differences in their reliability, even when this strategy was at odds with explicit feedback or monetary incentives. Expand
How social influence can undermine the wisdom of crowd effect
This work demonstrates by experimental evidence that even mild social influence can undermine the wisdom of crowd effect in simple estimation tasks. Expand
Memory and truth: correcting errors with true feedback versus overwriting correct answers with errors
The results indicate that people have some kind of privileged access to whether their answers are right or wrong, above and beyond their confidence ratings, and that they behave differently when trying to remember new “corrective” information depending upon whether they, themselves, were right orwrong initially. Expand