# Biased Beliefs About Random Samples: Evidence from Two Integrated Experiments

@article{Benjamin2017BiasedBA, title={Biased Beliefs About Random Samples: Evidence from Two Integrated Experiments}, author={Daniel J. Benjamin and Don A. Moore and Matthew Rabin}, journal={NBER Working Paper Series}, year={2017} }

This paper describes results of a pair of incentivized experiments on biases in judgments about random samples. Consistent with the Law of Small Numbers (LSN), participants exaggerated the likelihood that short sequences and random subsets of coin flips would be balanced between heads and tails. Consistent with the Non-Belief in the Law of Large Numbers (NBLLN), participants underestimated the likelihood that large samples would be close to 50% heads. However, we identify some shortcomings of…

## 18 Citations

### An Axiomatic Approach to the Law of Small Numbers ∗

- Economics
- 2022

With beliefs over the outcomes of coin-tosses as our primitive, we formalize the Law of Small Numbers (Tversky and Kahneman (1974)) by an axiom that expresses a belief that the sample mean of any…

### Mislearning from Censored Data: The Gambler's Fallacy in Optimal-Stopping Problems

- Economics
- 2018

I study endogenous learning dynamics for people expecting systematic reversals from random sequences -- the "gambler's fallacy" -- and how variance uncertainty provides another channel of positive feedback between past and future thresholds.

### Errors in Probabilistic Reasoning and Judgment Biases

- PsychologyHandbook of Behavioral Economics - Foundations and Applications 2
- 2019

Errors in probabilistic reasoning have been the focus of much psychology research and are among the original topics of modern behavioral economics. This chapter reviews theory and evidence on this…

### A MODEL OF NONBELIEF IN THE LAW OF LARGE NUMBERS.

- EconomicsJournal of the European Economic Association
- 2016

This work model this "non-belief in the Law of Large Numbers" by assuming that a person believes that proportions in any given sample might be determined by a rate different than the true rate.

### Mislearning from censored data: The gambler’s fallacy and other correlational mistakes in optimal-stopping problems

- Economics
- 2022

I study endogenous learning dynamics for people who misperceive intertemporal correlations in random sequences. Biased agents face an optimal-stopping problem. They are uncertain about the underlying…

### Mislearning from censored data: The gambler's fallacy and other correlational mistakes in optimal‐stopping problems

- EconomicsTheoretical Economics
- 2022

I study endogenous learning dynamics for people who misperceive intertemporal correlations in random sequences because they are uncertain about the underlying distribution and learn its parameters from predecessors to an extent that depends on predecessors’ stopping thresholds.

### Testing Theories of Gambler’s Fallacy and Hot-hand Fallacy: Probability Bias vs. Randomized Choice

- EconomicsSSRN Electronic Journal
- 2019

This paper proposes a new method to identify gambler’s fallacy (GF) and hot-hand fallacy (HHF). In the classical method, subjects are classified as exhibiting GF/HHF even they are just…

### We are All Behavioral, More or Less: A Taxonomy of Consumer Decision Making

- PsychologySSRN Electronic Journal
- 2020

We examine how 17 behavioral biases relate to each other, to three standard measures of risk and time preferences, to cognitive skills, personality, and demographics, and to outcomes in household…

### What Jobs Come to Mind? Stereotypes about Fields of Study

- Economics
- 2022

How do students form beliefs about how their future career will depend on their choice of college major? Using both nationally representative survey data and surveys that we administered among…

## References

SHOWING 1-10 OF 32 REFERENCES

### Inference from Streaks in Random Outcomes: Experimental Evidence on Beliefs in Regime Shifting and the Law of Small Numbers

- EconomicsManag. Sci.
- 2009

It is found that as the perception of the randomness of the outcome-generating process increases, subjects are more likely to predict reversals of current streaks, and results of a “test-of-fit” analysis based on structural estimation of each model favor the model in Rabin.

### BELIEF IN THE LAW OF SMALL NUMBERS

- Philosophy
- 1971

“Suppose you have run an experiment on 20 subjects, and have obtained a significant result which confirms your theory ( z = 2.23, p If you feel that the probability is somewhere around .85, you may…

### Inference by Believers in the Law of Small Numbers

- Economics
- 2000

Many people believe in the Law of Small Numbers, exaggerating the degree to which a small sample resembles the population from which it is drawn. To model this, I assume that a person exaggerates the…

### Surprised by the Gambler's and Hot Hand Fallacies? A Truth in the Law of Small Numbers

- Economics
- 2016

We prove that a subtle but substantial bias exists in a standard measure of the conditional dependence of present outcomes on streaks of past outcomes in sequential data. The magnitude of this novel…

### How psychological framing affects economic market prices in the lab and field

- EconomicsProceedings of the National Academy of Sciences
- 2013

It is concluded that psychological biases in individual judgment can affect market prices, and understanding those effects requires combining a variety of methods from psychology and economics.

### A Model of Non-Belief in the Law of Large Numbers

- Economics
- 2011

People believe that, even in very large samples, proportions of binary signals might depart significantly from the population mean. We model this "non-belief in the Law of Large Numbers" by assuming…

### Subjective Probability Assessment in Decision Analysis: Partition Dependence and Bias Toward the Ignorance Prior

- EconomicsManag. Sci.
- 2005

This work shows that assessed probabilities are systematically biased toward a uniform distribution over all events into which the relevant state space happens to be partitioned, so that probabilities are "partition dependent" and related research on the "pruning bias" in fault-tree assessment is related.

### Support theory: A nonextensional representation of subjective probability.

- Economics
- 1994

This article presents a new theory of subjective probability according to which different descriptions of the same event can give rise to different judgments. The experimental evidence confirms the…

### What’s Next? Judging Sequences of Binary Events

- PsychologyPsychological bulletin
- 2009

An explanation-based, mental models framework for describing people's beliefs about binary sequences, based on 4 perceived characteristics of the sequence generator: randomness, intentionality, control, and goal complexity is introduced.