Confidence Calibration in a Multiyear Geopolitical Forecasting Competition
@article{Moore2017ConfidenceCI, title={Confidence Calibration in a Multiyear Geopolitical Forecasting Competition}, author={D. Moore and S. Swift and Angela Minster and B. Mellers and L. Ungar and P. Tetlock and Heather H. J. Yang and Elizabeth R. Tenney}, journal={Manag. Sci.}, year={2017}, volume={63}, pages={3552-3565} }
This research examines the development of confidence and accuracy over time in the context of forecasting. Although overconfidence has been studied in many contexts, little research examines its progression over long periods of time or in consequential policy domains. This study employs a unique data set from a geopolitical forecasting tournament spanning three years in which thousands of forecasters predicted the outcomes of hundreds of events. We sought to apply insights from research to… Expand
Topics from this paper
16 Citations
Worker Overconfidence: Field Evidence and Implications for Employee Turnover and Returns from Training
- Business
- 2017
- 21
- PDF
Distilling the Wisdom of Crowds: Prediction Markets vs. Prediction Polls
- Economics, Computer Science
- Manag. Sci.
- 2017
- 43
Worker overconfidence: Field evidence and implications for employee turnover and firm profits
- Economics
- 2020
- 5
- PDF
Forecasting tournaments, epistemic humility and attitude depolarization
- Psychology, Medicine
- Cognition
- 2018
The Value of Performance Weights and Discussion in Aggregated Expert Judgments.
- Medicine
- Risk analysis : an official publication of the Society for Risk Analysis
- 2018
- 16
- PDF
Overconfidence at work: Does overconfidence survive the checks and balances of organizational life?
- Psychology
- 2016
- 11
- PDF
Leveraging Clickstream Trajectories to Reveal Low-Quality Workers in Crowdsourced Forecasting Platforms
- Computer Science
- ArXiv
- 2020
- PDF
References
SHOWING 1-10 OF 127 REFERENCES
Psychological Strategies for Winning a Geopolitical Forecasting Tournament
- Psychology, Medicine
- Psychological science
- 2014
- 139
- PDF
Accuracy of forecasts in strategic intelligence
- Engineering, Medicine
- Proceedings of the National Academy of Sciences
- 2014
- 50
- PDF
Identifying and Cultivating Superforecasters as a Method of Improving Probabilistic Predictions
- Psychology, Medicine
- Perspectives on psychological science : a journal of the Association for Psychological Science
- 2015
- 93
- PDF
Probability aggregation in time-series: Dynamic hierarchical modeling of sparse expert beliefs
- Mathematics, Computer Science
- 2014
- 24
- PDF
The effects of feedback and training on the performance of probability forecasters
- Computer Science
- 1992
- 60
- PDF
The psychology of intelligence analysis: drivers of prediction accuracy in world politics.
- Psychology, Medicine
- Journal of experimental psychology. Applied
- 2015
- 87
- PDF