The benefits of knowing what you know (and what you don’t): How calibration affects credibility

@article{Tenney2008TheBO,
  title={The benefits of knowing what you know (and what you don’t): How calibration affects credibility},
  author={Elizabeth R. Tenney and Barbara A. Spellman and Robert J MacCoun},
  journal={Journal of Experimental Social Psychology},
  year={2008},
  volume={44},
  pages={1368-1375}
}

Figures and Tables from this paper

Accuracy, confidence, and calibration: how young children and adults assess credibility.
TLDR
It was found that both children and adults used information about confidence and accuracy to judge credibility; however, only adults used knowledge about informants' calibration, and children did not.
Title Cheap talk and credibility : The consequences of confidence and accuracy on advisor credibility and persuasiveness Permalink
Is it possible to increase one’s influence simply by behaving more confidently? Prior research presents two competing hypotheses: (1) the confidence heuristic holds that more confidence increases
Identifying the Effects of Unjustified Confidence versus Overconfidence: Lessons Learned from Two Analytic Methods.
TLDR
This paper contrasts two approaches toward answering whether misplaced confidence is good or bad, which are labeled the overconfidence and unjustified confidence approach, and provides findings from a set of simulations designed to determine when the approaches produce different conclusions.
The Epistemic Contract: Fostering an Appropriate Level of Public Trust in Experts.
  • R. MacCoun
  • Philosophy
    Nebraska Symposium on Motivation. Nebraska Symposium on Motivation
  • 2015
TLDR
Research on expert calibration, on the effects of confidence and calibration on perceived credibility, and on the role that “naive realism” plays in biasing their assessments of experts who say what the authors want to hear are reviewed.
Children's understanding of when a person's confidence and hesitancy is a cue to their credibility
TLDR
Children preferred a well-calibrated over a miscalibrated confident person by around 4 years, whereas even 7- to 8-year-olds were insensitive to calibration in hesitant people, suggesting that one should not always trust confident sources or disregard hesitant ones.
Prior knowledge influences interpretations of eyewitness confidence statements: ‘The witness picked the suspect, they must be 100% sure%
ABSTRACT When an eyewitness identifies a suspect from a lineup, it is important to know how certain they are about the decision. Even though eyewitnesses are likely to express certainty with words,
Do People Inherently Dislike Uncertain Advice?
TLDR
The results suggest that people do not inherently dislike uncertain advice, and that advisors benefit from expressing themselves with confidence, but not from communicating false certainty.
Across-subject correlation between confidence and accuracy: A meta-analysis of the Confidence Database.
If one friend confidently tells us to buy Product A while another friend thinks that Product B is better but is not confident, we may go with the advice of our confident friend. Should we? The
Meta-accuracy and relationship quality: Weighing the costs and benefits of knowing what people really think about you.
TLDR
Meta-accuracy seems to be a virtue in the eyes of judges, but metaperceivers do not seem to reap the same benefits of knowing what others really think, suggesting that accurate metaperceptions have positive effects on relationships.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 29 REFERENCES
Intuitive evaluation of likelihood judgment producers: evidence for a confidence heuristic
This research tests the hypothesis of Yates et al. (1996) that people prefer judgment producers who make extreme confidence judgments. In each of three experiments, college students evaluated two
Calibration Trumps Confidence as a Basis for Witness Credibility
TLDR
Two experiments show that errors in testimony damage the overall credibility of witness who were confident about the erroneous testimony more than that of witnesses who were not confident about it, and people make inferences about source calibration when evaluating testimony and other social communication.
Calibration of probabilities: the state of the art to 1980
From the subjectivist point of view (de Finetti, 1937/1964), a probability is a degree of belief in a proposition. It expresses a purely internal state; there is no “right,” “correct,” or “objective”
Why is p = .90 better than p = .70? Preference for definitive predictions by lay consumers of probability judgements.
TLDR
Four experiments are reported that show participants to have a clear preference for more extreme and higher probabilities over less extreme and lower ones, interpreted as manifestations of a search for definitive predictions principle.
Why isp = .90 better thanp = .70? Preference for definitive predictions by lay consumers of probability judgments
What do people regard as an informative and valuable probability statement? This article reports four experiments that show participants to have a clear preference for more extreme and higher
Calibration of Probabilities: The State of the Art
TLDR
From the subjectivist point of view (de Finetti, 1937) a probability is a degree of belief in a proposition whose truth has not been ascertained and there is no “right” or “correct” probability that resides somewhere “in reality” against which it can be compared.
Judgment under Uncertainty: Heuristics and Biases.
TLDR
Three heuristics that are employed in making judgements under uncertainty are described: representativeness, availability of instances or scenarios, which is often employed when people are asked to assess the frequency of a class or the plausibility of a particular development.
...
1
2
3
...