For the complete documentation index, see llms.txt.
Skip to main content
New
17% · 1/6
Lesson 11 min 20 XP

Overconfidence Bias

Why experts and novices alike systematically overestimate the accuracy of their predictions and the completeness of their knowledge.

The Calibration Problem

When people say they are '90% confident' in a prediction, they are correct only about 70-80% of the time. This miscalibration — systematic overconfidence in the accuracy of our beliefs and predictions — is one of the most consistent findings in cognitive psychology. It affects everyone from weather forecasters (who are well-calibrated because they get rapid, clear feedback) to political pundits (who are poorly calibrated because feedback is delayed and ambiguous).

Philip Tetlock's landmark study, documented in 'Expert Political Judgment,' analyzed 28,000 predictions by political and economic experts over two decades. The experts performed barely better than random chance — and were dramatically overconfident about their accuracy. The average expert's predictions were only slightly better than a simple algorithm, yet they expressed high confidence.

Overconfidence Bias | Model Diplomat