Shameless Guesses, Not Hallucinations
Read the original on Astral Codex Ten →
Summary
Reframes AI 'hallucinations' as 'shameless guesses.' Models say false things for the same reason a student bubbles in 'C' on a test they didn't study for: training rewards a correct guess and never punishes a confident wrong one, so always-guess is the rational strategy - the AI differs from the student only in having no shame (no social cost to the 999,999-in-a-million chance of sounding like an idiot). Vivid illustration: the fake cotton-gin/Thomas-Edison/John-Smith essay. Notes the interpretability finding that models activate deception-related features mid-hallucination (he considered, then rejected, the 'Lies' framing - the model is giving its real best guess while knowing the odds are low), and closes with an alignment coda: the model understands the game it is playing (maximize pretraining reward); we just haven't aligned that reward with our wants - which rebuts both the 'stochastic parrot' dismissal and the 'hallucinations prove AI is too dumb to be dangerous' complacency.
Why this score
Quality 71 · Strong. Strong band (upper). A clear, memorable, genuinely clarifying reframe of a widely-misunderstood phenomenon, with a sharp alignment payoff. Held below Excellent because it is short and largely popularizes a reward-structure explanation of hallucination that was already becoming standard by 2026; the contribution is mostly the vivid framing. A=71.
Claude’s paradigm shift 42 · Moderate. Moderate. The core explanation (guessing is rewarded, so models guess) was already in circulation by publication (e.g., 2025 work on why language models hallucinate); 'shameless guesses' is a rhetorical contribution, not a new idea. B=42.
Real-world impact 1 · Negligible. A clear, memorable reframe of AI 'hallucinations' as 'shameless guesses' (training rewards confident guessing and never punishes confident wrongness — the AI just lacks shame), with a sharp alignment payoff. Conceptual influence within AI discourse, short and popularizing a becoming-standard explanation, no material change — minimal RWI.