causal

AI hallucinates because its objective isn't truth

Reasoning systems still hallucinate because their objective function is not truth—unlike even a baby—but rather producing output a human will like, via reinforcement learning from human feedback; relatedly they reproduce reasoning patterns yet fail at basic arithmetic and at generating the novel relationships humans generate.

causalpending

Speaker

Alison Gopnik

Evidence Quote

“It’s interesting that they’renot good at things like basic arithmeticoften. You get this weird combination of it’s reproducing a reasoning process that you could imagine in math, but it’s not doing basic arithmetic.”

Source

Alison Gopnik— Conversations with Tyler
Created: 6/12/2026, 4:55:45 PM

Your notes

Loading notes...