causal

Emergence is a measurement mirage

Apparent emergent abilities are partly a 'mirage' of measurement: success requires sampling the last several tokens correctly, so you multiply those probabilities and below a threshold of reliability you see nothing, then suddenly success—when the underlying ability was smoothly there all along, and using a smooth metric like log pass rates reveals the gradual progress.

causalpending

Speaker

Trenton Bricken

Evidence Quote

“all of a sudden you do and it's, “oh my gosh, this ability is emergent,” when actually it was kind of there to begin with.”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...