causal
Emergence is a measurement mirage
Apparent emergent abilities are partly a 'mirage' of measurement: success requires sampling the last several tokens correctly, so you multiply those probabilities and below a threshold of reliability you see nothing, then suddenly success—when the underlying ability was smoothly there all along, and using a smooth metric like log pass rates reveals the gradual progress.
causalpending
Speaker
Trenton BrickenEvidence Quote
“all of a sudden you do and it's, “oh my gosh, this ability is emergent,” when actually it was kind of there to begin with.”
Created: 6/13/2026, 3:31:11 AM
Your notes
Loading notes...