causal
Verifiable Task Progress May Miss Overall Usefulness
Progress on verifiable tasks may have doubled while non-verifiable real-world usefulness has not, because training and measurement concentrate on verifiable tasks, like searching for keys under the lamplight.
causalpending
Speaker
Dwarkesh PatelEvidence Quote
“Progress on verifiable tasks has doubled. But we have this effect where we’re searching for our keys under the lamplight.”
Source
Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:22:08 AM
Your notes
Loading notes...