causal

Verifiable Task Progress May Miss Overall Usefulness

Progress on verifiable tasks may have doubled while non-verifiable real-world usefulness has not, because training and measurement concentrate on verifiable tasks, like searching for keys under the lamplight.

causalpending

Speaker

Dwarkesh Patel

Evidence Quote

“Progress on verifiable tasks has doubled. But we have this effect where we’re searching for our keys under the lamplight.”

Source

Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:22:08 AM

Your notes

Loading notes...