factual
Compressing Wikipedia As Test For Intelligence
Shane Legg's 2009 thesis proposed that a test for AI is whether you can compress Wikipedia, which is essentially the loss function used to train modern LLMs, and Hassabis's own 2016 paper comparing neuroscience and AI identified attention as a needed capability before transformers existed.
factualpending
Speaker
Demis HassabisEvidence Quote
“we had some early attention papers, but they weren’t as elegant as transformers in the end, neural Turing machines and things like this.”
Source
Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:35:13 AM
Your notes
Loading notes...