factual

Compressing Wikipedia As Test For Intelligence

Shane Legg's 2009 thesis proposed that a test for AI is whether you can compress Wikipedia, which is essentially the loss function used to train modern LLMs, and Hassabis's own 2016 paper comparing neuroscience and AI identified attention as a needed capability before transformers existed.

factualpending

Speaker

Demis Hassabis

Evidence Quote

“we had some early attention papers, but they weren’t as elegant as transformers in the end, neural Turing machines and things like this.”

Source

Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:35:13 AM

Your notes

Loading notes...