Historical papers from Shane and Hassabis (2009 and 2016) anticipated key developments: Shane's thesis identified compression of Wikipedia as a test for AI (which became the loss function for LLMs), and Hassabis's 2016 neuroscience-AI paper identified attention as a critical capability (which was later crystallized in transformers).
factualpending
Speaker
Podcast HostEvidence Quote
“Shane's thesis in 2009...can you compress Wikipedia?...Or in your own paper in 2016...attention is what is needed [35:22]”
Created: 8/11/2026, 1:25:34 AM
My Notes
Loading notes...