Historical papers from Shane and Hassabis (2009 and 2016) anticipated key developments: Shane's thesis identified compression of Wikipedia as a test for AI (which became the loss function for LLMs), and Hassabis's 2016 neuroscience-AI paper identified attention as a critical capability (which was later crystallized in transformers).

factualpending

Speaker

Podcast Host

Evidence Quote

Shane's thesis in 2009...can you compress Wikipedia?...Or in your own paper in 2016...attention is what is needed [35:22]

Source

Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFoldDwarkesh Patel
Created: 8/11/2026, 1:25:34 AM

My Notes

Loading notes...