The transformer architecture, published by Google in 2017 in a paper called 'Attention is All You Need,' is fundamentally a machine for learning what word is likely to appear given a particular prompt, and was the breakthrough that enabled practical large language models.
factualpending
Speaker
Michael WooldridgeEvidence Quote
“transformer architecture...is really just a way of organizing neural networks...a machine for learning what word is likely to appear”
Created: 8/12/2026, 6:23:19 PM
Your notes
Loading notes...