The transformer architecture, published by Google in 2017 in a paper called 'Attention is All You Need,' is fundamentally a machine for learning what word is likely to appear given a particular prompt, and was the breakthrough that enabled practical large language models.

factualpending

Speaker

Michael Wooldridge

Evidence Quote

“transformer architecture...is really just a way of organizing neural networks...a machine for learning what word is likely to appear”

Source

This is not the AI we were promised | The Royal Society— The Royal Society
Created: 8/12/2026, 6:23:19 PM

Your notes

Loading notes...