Roughly 10 years after Hinton's 1985 model, Yoshua Bengio showed the same feature-vector approach worked on real English sentences with 5-10 input words and predicted the next word about as well as the best language models of the time; about 10 years later the linguists conceded feature vectors were a good idea; and about 10 years after that Google invented transformers.

factualpending

Speaker

Geoffrey Hinton

Evidence Quote

“about 10 years after that, people at Google invented transformers”

Source

Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton— The Royal Institution
Created: 6/18/2026, 2:17:54 PM

Your notes

Loading notes...