Roughly 10 years after Hinton's 1985 model, Yoshua Bengio showed the same feature-vector approach worked on real English sentences with 5-10 input words and predicted the next word about as well as the best language models of the time; about 10 years later the linguists conceded feature vectors were a good idea; and about 10 years after that Google invented transformers.
factualpending
Speaker
Geoffrey HintonEvidence Quote
“about 10 years after that, people at Google invented transformers”
Source
Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton— The Royal InstitutionCreated: 6/18/2026, 2:17:54 PM
Your notes
Loading notes...