factual
Transformers Generalized Sequence Processing
The transformer architecture, developed in late 2016 and made public in 2017, replaced recurrent networks like LSTMs (which date to the early 1990s) for sequence processing and works so well that nearly anything—images, video—can be treated as sequence data, enabling the rise of internet-scale generative AI.
factualpending
Speaker
François CholletEvidence Quote
“it works for sequence data but pretty much anything can be treated as sequence data. So it actually works for images, it can work for videos, it can work for pretty much whatever you want.”
Source
280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's MindscapeCreated: 6/13/2026, 12:07:39 AM
Your notes
Loading notes...