factual

Transformers Generalized Sequence Processing

The transformer architecture, developed in late 2016 and made public in 2017, replaced recurrent networks like LSTMs (which date to the early 1990s) for sequence processing and works so well that nearly anything—images, video—can be treated as sequence data, enabling the rise of internet-scale generative AI.

factualpending

Speaker

François Chollet

Evidence Quote

“it works for sequence data but pretty much anything can be treated as sequence data. So it actually works for images, it can work for videos, it can work for pretty much whatever you want.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...