causal

Transformers scale by learning any pairwise relationship

Transformers scale because attention lets any token relate to any other, making them general learners that find whatever patterns exist in a sequence, which explains their dominance in language and their ability to scale from millions to trillions of parameters.

causalpending

Speaker

Neil Movva

Evidence Quote

“transformers are the link to go from millions to trillions of parameters.”

Source

Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]— Invest Like the Best
Created: 11/17/2026, 6:43:49 AM

Your notes

Loading notes...