← Jargon

Jargonmachine learning· 17 claims· 8 episodes

attention mechanism

The process by which transformers let word vectors incorporate information from each other (pay attention) through matrix operations, contextualizing them across layers.

As defined in 336 | Anil Ananthaswamy on the Mathematics of Neural Nets and AI


Other definitions

Where it comes up · 8