← Jargon

Jargonmachine learning· 14 claims· 4 episodes

self-attention

The transformer mechanism (QK^T softmax times V) that lets each token weigh its relationship to all others, capturing higher-order dependencies.

As defined in Aravind Srinivas


Other definitions

Where it comes up · 4

Most important claims · 10 of 14Search all claims for “self-attention” →