← Jargon

Jargontechnology· 7 claims· 1 episode

attention score

A numerical value computed by taking the dot product of a query vector with a key vector, representing how much focus or relevance should be placed on a particular element relative to others

As defined in Illustrated Guide to Transformers Neural Network: A step by step explanation


Where it comes up · 1