Positional Encoding
Definition
A technique for injecting word position information into embeddings using sine and cosine functions, necessary in transformers because unlike RNNs they lack sequential processing and must explicitly know where each word appears in the sequence
Cast within
No topic-region cast yet — this appears once Positional Encoding's compiled claims are aligned into a topic region's argument tree.
Claims mentioning Positional Encoding (5)
Your notes
Loading notes...