Look-Ahead Masking
Definition
A masking technique used in autoregressive decoders where a matrix of negative infinities is added to attention scores before softmax for future position pairs, ensuring that attending to future tokens results in zero probability
Cast within
No topic-region cast yet — this appears once Look-Ahead Masking's compiled claims are aligned into a topic region's argument tree.
Claims mentioning Look-Ahead Masking (1)
Your notes
Loading notes...