Look-Ahead Masking

Definition

A masking technique used in autoregressive decoders where a matrix of negative infinities is added to attention scores before softmax for future position pairs, ensuring that attending to future tokens results in zero probability

Cast within

No topic-region cast yet — this appears once Look-Ahead Masking's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Look-Ahead Masking (1)

Your notes

Loading notes...