The output of the decoder's first multi-headed attention is a masked output vector with information on how the model should attend to the decoder's inputs.

factualpending

Speaker

Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]

Evidence Quote

“the output of the first multi-headed attention is a mask output vector with information on how the model should attend on the decoders inputs”

Source

Illustrated Guide to Transformers Neural Network: A step by step explanation— The AI Hacker
Created: 8/13/2026, 9:51:15 AM

Your notes

Loading notes...