The decoder takes the index of the highest probability score from the softmax layer to identify the predicted word, adds the predicted output to the list of decoder inputs, and continues decoding until an end token is predicted.
factualpending
Speaker
Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]Evidence Quote
“we take the index of the highest probability score and that equals our predicted word the decoder didn't taste the output and adds it to the list of decoder inputs and continue decoding again until end token is predicted”
Created: 8/13/2026, 9:51:15 AM
Your notes
Loading notes...