The decoder's final point-wise feed-forward layer output goes through a final linear layer that acts as a classifier with classes equal to the vocabulary size, with softmax producing probability scores between 0 and 1 for each class.
factualpending
Speaker
Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]Evidence Quote
“the output of the final point wise feed-forward layer goes through a final linear layer that access a classifier the classifier is as biggest number of classes you have for example if you have 10,000 classes for 10,000 words the output of that classifier will be of size 10,000”
Created: 8/13/2026, 9:51:15 AM
Your notes
Loading notes...