The decoder's final point-wise feed-forward layer output goes through a final linear layer that acts as a classifier with classes equal to the vocabulary size, with softmax producing probability scores between 0 and 1 for each class.

factualpending

Speaker

Unidentified Speaker — Illustrated Guide to Transformers Neural Network: A step by… [4Bdc55j80l8]

Evidence Quote

“the output of the final point wise feed-forward layer goes through a final linear layer that access a classifier the classifier is as biggest number of classes you have for example if you have 10,000 classes for 10,000 words the output of that classifier will be of size 10,000”

Source

Illustrated Guide to Transformers Neural Network: A step by step explanation— The AI Hacker
Created: 8/13/2026, 9:51:15 AM

Your notes

Loading notes...