The main issue with the original encoder-decoder architecture is that the encoder must map the entire input sequence into a single vector embedding, which then becomes the sole source of information for the decoder to generate the entire target sequence, creating a severe information bottleneck.

causalpending

Speaker

Unidentified Speaker — 10 years of NLP history explained in 50 concepts | From Wor… [uocYQH0cWTs]

Evidence Quote

“the main issue with the original sequence to sequence architecture is that the encoder has to map the entire sequence into a single Vector embedding which the decoder then has to produce the entire Target sequence from”

Source

10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT— Neural Breakdown with AVB
Created: 8/11/2026, 1:00:15 AM

Your notes

Loading notes...