sequence-to-sequence task
Machine learning task where a model must generate an output sequence from an input sequence, such as machine translation or text summarization.
As defined in 10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “sequence-to-sequence task” →
- The encoder-decoder architecture (introduced in 2014) solves sequence-to-sequence tasks by passing the entire input sequence token-by-token through an encoder RNN (LSTM or GRU), using the final hidden state as an embedding of the full input sequence, then passing this encoding as the initial hidden state to a decoder RNN that generates the target sequence.10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT
- Sequence-to-sequence tasks involve generating a sequence as output from another input sequence, with examples including machine translation (French to English) and summarization (long passage to short summary).10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT