Generative
A property of machine learning models that means they generate new text output one token at a time by predicting what comes next in a sequence, rather than retrieving pre-written responses
As defined in What Is ChatGPT Doing? Episode 1: Introduction
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “Generative” →
- The generative component means the model is trained to generate text word by word by predicting what comes next, as demonstrated in Wolfram's example where the sentence 'the best ability about AI is its ability to' is continued by the modelWhat Is ChatGPT Doing? Episode 1: Introduction
- ChatGPT stands for Generative Pre-trained Transformer and is the neural network architecture on which the whole system is builtWhat Is ChatGPT Doing? Episode 1: Introduction