← Jargon

Jargonartificial intelligence· 19 claims· 2 episodes

generative pre-trained transformer (GPT)

A type of large language model that is first pre-trained on vast text data to learn patterns and then fine-tuned for specific tasks, capable of generating new text

As defined in The Future of Artificial Intelligence


Other definitions
  • A class of large language models that are pre-trained using self-supervised next-token prediction on large text corpora, then fine-tuned for specific tasks, representing the dominant approach to building powerful language models

    Yann LeCun's $1B Bet Against LLMs [Part 1]

Where it comes up · 2