Pre-trained means the model learns from examples by being shown large amounts of text content from diverse sources including Wikipedia articles, book databases, Reddit posts, cooking recipes, and relationship discussions, processing sentence by sentence to predict what comes next

definitionpending

Speaker

Julio

Evidence Quote

“pre-train means like how can this model generate tax yeah it generates learning from examples so the the training of this is like you know like a training like a an animal or like teaching a student how to do something uh by view of showing them a lot of examples um and and the training part is done on a large amount of text content from everywhere”

Source

What Is ChatGPT Doing? Episode 1: Introduction— Wolfram
Created: 8/11/2026, 1:13:01 AM

Your notes

Loading notes...