← Jargon

Jargonartificial_intelligence· 17 claims· 8 episodes

pretraining

The initial large-scale training phase where models learn general language patterns from massive unlabeled text corpora, before fine-tuning or RL on specific tasks

As defined in What does the next training paradigm look like?


Other definitions

Where it comes up · 8

Most important claims · 10 of 17Search all claims for “pretraining” →