factual
Pre-training scaling has plateaued
All the major labs have hit a plateau in how scaling is perceived for pre-training, since the power laws implied that 10x more pre-training compute yields a step-function gain in model performance, but that has stopped holding in practice.
factualpending
Speaker
ChetanEvidence Quote
“all the labs have hit some kind of plateauing effect on how we perceive scaling for the last two years, which was specifically in the pre-training world”
Created: 11/18/2026, 6:42:24 AM
Your notes
Loading notes...