factual

Pre-training scaling has plateaued

All the major labs have hit a plateau in how scaling is perceived for pre-training, since the power laws implied that 10x more pre-training compute yields a step-function gain in model performance, but that has stopped holding in practice.

factualpending

Speaker

Chetan

Evidence Quote

“all the labs have hit some kind of plateauing effect on how we perceive scaling for the last two years, which was specifically in the pre-training world”

Source

Capital, Compute & AI Scaling— Invest Like the Best
Created: 11/18/2026, 6:42:24 AM

Your notes

Loading notes...