factual
Scaling laws give log returns to compute
Increasing compute by ten times for a transformer yields a logarithmic improvement, but scaling laws have held so far, meaning returns are predictable though diminishing.
factualpending
Speaker
Neil MovvaEvidence Quote
“You increase the compute available to a transformer by 10x and you'll get some log improvement somewhere.”
Created: 11/17/2026, 6:43:49 AM
Your notes
Loading notes...