causal

Retraining cost brakes recursive self-improvement

Modern recursive self-improvement differs from old fantasies of an AI rewriting its own code, because the model must actually train a new, expensive model—training code is typically small and simple (plausibly 10,000 lines), so the real cost is the increasingly expensive training runs, which acts as a braking mechanism on intelligence explosion.

causalpending

Speaker

Sholto Douglas

Evidence Quote

“It's not going to be able to write the same code to be really smart, because actually it needs to train itself. The code itself is typically quite simple, typically really small and self contained.”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...