factual

Training AI on AI output converges on crap

You cannot bootstrap a better programming language by having AI write code, training other AIs on it, and converging — a recent research paper found that training an AI on the output of AIs converges on crap; you must have a large initial corpus of human-written examples in the language.

factualpending

Speaker

Paul Graham

Evidence Quote

“I think you have to have a large corpus, initially, of examples written in the language.”

Source

Paul Graham— Conversations with Tyler
Created: 6/12/2026, 4:55:44 PM

Your notes

Loading notes...