Next-token prediction is not a substantive goal because it does not change the world; tokens come at the model and predicting them does not influence them, so the model has no goal about the external world.
factualpending
Speaker
Richard SuttonEvidence Quote
“Tokens come at you, and if you predict them, you don't influence them.”
Created: 6/18/2026, 1:59:29 PM
Your notes
Loading notes...