Humans take for granted substantial implicit knowledge about physics and physical affordances when making predictions, which token-level models must attempt to explicitly predict and learn, making token-level prediction inefficient.
causalpending
Evidence Quote
“if you're just predicting the next token, there are a lot of things that are just implicit from your understanding of the physical world and you being there and all of this reasoning that goes on in your brain that you really just take for granted.”
Created: 8/11/2026, 7:13:18 AM
Your notes
Loading notes...