causal
LLMs Acquire Inferential Competence From Text Statistics
Because language models are trained on huge text corpora to learn fine-grained statistical relationships between words, they are well placed to induce inferential (intra-linguistic) competence; and insofar as language statistics reflect the structure of the world, they can latch onto worldly structure—evidenced by Ellie Pavlick's finding that models' color-term representational geometry maps onto RGB color space.
causalpending
Speaker
Raphael MilliereEvidence Quote
“there is something about the structure of the encodings for word terms in these models that encodes information or is somehow isomorphic to the structure of colors out there in the world”
Created: 6/13/2026, 12:19:51 AM
Your notes
Loading notes...