factual

Superposition is a combinatorial code from the space

Superposition is not an artifact of an individual neuron but of the high-dimensional space they jointly create—with two neurons as X and Y axes you can map many different things to different parts of the plane—so it is a combinatorial code, and to the extent the real world is high-dimensional and sparse, the brain should also be underparameterized and use superposition (e.g. in poorly-understood regions like V2).

factualpending

Speaker

Trenton Bricken

Evidence Quote

“It's a combinatorial code”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...