factual
Superposition is a combinatorial code from the space
Superposition is not an artifact of an individual neuron but of the high-dimensional space they jointly create—with two neurons as X and Y axes you can map many different things to different parts of the plane—so it is a combinatorial code, and to the extent the real world is high-dimensional and sparse, the brain should also be underparameterized and use superposition (e.g. in poorly-understood regions like V2).
factualpending
Your notes
Loading notes...