invariance
The visual system's ability to recognize the same object or identity despite large changes in viewpoint, position, or appearance—considered the core problem of object recognition.
As defined in 284 | Doris Tsao on How the Brain Turns Vision Into the World
Where it comes up · 1
Most important claims · 4 of 4Search all claims for “invariance” →
- Monkeys have six face areas (patches), each performing a different function arranged hierarchically: the most posterior patch likes eyes (a dark disc within an outline), the next cares about faces at specific views, more anterior patches respond mirror-symmetrically (left and right profiles alike), and the most anterior patch contains cells that respond in a view-invariant way—firing for the same identity regardless of facial orientation.284 | Doris Tsao on How the Brain Turns Vision Into the World
- Inferior temporal (IT) cortex is the end of the ventral stream and is responsible for object recognition—identifying objects (your mom, keys, a pencil) invariant to how they are presented (profile, frontal, or back of the head)—which is a huge computational problem that IT cortex appears to solve.284 | Doris Tsao on How the Brain Turns Vision Into the World
- The biggest job of the visual system is solving the invariance problem—figuring out what corresponds to the same thing as input changes drastically—which functions like a compression problem: when the gaze shifts slightly, rather than rewriting the entire huge visual field, the brain represents the scene as almost the same thing shifted by a small amount, an enormous saving in energy and information processing achieved via dynamic receptive fields that transform to counteract image changes.284 | Doris Tsao on How the Brain Turns Vision Into the World
- Object identity across viewpoints can be solved without training data using differential geometry: a surface is defined as a collection of overlapping charts, so as you move around an object you compute one chart, change perspective (via two eyes or motion), find an overlapping chart, and form an equivalence class of charts whose equivalence relation is overlap—giving an elegant mathematical theory of how persistent objects arise, in contrast to computer vision's reliance on massive training data.284 | Doris Tsao on How the Brain Turns Vision Into the World