definition

Feature is a direction in activation space

A feature is a direction in activation space—a latent variable operating behind the scenes that has causal influence over the observed system; somewhat tautologically 'it's a feature if you call it a feature', but operationally it is a discrete unit with connections to other things that imbue it with meaning, and superposition lets many such features pack into high-dimensional vectors.

definitionpending

Speaker

Trenton Bricken

Evidence Quote

“A direction and activation space. A latent variable that is operating behind the scenes, that has causal influence over the system you're observing. It’s a feature if you call it a feature, it's tautological.”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...