The circuit analysis also reveals that when planning the second line of the poem, Claude considers multiple alternative completions (e.g., 'habit' as an alternative to 'rabbit'), and the model is capable of writing different lines depending on which concept pathway is active during generation.

factualpending

Speaker

Unidentified Speaker — Tracing the thoughts of a large language model [Bj9BD2D3DzA]

Evidence Quote

“We look at the place that the model was thinking about the word rabbit, and we see other ideas it had for places to take the poem. We also see the word habit is present there.”

Source

Tracing the thoughts of a large language model— Anthropic
Created: 8/11/2026, 7:42:04 AM

Your notes

Loading notes...