factual

Circuits reveal models plan ahead and reason genuinely

Circuits work shows models do genuine reasoning and planning: in a poetry example the model decides by the end of the first line what it wants to write at the end of the second and backfills, and in medical diagnosis it maps '20 weeks gestation' to pregnancy without being told, extracts symptoms, maps them to a specific condition, and projects out to unmentioned symptoms—reasoning that changed Sholto's prior view that models don't reason.

factualpending

Speaker

Sholto Douglas

Evidence Quote

“I remember you asked, "Do these models really reason?" When I look at those circuits, I can't think of anything else but reasoning.”

Source

Is RL + LLMs enough for AGI? — Sholto Douglas & Trenton Bricken— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:28:51 AM

Your notes

Loading notes...