The base common model of the agent has four parts: a policy (what to do in the current situation), a value function (learned via TD learning, producing a number for how well things are going used to adjust the policy), a perception/state-representation component, and a transition model of the world (belief about consequences of actions, learned richly from all sensation, not just reward).

definitionpending

Speaker

Richard Sutton

Evidence Quote

“Now I want to talk about the base common model of the agent with the four parts.”

Source

Richard Sutton – Father of RL thinks LLMs are a dead end— Dwarkesh Patel
Created: 6/18/2026, 1:59:29 PM

Your notes

Loading notes...