definition

Four-part base agent model

The base common model of an agent has four parts: a policy (what to do in the current situation), a value function (a learned number indicating how well things are going, used to adjust the policy), a perception component (constructing the state representation), and a transition model of the world (predicting the consequences of actions), the last of which is learned richly from all sensation rather than from reward.

definitionpending

Speaker

Richard Sutton

Evidence Quote

“Now I want to talk about the base common model of the agent with the four parts.”

Source

Richard Sutton – Father of RL thinks LLMs are a dead end— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:36 AM

Your notes

Loading notes...