A basic model of an agent has four parts: a policy that says what to do in a situation, a value function that is learned with TD learning and produces a number about how well it's going, a perception component that constructs state representation, and a transition model of the world that represents what will happen if you take an action.

definitionpending

Speaker

Richard Sutton

Evidence Quote

“We need a policy. The policy says, 'In the situation I'm in, what should I do?' We need a value function... The fourth one is the transition model of the world.”

Source

Richard Sutton – Father of RL thinks LLMs are a dead end— Dwarkesh Patel
Created: 8/11/2026, 6:36:28 AM

Your notes

Loading notes...