A basic model of an agent has four parts: a policy that says what to do in a situation, a value function that is learned with TD learning and produces a number about how well it's going, a perception component that constructs state representation, and a transition model of the world that represents what will happen if you take an action.
definitionpending
Speaker
Richard SuttonEvidence Quote
“We need a policy. The policy says, 'In the situation I'm in, what should I do?' We need a value function... The fourth one is the transition model of the world.”
Created: 8/11/2026, 6:36:28 AM
Your notes
Loading notes...