Temporal difference (TD) learning solves the sparse reward problem by learning a value function that predicts long-term outcomes; when intermediate progress is made (like capturing an opponent's piece in chess), the value prediction increases immediately, creating intermediate reinforcement without explicit reward.
factualpending
Speaker
Richard SuttonEvidence Quote
“When you learn to play chess, you have the long-term goal of winning the game. Yet you want to be able to learn from shorter-term things like taking your opponent's pieces.”
Created: 8/11/2026, 6:36:28 AM
Your notes
Loading notes...