TD learning (temporal difference learning)
A reinforcement learning method where an agent updates its predictions of long-term outcome based on the difference between successive predictions, letting it learn from intermediate steps rather than waiting for the final result.
As defined in Richard Sutton – Father of RL thinks LLMs are a dead end
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “TD learning (temporal difference learning)” →
- AlphaGo was essentially a scaling-up of Gerry Tesauro's TD-Gammon (which used temporal difference learning to beat the world's best backgammon players), plus an additional search innovation; AlphaGo itself waited for final outcomes rather than using TD, but AlphaZero used TD and applied it across many games extremely well.Richard Sutton – Father of RL thinks LLMs are a dead end
- The base common model of the agent has four parts: a policy (what to do in the current situation), a value function (learned via TD learning, producing a number for how well things are going used to adjust the policy), a perception/state-representation component, and a transition model of the world (belief about consequences of actions, learned richly from all sensation, not just reward).Richard Sutton – Father of RL thinks LLMs are a dead end