Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargonmachine learning· 2 claims· 1 episode

TD learning (temporal difference learning)

A reinforcement learning method where an agent updates its predictions of long-term outcome based on the difference between successive predictions, letting it learn from intermediate steps rather than waiting for the final result.

As defined in Richard Sutton – Father of RL thinks LLMs are a dead end


Where it comes up · 1
  • Richard Sutton – Father of RL thinks LLMs are a dead end2 claims

Most important claims · 2 of 2Search all claims for “TD learning (temporal difference learning)” →
  • AlphaGo was essentially a scaling-up of Gerry Tesauro's TD-Gammon (which used temporal difference learning to beat the world's best backgammon players), plus an additional search innovation; AlphaGo itself waited for final outcomes rather than using TD, but AlphaZero used TD and applied it across many games extremely well.Richard Sutton – Father of RL thinks LLMs are a dead end
  • The base common model of the agent has four parts: a policy (what to do in the current situation), a value function (learned via TD learning, producing a number for how well things are going used to adjust the policy), a perception/state-representation component, and a transition model of the world (belief about consequences of actions, learned richly from all sensation, not just reward).Richard Sutton – Father of RL thinks LLMs are a dead end