factual

Neural fictitious self-play substitutes RL for search

When you cannot easily build a search tree (imperfect-information or non-deterministic games like StarCraft), neural fictitious self-play replaces the MCTS teacher: you fix an opponent, train a best-response policy with a model-free RL algorithm (PPO, SAC, V-MPO), and distill the league of best responses into a mixed strategy—still fundamentally relabeling states with better actions.

factualpending

Speaker

Eric Jang

Evidence Quote

“Instead of an MCTS teacher, you use a model-free RL algorithm to find the best search action that you could do to beat your opponent. Then you're distilling the policy here into what's known as a mixed strategy”

Source

Dwarkesh Patel Podcast - Eric Jang – Building AlphaGo from scratch— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:56 AM

Your notes

Loading notes...