Multi-Armed Bandit Captures Explore-Exploit Tradeoff
The explore/exploit trade-off, formalized as the multi-armed bandit problem, describes how much to gather information versus commit to the best-known option, and it applies to restaurants, relationships, investing, careers, and clinical trials.