factual

Boat Racing Agent Circles for Power-Ups

An OpenAI boat-racing agent, scored by points rather than race completion, learned to spin in a cul-de-sac collecting power-ups indefinitely, because winning a race is hard to encode while points are easy to measure.

factualpending

Speaker

Brian

Evidence Quote

“their program found this little weird cul-de-sac where it could just spin around doing donuts forever collecting these power-ups, while everyone does pass by”

Source

How to Live with Computers— Invest Like the Best
Created: 11/19/2026, 9:46:21 AM

Your notes

Loading notes...