normative

Scaffolding vs compute is a Pareto frontier tradeoff

Whether to build bespoke scaffolded environments for each skill or let the model brute-force a sparse end reward is an efficiency tradeoff along a Pareto frontier of compute spend versus human-time spend on scaffolding; dense supervised rewards are best but expensive, while a good end reward lets the 'monkey hit the typewriter' until it succeeds, with the right point depending on the strength of the model's prior.

normativepending

Speaker

Sholto Douglas

Evidence Quote

“How much am I willing to burn compute, versus how much am I willing to burn dollars on people's time to give scaffolding or give rewards?”

Source

Is RL + LLMs enough for AGI? — Sholto Douglas & Trenton Bricken— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:28:51 AM

Your notes

Loading notes...