normative
Scaffolding vs compute is a Pareto frontier tradeoff
Whether to build bespoke scaffolded environments for each skill or let the model brute-force a sparse end reward is an efficiency tradeoff along a Pareto frontier of compute spend versus human-time spend on scaffolding; dense supervised rewards are best but expensive, while a good end reward lets the 'monkey hit the typewriter' until it succeeds, with the right point depending on the strength of the model's prior.
normativepending
Speaker
Sholto DouglasEvidence Quote
“How much am I willing to burn compute, versus how much am I willing to burn dollars on people's time to give scaffolding or give rewards?”
Created: 6/13/2026, 3:28:51 AM
Your notes
Loading notes...