effective compute
The combined measure of computational capability available for training, accounting for hardware investment, hardware efficiency, and algorithmic/software progress together rather than raw chip count.
As defined in Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
Where it comes up · 1
- Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment5 claims
Most important claims · 5 of 5Search all claims for “effective compute” →
- The intelligence explosion feedback loop begins not at full human-level AI but when AI contributions to AI research become comparable to human contributions — boosting researcher productivity by 50-100% — because automating some tasks done in extreme profusion (like generating billions of programming problems or custom curricula) effectively doubles the research workforce even with the AI having weaknesses in other areas.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
- When AI does the research work, a doubling of computing performance translates directly into a doubling or more of effective labor supply, and since historically you got four to five doublings of compute efficiency per doubling of human labor inputs, you only need to spend one of those doublings on overcoming diminishing returns, leaving the rest to accelerate progress so each successive doubling takes a smaller fraction of the time.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
- During the explosion, AIs are applied where returns are highest, and software runs ahead first because a software improvement instantly upgrades all existing GPUs while a new chip design takes months to produce and doesn't update old chips — creating an ordering where the lowest-dependence-on-existing-stock improvements come first, until software gains approach their limits and slow down.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
- Software improvements are the most disruptive lever in an intelligence explosion because an algorithmic improvement can be immediately applied to all existing GPUs you already own, whereas a chip-design improvement only applies to chips manufactured after that point, so the leading edge of AI-automated input acceleration is on the software side.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
- Across hardware and software, AI capabilities consistently double on a shorter timescale than the number of people required to produce them, with Epoch estimates showing hardware efficiency doubling roughly every two years, training budgets doubling about every six months, and algorithmic efficiency doubling in less than a year, so effective compute for training is growing drastically.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment