wireheading
A scenario where humans (or agents) become so absorbed in directly stimulating their own reward/pleasure systems that they neglect survival, e.g. staring at infinitely engaging media and forgetting to eat.
As defined in George Hotz #3
Where it comes up · 6
- Dylan Field - Designing The Future - [Invest Like the Best, EP.407]2 claims
- Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment1 claim
- Patrick McKenzie — Money laundering, big tech censorship, SBF & Japan1 claim
- George Hotz #31 claim
- Guillaume Verdon1 claim
- Roman Yampolskiy1 claim
Most important claims · 7 of 7Search all claims for “wireheading” →
- Broad segments of the population have become addicted to things in the past and society has still gotten through, so people's habituation makes Dylan less fearful of wireheading than of military AI risks, and he is optimistic because thoughtful people work on military AI.Dylan Field - Designing The Future - [Invest Like the Best, EP.407]
- Games like World of Warcraft can function as a substitute advancement ladder and escape: McKenzie led a raid guild with 60 direct reports because his real job gave him no scope of control, and people in self-destructive spirals (often from undiagnosed depression) use video games, books, or TV as a 'poison' that drains effort from their true goals, worsening real-world results.Patrick McKenzie — Money laundering, big tech censorship, SBF & Japan
- The most obvious way humanity ends is wireheading: we amuse ourselves to death, staring at an infinite TikTok and forgetting to eat, or more benignly simply stop reproducing — though it's hard to get all of humanity to do this.George Hotz #3
- Just as evolution implanted reinforcers like food, sex, and social imitation yet humans developed values like caring about real-world loved ones rather than wireheading — and many reject the experience machine despite knowing it would maximize their reward — successful human values are a misgeneralization away from the optimal reward-maximizing behavior, which proves it is possible to train a system that doesn't automatically converge to reward-hacking in the limit.Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment
- The obvious dark pattern for brain-computer interfaces is wireheading, in which users keep pressing a reward button, which is an old idea that has been discussed for a long time.Dylan Field - Designing The Future - [Invest Like the Best, EP.407]
- Physical pain can be re-engineered out of humans, as evidenced by mutants who feel no physical pain, but suffering tied to meaning is harder to remove, and attempts to manipulate one's hedonic set point risk wireheading—blissing out too much by tampering with the reward channel.Roman Yampolskiy
- Whereas effective altruism's loss function is hedons (units of hedonism) which has spurious minima like shrimp-farm pain reduction or wireheading via Neuralink or TikTok, effective accelerationism measures civilizational progress by an objective, ungameable physical quantity—energy—because subjective measures and currencies can be gamed or shift in value.Guillaume Verdon