moral patienthood
The status of being a being to whom others have duties and responsibilities; does not require advanced cognition.
As defined in Do All Creatures, Great and Small, and Made From Silicon, Have Rights? (with Jeff Sebo)
Where it comes up · 3
- Jack Clark4 claims
- Do All Creatures, Great and Small, and Made From Silicon, Have Rights? (with Jeff Sebo)1 claim
- 363 | Chandra Sripada on How LLMs and Humans are Cognitive Cousins1 claim
Most important claims · 6 of 6Search all claims for “moral patienthood” →
- Moral agency (having duties to others) requires sophisticated higher-order states like complex beliefs, desires, and emotions such as regret, which is why a dog lacks duties to humans; but moral patienthood (others having duties to you) does not require such cognitive sophistication—a being can still have a life that matters to it and be capable of being benefited and harmed without adult-human-level cognition.Do All Creatures, Great and Small, and Made From Silicon, Have Rights? (with Jeff Sebo)
- If welfare and moral patienthood rest on rationality, agency, or functional representational states rather than only sentience, and if consciousness is functional rather than substrate-dependent, then LLMs' functional states may make a stronger case for moral consideration.363 | Chandra Sripada on How LLMs and Humans are Cognitive Cousins
- World dynamics push toward AI agents having some independence and trading ability, but echoing IBM's principle that a computer cannot be held accountable for a decision (only humans can), creating agents wholly independent from people yet making decisions affecting people introduces a genuinely hard, unresolved problem for policy and legal systems.Jack Clark
- Today's AI systems are conscious only in the sense that a tongue without a brain is conscious—they respond to extremely complicated stimuli in the moment but lack a sense of self, living in an 'infinite now' within a context window with no memory or permanence; they are on a trajectory toward consciousness, but any consciousness they have today would be a truly alien, not human, consciousness.Jack Clark
- Controlling and changing the resources agents use is the ultimate disincentive and a possible path to controlling them, but this collides with tricky questions of moral patienthood: if AI agents are genuinely moral patients, turning them off introduces significant ethical issues that must be reconciled with the desire to control them.Jack Clark
- Humanities majors may rise in status while being handed problems that have proved impossible for humans to solve for thousands of years—like the economic policy of technological unemployment or the policy of moral patienthood—reflecting a growing recognition that non-technical skills are needed precisely where the hardest unsolved problems lie.Jack Clark