Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargontechnology· 3 claims· 1 episode

governance challenges

The institutional, policy, and coordination problems involved in managing superintelligence development and deployment, including international cooperation and regulation

As defined in Nick Bostrom: What Happens When AI Evolves Faster Than Humans?


Where it comes up · 1
  • Nick Bostrom: What Happens When AI Evolves Faster Than Humans?3 claims

Most important claims · 3 of 3Search all claims for “governance challenges” →
  • Beyond alignment, governance challenges also arise in superintelligence development, though they are not one-time solutions but ongoing management of the transition as it unfolds.Nick Bostrom: What Happens When AI Evolves Faster Than Humans?
  • There are four major areas of challenge in managing superintelligence development: the alignment problem (for technical AI researchers), governance challenges (ongoing management of the transition), expanding empathy to digital minds (for broad culture), and ensuring positive interaction with other potential superintelligences or super-beings.Nick Bostrom: What Happens When AI Evolves Faster Than Humans?
  • Whether we will solve the alignment and governance challenges depends on how hard these challenges turn out to be, which we don't really know—thus the outcome is partially 'baked in' to factors beyond current understanding.Nick Bostrom: What Happens When AI Evolves Faster Than Humans?