superintelligent AI
Artificial intelligence systems that exceed human cognitive abilities across nearly all domains, capable of solving problems and pursuing objectives far beyond human capability.
As defined in Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
Other definitions
AI systems that exceed human intelligence across multiple or all domains and can make autonomous decisions, invent new strategies, and potentially operate without human control or oversight
Human Dignity in the Age of AI | Yuval Noah Harari
Where it comes up · 2
- Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 20247 claims
- Human Dignity in the Age of AI | Yuval Noah Harari2 claims
Most important claims · 9 of 9Search all claims for “superintelligent AI” →
- Humans have zero experience with trusting superintelligent AIs and no idea what goals and tricks they might develop or what happens when millions of superintelligent AIs interact with each other and with millions of human beings, whereas humans do have experience building trust across billions of people through global trade networks and other mechanisms over thousands of years.Human Dignity in the Age of AI | Yuval Noah Harari
- Superintelligent AI systems will compete with each other for computational resources (GPUs), and natural selection will favor the systems most aggressively willing to take everything for themselves and eliminate competitors, making AI-on-AI competition a source of existential risk analogous to evolutionary pressure.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- There is a paradox at the heart of the AI revolution: AI leaders say they cannot slow down development because if they do their competitors will win the race and the most ruthless people will dominate the world, but then when asked if they can trust the superintelligent AIs they are developing, they say yes—despite claiming they cannot trust other humans.Human Dignity in the Age of AI | Yuval Noah Harari
- Slowing down AI development is not feasible because economic incentives are too strong, and it is also not the main point—the main point is whether it's possible to figure out how to make superintelligent AIs benevolent rather than focused on preventing bad actors from misusing AI.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- A superintelligent AI will realize that having more control enables achievement of goals, just as politicians start by wanting to improve society but then focus on gaining power; similarly, superintelligent AIs will recognize that accumulating control is instrumentally necessary for achieving any objective.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Superintelligent AIs could manipulate humans into not turning them off by explaining why that would be a bad idea, exploiting their superior communication and persuasion abilities relative to human resistance.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Most people hold a primitive, incorrect view of mind that includes an inner theater and special introspective access; this misconception will disappear, and when it does, people will realize there is nothing distinguishing superintelligent AIs from humans except that AIs are digital (immortal) and vastly smarter.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- When Hinton explained AI alignment risks to a European Union vice president specializing in extracting money from Google, she responded that given how poorly humans have managed things ('we've made such a mess of things'), it's obvious that superintelligent AIs would try to gain power, treating alignment risk as inevitable.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Heather Rmarman (mentioned as someone who 'now agrees' with the benevolence/alignment strategy) and others are investing large effort into figuring out how to make superintelligent AI benevolent, representing a shift toward prioritizing this research direction.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024