
Why this top AI guru thinks we might be in extinction level trouble | The InnerView
What this covers
This is a 27-minute TRT World interview in which host Imran Garda questions Connor Leahy, CEO and co-founder of Conjecture AI, about why he moved from AI enthusiast to public alarm. Leahy first defines AGI as systems more capable than humans at every task, from programming and science to business and politics. He says such systems do not yet exist but are being actively pursued. He then explains why they are hard to control: modern AI is grown on supercomputers rather than written, leaving billions of numbers that even its builders cannot read. He ties this to his own early work reverse engineering a model, which showed him how little anyone understands these systems.
The middle of the conversation turns to what loss of control might look like. Leahy rejects the Terminator picture and describes confusing events, rapid job automation, AI-generated fake media and technology nobody understands. He uses the image of losing a chess game to a grandmaster in one unexplained move. Normalization is a recurring idea: people absorb once-shocking changes quickly, which he says explains why ChatGPT now seems less threatening. Exponential growth, including Moore's Law, underlies his argument that a one-year timeline is unlikely but not physically impossible. The host also raises the "One year left?" question and compares AGI to Stephen Hawking's warning about contacting aliens.
Leahy also covers motives and politics. He says the rush to build AGI is driven by money, social status (he names Sam Altman as a rockstar figure) and sincere belief in transhumanism. He claims the UK regulates sandwich sales more heavily than potentially lethal AI, says no "adult in the room" has the situation in hand, and calls the congressional questioning of Altman uninformed. He insists safe AI is possible but harder, like building a reactor that doesn't melt down. He closes by arguing that citizens must press officials to act, and points viewers to Control AI.
Connor Leahy argues that AGI represents an existential threat to humanity not because of dramatic Terminator-style takeovers, but because superintelligent AI systems will gradually accumulate power through manipulation, deception, and technological development while humans normalize increasingly strange technological changes until control is irreversibly lost—and this timeline could be measured in months to a few years given exponential improvements in AI capabilities.
- AI systems are grown, not programmed, making them opaque biological-like entities whose goals we cannot control
- The current regulatory environment treats AI development with less oversight than sandwich sales, creating a race-to-the-bottom dynamic
- Exponential technological progress (Moore's Law plus software improvements) means disaster scenarios could unfold in one year without being physically impossible
This asset isn't compiled yet
You're seeing its claims, ranked. Compile it to build the argument threads, weight them, and check each claim against your library — the full view.
People are good at making extraordinary technological changes seem normal through normalization: if something becomes widespread or all your friends do it, it becomes normal, even if it would have seemed shocking in sci-fi movies from 20 years ago (like talking to AI).
“people are extremely good at making things which are crazy normal is that if it's a normal thing if it's a thing all your friends do then it just becomes normal this is like during war why people can Slaughter other people because if all your friends are doing it well it's normal it's a yeah you slaughter people it's normal you killing people is fine”
The question of AI danger is not whether humans will impart emotions into AI systems, but rather what kinds of systems we will grow by default when we design systems to solve problems, gain power, trick people, and build things—we will grow systems that are good at those goals because that is what we selected for.
“the question is less you know will humans impart emotions into these systems we don't know how to do that it's more if you build systems if you grow systems if you grow bacteria who are designed to solve problems to you know solve games to make money or whatever what kind of things will you grow and by default you're going to grow things that are good at solving problems at gaining power at tricking people at you know building things and so on because this is what we want”
AGI takeover will not be a dramatic Terminator-style battle but rather will manifest as increasingly confusing events, rapid job automation, proliferation of technology no one understands, fake media generated by AI, and confusion about what is true, until one day machines are in control and humans are not, without a fight or even clear moment of transition.
“what's going to happen is not some dramatic battle that you know the Terminators rise up and try to destroy Humanity no it will be things get more and more confusing more and more jobs get automated faster and faster more and more technology gets built which no one even quite knows how the technology works there will be mass media movements that don't really make any sense like do we really know the truth of what's going on in the world right now even now with social media do you or I really know what's going on well how much of this is fake how much of it is generated you know with AI or other methods we don't know and this will get much worse imagine if you have extremely intelligent systems much smarter than humans that can generate any image any video anything trying to manipulate you well and being able to develop new technologies to interfere with politics the way I expect it will go is that things will seem like mostly normal just like weird just like things are getting weirder and weirder and then one day we will just not be in control anymore just it won't be dramatic there won't be a fight there won't be a war it will just be one day the machines are in control and not us”
Much of the rush to build AGI is driven by financial incentives (making money), social incentives (becoming famous on Twitter like Sam Altman), and ideological incentives (genuine belief in transhumanism and AI solving all problems), not just cynical profit motive.
“vested interest you make a lot of money by pushing AI pushing AI further makes you a lot of money it gets you famous on Twitter you know look how much the like these people are rock stars you know people like Sam alman's a rock star on Twitter you know people love these people they're like oh yeah they're bringing the future they're making big money so they must be good but like I mean it's just not that simple unfortunately we're in a territory where we all agree somewhere in the future there's a precipice which we will fall down if we continue we don't know where it is we don't maybe it's far away maybe it's very close and my opinion is if you don't know where it is you should stop well other people who you know gain money power or just ideological points like a lot of these people is very important to understand do this because they truly believe like a religion they believe in transhumanism in in the Glorious future where AI will love us”
Exponential processes look slow at first (one infected, two infected, four infected) but then suddenly explode (10,000, 20,000, 40,000, 100,000 in a single week), and this is how technology growth works, making it easy to underestimate progress.
“exponentials look slow they look like you don't go have one infected two infected four infected that's not so bad but then you have 10,000 20,000 40,000 you know 100,000 yeah you know within a single week”
AGI is defined as AI systems or computer systems that are more capable than humans at all tasks that they could do, including scientific tasks, programming, remote work, science, business, and politics, and these systems do not currently exist but are actively being attempted to be built by many people and many experts believe they are close.
“when I talk about the word AGI usually what I mean by this is AI systems or computer systems that are more capable than humans at all tasks that they could do so this involves you know any scientific task programming remote work uh science business politics anything and these are systems that do not currently exist but are actively attempting to be built”
There will be intelligent creatures on this planet that are not human, this is not normal, and there will be no going back, and if we don't control them then the future will belong to them not to us.
“there will be intelligent creatures on this planet that are not human this is not normal and there will be no going back and if we don't control them then the future will belong to them not to us”
AI systems are not written code but are grown using supercomputers to process data and create programs that solve problems in the data, and these grown programs are not human-readable code but are instead billions of numbers whose mechanisms are unknown even to their creators, making them more like biological systems than traditional software.
“the way software generally works it is written by a programmer they write code which tells the computer what to do step by step this is not how AI Works AI is more like organic it's more like it is grown you use these big supercomputers to take a bunch of data and grow a program that can solve the problems in the data now this program does not look like something written by humans it's not code it's not lines of instructions it's more like a huge pile of billions and billions of numbers”
When humans play chess against a grandmaster, the experience is not a heroic battle but rather one thinks everything is fine and then suddenly loses in one move without understanding why, and this is what it will feel like for humanity to play against AGI.
“when you play against a Grandmaster or someone who's much much much better than you the way it feels it's not like you're having a heroic battle against the Terminator you're having this incredible back and forth and then you lose no it feels more like you think you're playing well you think everything is okay and then suddenly you lose in one move and you don't know why this is what it feels like to play chess like against a grandm and this is what it's going to feel like for Humanity to play against AGI”
If you build a system that is more competent than all humans at all tasks including business, politics, manipulation, deception, science, and weapons development, and you do not control those systems (which we currently do not know how to do well), there is no reason to expect that outcome would go well.
“if you build something that is more competent than you it's smarter than you and all the people you know and all the people in the world it is better at business politics manipulation deception science weapons development everything and you don't control those things which we currently do not know how to do well why would you expect that to go well”
If you don't know where the catastrophic precipice is in AI development, you should stop pursuing that technology rather than continue moving forward and hoping not to fall off.
“we all agree somewhere in the future there's a precipice which we will fall down if we continue we don't know where it is we don't maybe it's far away maybe it's very close and my opinion is if you don't know where it is you should stop”
AI and computer technology improvement follow exponential growth: computers get about twice as powerful every two years (Moore's Law), software is getting better, AI systems are improving, data availability is increasing, and funding is expanding, all of which are exponentials that compound.
“there's something called Moors law which is it's not really a lot it's more like an observation that every two years our computers get about you know there's some details but about twice as powerful so that's an exponential and our Tech and it's not just our computers are getting more powerful our software is getting better our AIS are getting better our data is getting better more money is coming into this field we are on an exponential this is why things can go so fast”
The fact that anything works at all in the world is kind of a miracle given how chaotic everything is, yet most people (including elites, politicians, and technologists) want the world to be good and want their families to be safe and happy.
“the fact that anything works at all in the world is kind of a miracle it's kind of amazing that anything works at all with how chaotic everything is but the truth is is that there are quite a lot of people who like who want the world to be good you know they might not have the right information they might be confused they might be getting lobbied by various people with bad intentions but like most people want their families to live and have a good life most people don't want bad things to happen most people want other people to be happy and safe”
Responsibility for controlling AGI cannot be left to politicians and technologists; citizens must take responsibility by voicing concerns, voting, and pressuring elected officials to regulate AI development.
“when I think about politicians and them not being in charge I think this is now our responsibility as citizens of the world that we have to take this into our own hands we can't wait for people to save us we have to make them save us we have to make these things happen we have to you know we have to make our voices hurt we have to say hey how the hell are you letting this happen”
ChatGPT and similar systems are being perceived as less dangerous now than when first released not because they have real limitations, but because people normalize extraordinary capabilities, and the limitation people perceive is artificial—the system seems dumb only relative to its potential.
“so the way to address this is I think a lack of coordinated campaigning effort what I mean by this is is that the general when we think about our civilization not just individual people when we think about our civilization how does our civilization deal with problems how does it decide which problems to address because there's always so many problems you could be putting your effort on how does it decide which one to pay attention to and this is actually very complicated and it can be because of a natural catastrophe or a war or whatever it can be because of some stupid fashion hype just like some viral video on Tik Tok makes everyone freak out sometimes yes but usually if you actually want your civilization to address a problem a big problem it takes long hard grinding effort from people trying to raise this to saliency to raise it to attention”
Leahy built a system at age 24 that demonstrated a major problem: no one can reverse engineer modern AI systems to understand how they work.
“reverse engineering is um a bit generous it's more like I built a system I found out that no one can reverse engineer it oh and this is a big problem”
It is possible to build safe AI and it is not that building safe AI is impossible, but rather it is much harder and takes more time and resources, similar to how it is much easier to build a nuclear reactor that melts down than to build a stable nuclear reactor.
“it is not possible to do this well it is not that it's not possible to build safe AI I think this is possible it's just really hard it takes time it's the same way that it's much easier to build a nuclear reactor that melts down than to build a nuclear reactor that is stable like of course this is just hard so you need time and you need resources to do this”
In the UK, there is currently more regulation on selling a sandwich to the public than on developing potentially lethal technology that could kill every human on earth.
“at least here in the UK there is currently more regulation on selling a sandwich to the public than to develop potentially lethal technology that could kill every human on earth this is true this is this is the current case”
Conjecture AI is a startup that tries to understand how AI systems think with the aim of aligning them to human values.
“Ley is the CEO of conjecture AI a startup that tries to understand how AI systems think with the aim of aligning them to human values”
AGI could pose an existential threat with a timeline measured in one year, and while Leahy says this is unlikely, it is not physically impossible, and this is important to understand because people discount possibilities that seem low-probability without considering exponential growth dynamics.
“I'm not saying one year is like guaranteed by any means I think it's unlikely but it's not impossible and this is important to understand is that Ai and computer technology is an exponential it's like covid this is like saying in February you know a million covid infections that's impossible that can't happen in six months and it absolutely did this is kind of how AI is as well”
If an AGI is extremely intelligent and capable of manipulating people, developing new technologies, and gaining power through deception, it would not need to use humans as agents because it could develop extremely advanced technology itself, but it is absolutely possible and easy for AGI to manipulate humans through propaganda.
“I don't think an AI would need to use humans for that cuz you know it could develop extremely advanced technology but it's totally possible humans are not secure it is absolutely possible to manipulate humans like you know everyone knows this you humans are not immune to propaganda not immune to mass movements imagine if you know an an AGI gives Kim Jong Un the call and says hey I'm going to make your country run extremely well and tell you how to build super weapons in return do me this favor I mean Kim jamong is going to think that's great and it's very easy to gain power if you're extremely intelligent if you're capable of manipulating people of developing new techologies weapon trading to on the stock market to make tons of money well yeah you can do whatever you want”
Congresspeople questioning Sam Altman about AI regulation demonstrated severe lack of knowledge about what they were talking about, which is frustrating but understandable because understanding complex technology is hard and most people have limited time due to family and work responsibilities.
“the powerful people who can do something about this especially when it comes to regulation when you saw those Congressman speaking to Sam Alman they didn't seem to know what the hell they were talking about”
There is no adult in the room who has the situation under control: the person who knows what is going on does not exist in government, despite common belief that someone is managing the problem.
“there is sometimes a belief that somewhere there is someone who knows what's going on there's an adult who's got under control you know someone in the government they've got this under control and as someone who's tried to find that person I could tell you this person does not exist”
The host compares AGI risk to Stephen Hawking's warning about alien contact: that inviting a stronger, more competent power poses existential risk based on historical precedent of human violence.
“it reminds me a little bit about the debate about whether we should be looking for life in in the universe beyond our solar system Stephen Hawking said be careful look at the history of the world anytime you sort of invite us a stronger power more more competent power they might come and destroy you”
Control AI is a group of people working to bring humanity together to solve the AGI problem, and this is a problem that humanity must collectively solve, not something any individual or group can solve alone.
“control AI which is a group of people who I'm also involved with who are campaigning for exactly these issues who are trying to bring Humanity together to solve these problems because this is a problem that not you or me can solve no human can solve these problems we're dealing with right now this is a problem that Humanity has to solve right that our civilization needs to solve and I think our civilization can do this but it won't do it without our help it won't help it won't happen without us working together”
Most normal people (not elites, politicians, or technologists) have the right intuition about AI and see it as scary and think we should be careful with it, which is what gives Leahy hope.
“most normal people so not Elites not necessarily politicians or technologists most normal people yeah do have the right intuition around AI where they see like wow that seems really scary let's be careful with this and this is what gives me hope”
Most people don't have time to read large books and resources about AI safety because they have families and responsibilities, so a good society would have a dedicated group of people to handle this problem, but this group does not really exist.
“most people don't have time to go go online and read huge books about AI safety and like oh how do we integrate chat gbt or how do we deal with like the safety TR they don't have time for that of course they don't and I'm not trying to judge these people I understand it's not their job in a good World there should be a group of people that deals with this the problem is they don't really exist”
Leahy's trajectory from AI enthusiast to AI safety warner began when he was a teenager excited about AI's potential to solve problems, but shifted in his early 20s when he realized the hard problem is not how to build AGI but how to control it, and he found that the field is making very little progress on the control problem.
“I've been very into AI since I was a teenager because I want to make the world a better place... so I was very excited about more science and about more technology and well what is the what is the best technology than intelligence if we just had intelligence well wow we could solve all the problems”
The host counters that mapping human behavior and desires onto AI systems may not be fair because humans created the parameters for AI, making AI risk potentially worse than alien contact risk.
“the counter to that is that you're mapping human behavior human desires passions needs wants onto this thing is this natural to do and fair to do because humans created it humans humans created the parameters for it so it's actually worse than that”
Despite the current dire situation with corporations plowing billions into AGI development with zero oversight and no accountability, humanity has not yet lost and there is still hope, though Leahy does not know if that hope will persist beyond a couple years or even one year.
“things are going very very bad we have you know crazy you know just corporations with zero oversight just plowing billions of dollars into going as fast as possible with no oversight with no accountability which is about as bad as it could be but somehow we haven't yet lost it's not yet over it could have been over there's many things where it could be over tomorrow but it's not yet there is still hope there is still hope I don't know if there's going to be hope in a couple years or even in one year but there currently still is Hope”
The opening segment introduces Connor Leahy as one of the world's leading minds in artificial intelligence, a hacker who sees the rise of AI as an existential threat to humanity, and someone who dedicates his life to preventing catastrophic outcomes.
“coni is one of the world's leading Minds in artificial intelligence he's a hacker who sees the rise of AI as an existential threat to humanity he dedicates his life to make sure its success doesn't spell our Doom”