Holiday Message 2022: Thinking Really Slowly
What this covers
This solo episode uses two recent events—Elon Musk's acquisition of Twitter and the collapse of Sam Bankman Fried's FTX—as entry points to a broader argument about the cultural overvaluation of speed and surface-level cleverness. Sean Carroll weaves these cautionary tales together with historical episodes from physics, arguing that genuinely complex problems resist glib solution and that patience, careful reasoning, and willingness to question settled assumptions are essential virtues that modern incentive structures systematically undervalue.
The episode moves across three distinct registers. In tech and finance, Carroll examines how oversimplification creates vulnerability: the belief that one can "[move] fast and break things" works only in certain evolutionary or organizational contexts, but fails catastrophically when applied to established, interconnected systems where components have non-obvious dependencies. Twitter content moderation and fraud detection are held up as cases where the Bureaucratic Trap—the false belief that rules can be written to cover all future scenarios—leads people to mistake glib certainty for genuine insight. In physics, Carroll traces how John Bell and David Bohm advanced our understanding of quantum mechanics by refusing to accept von Neumann's supposedly settled negative result on hidden variables, showing instead that non-locality was required. The underlying thread connects Breadth vs Depth: the episode argues that while breadth of opinion carries social cachet, serious work demands depth, and that slow, contextual thinking—beyond even Kahneman's System Two—is what separates real intelligence from the performed version.
Carroll argues that across domains—tech ventures, finance, and physics—people over-valorize quick, glib thinking and oversimplification, and that slow, careful, deep thinking is undervalued but essential for handling genuinely complex problems.
- Twitter and FTX failures stem from treating complex, nuanced problems (free speech moderation, fraud) as easily solvable
- Investors and audiences mistake glib quickness for genuine intelligence, ignoring red flags
- Foundations of physics shows the payoff of patience—Bohm/Bell histories prove that questioning 'settled' results yields deep advances
Speed and confidence without depth are dangerous; careful thought reveals hidden assumptions and uncovers fraud that glib talk conceals.
- Sam Bankman-Fried's net wealth went from an estimated $26 billion to zero in a remarkably short period because of FTX's collapse, which was not merely bad management but seems very clearly to have involved outright fraud, as SBF himself admitted in interviews that much of what he did was fooling people to get their money.
“had a net wealth that went from $26 billion estimated to zero in a remarkably short period of time... It was not just bad management. It seems very, very clear that there was outright fraud going on”
- Society wrongly valorizes glib quickness and fast talking over careful thought, exemplified by investors being impressed that SBF could deliver a smooth pitch while playing video games and by SBF claiming every book should just be a blog post—signs that should be read as red flags rather than markers of genius.
“It's a valorization of a kind of glib quickness and fast talking over careful thought.”
- When physics has strong experimental guidance, wrong ideas get shot down quickly, so you can reach correct ideas even with sloppy reasoning because nature guides you kicking and screaming; but for questions with meager empirical guidance—like why the cosmological constant or Higgs mass are small—the old fast ways of thinking aren't enough and you must think more carefully, asking why you assumed a number was natural in the first place.
“When you're in a situation where you have huge guidance from experimental or empirical data, wrong ideas get shot down quickly... But sometimes, there are important questions for which the experimental guidance is kind of meager”
- Beyond Kahneman's system-two cognitive thinking, there is value in 'thinking really slowly'—taking a breath, considering the broader context a problem resides in, and reflecting on all the connotations, insinuations, and implications of a situation.
“thinking about the context that some certain problem or situation resides in and thinking about all of the connotations and insinuations and implications of what is going on”
Complex systems require human judgment and transparency, not preset rules; moderation and policy need agency, community input, and ongoing adaptation.
- Any 'just obey the law' moderation policy is unworkably simplistic because every platform inevitably draws lines (death threats, hardcore pornography), different countries have different laws, and there is no magic formula—you must enumerate considerations, weigh your own values, and gather community input rather than impose a single simple rule.
“what you realize very, very quickly is, you are drawing a line. Everyone draws a line between what is permitted and what is not permitted”
- The deeper problem in content moderation is not where to draw the line but the procedural question of who moderates and how transparently, because opaque processes controlled by a tiny number of people relative to a huge user base create frustration; community self-moderation is likely a superior approach.
“the real problem is not where to draw the line between what's allowed on Twitter and what's not allowed on Twitter, but the procedural question about who gets to moderate?”
- The 'bureaucratic trap' is the false belief that you can think ahead to every possible future circumstance and write rules to handle them; this always fails because complex systems generate unanticipated situations, so what you need instead is agency—a smart, careful person or community able to consider the actual, possibly unprecedented situation.
“The bureaucratic trap is, "I can think ahead to every possible circumstance that will happen in the future, write a set of rules that will deal with it." And it always fails.”
- Whether being a working physicist or a tech mogul trying to change the world, we should place more value than we currently do on going deeply, being patient, and thinking very slowly about difficult questions, and consider changing incentive structures—such as alternating years of publishing with years of reading—to reward depth over speed.
“we should place a little bit more value than we do on going deeply, being patient, thinking carefully, thinking very, very slowly about the very difficult questions that we're trying to address”
Depth of understanding matters more than breadth; physicists tolerate unclear foundations while hidden-variable theories show how questioning assumptions unlocks insight.
- John Bell, struck by Bohm's non-local hidden-variable theory, derived Bell's inequalities showing that quantum mechanics requires some kind of non-locality—proving that local hidden-variable theories are impossible, not that hidden-variable theories in general are impossible; the Nobel Committee got this exactly backwards in its press release, even though Bell was actually a strong booster of hidden-variable theories like Bohmian mechanics.
“They wrote in their press release that John Bell had proven that hidden variable theories were impossible, which is exactly the opposite of the truth. What he proved was that non-local was the only way to be a hidden variable theory.”
- Foundations of physics shares the same goal as physics—understanding reality—but is distinguished by patience: the willingness to keep asking 'why exactly is that true?' and to open the conceptual boxes that working physicists set aside, rather than philosophy of physics which describes the process by which physics gets done.
“Foundations of physics is trying to understand the universe... just like physics is. But it's doing it in a way, it's a style within our attempts to understand nature better.”
- Both breadth (having opinions across topics, the pundit/essayist mode) and depth (having really thought through the nuances of one thing) are valuable, but for serious work—like choosing podcast guests—depth is what matters most, and someone claimed to be 'smart about everything' is a turn-off and warning sign rather than an asset.
“Breadth is good, but so is depth; you need a little bit of both... But mostly... I'm looking for the depth when I'm here on the podcast. I'm looking for people who have really thought through the nuances of something.”
- Physicists are very happy to get the right answer for the wrong reasons—they focus so intensely on predicting what nature does that they tolerate not having real clarity on why, exemplified by quantum mechanics where nearly a century after the Solvay Conference there is still no consensus on its ontology yet physicists use it without trouble and are remarkably content with not understanding.
“they are very happy to get the right answer for the wrong reasons. They are very, very focused on getting the right answer”
- Einstein, who cared deeply about quantum foundations and read German, recognized that von Neumann's celebrated proof against hidden variables relied on assumptions that might not be true and thus proved nothing about the real world, and conveying this to David Bohm prompted Bohm to construct a working hidden-variable theory (Bohmian/de Broglie-Bohm mechanics) that is explicitly non-local.
“Einstein says, "Look, you say that this thing is proven here, but..." He opens von Neumann's book in German, he says like, "He's making all these assumptions that might not be true. This doesn't prove anything all about the real world."”
Disruption works only in immature systems; established interconnected systems require caution because components have non-obvious essential functions.
- Sometimes 'moving fast and breaking things' is correct because in a rugged fitness landscape you can be stuck on a local maximum where every incremental change makes things worse, yet a higher peak exists across a valley—so reaching it requires going through a worse-off situation, which sometimes only a disaster (like the Cambrian explosion opening niches) enables.
“You are at a peak, a local maximum in the fitness landscape. Everywhere you change by a little bit things would get worse. But somewhere over there, past the valley, there's an even higher peak”
- There's a crucial difference between disrupting a startup (early evolutionary history) and modifying an established, interconnected system like Twitter or legacy code—because in established complex systems components have non-obvious essential functions, so deleting what looks useless can cause unforeseen failures, just as mutation rates were higher early in life's history and beneficial mutations are rare for established organisms.
“any computer programmer knows when you're trying to improve some legacy code... you don't know what's gonna happen when you delete some module... You can't see that it has any use, but somehow it's really, really important in a way that you don't know”
- Elon Musk is in some sense very sincere about caring for humanity and the Earth—he genuinely changed the world with SpaceX and Tesla—but he is not good at helping actual people along the way, has a very bad track record with employees, and has been ineffective at his sincere goals in the current late phase of his career.
“I think that Elon Musk is in some sense very sincere about his care for humanity and the Earth... But I don't think that he's sort of an evil genius... He's just not been very good at it in his late phase”
Terms like 'free speech' degenerate into tribal slogans; seek simplicity without premature certainty to avoid conspiracy thinking and closed-mindedness.
- The phrase 'free speech' is degenerating from a crucially important political-philosophical concept that requires careful balancing of competing values into a tribal slogan and identifier, much like 'woke' or 'politically correct', which makes careful conversation harder because people load political connotations onto the terms.
“the phrase "free speech" is sort of degenerating from a crucially important political, philosophical concept into a slogan. It becomes a tribal identifier”
- Trying something new and crazy is more likely to be the next big thing in startups, but when we judge who did well there's a huge selection effect—a thousand people try crazy things, most fail, and we only see the one success and call it genius—exactly analogous to beneficial mutations being exceedingly rare in evolution.
“there's a thousand people trying something new and crazy. Most new and crazy things fail and we look at the one that succeeds and go aha, genius”
- Striving for too much clarity and simplicity in one's model of the world is seductive because it makes you feel you have answers for everything, but this opens you to vulnerability—becoming a conspiracy theorist and disdaining self-questioning—so the right approach is a happy medium that seeks simplicity without prematurely believing you have achieved it.
“there is a downside, there's a dark side to clarity in your view of the world. Trying to get things to be too clear and too simple is seductive, because it makes you think you have answers for everything”