causal

AI-run firms may have higher tail risk

Even if AI-run companies look better most of the time, they might have higher tail risk because AIs remain less sample-efficient in wacky situations and are more likely to malfunction in a big way; such practical considerations—plus liability and accountability rules—may push toward keeping humans in the loop for the near future regardless of average performance.

causalpending

Speaker

John Schulman (OpenAI Cofounder)

Evidence Quote

“AI-run firms might actually have higher tail risk because they're more likely to malfunction in a big way.”

Source

John Schulman (OpenAI Cofounder) — Reasoning, RLHF, & plan for 2027 AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:30 AM

Your notes

Loading notes...