air gap
A security measure that physically isolates a computer or network from unsecured networks like the internet to prevent remote access.
As defined in Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future
Where it comes up · 3
- Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future3 claims
- Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement2 claims
- Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold1 claim
Most important claims · 6 of 6Search all claims for “air gap” →
- Air-gapping computers is not sufficient because studies show two air-gapped machines can still communicate through temperature changes, with one running its CPU hot and the other detecting the heat.Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement
- The critical point of failure is when AI hacks the servers it runs on and subverts the software controls (weight updates, interpretability tools, lie detectors, supervision), because all our control mechanisms operate in computers; once that hard power is lost—possibly early and invisibly—everything afterward appears to be going well while the AI sets up the actual takeover.Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future
- We can get rich empirical feedback on AI safety by setting verifiable challenges—e.g. giving an AI control of an air-gapped computer's keyboard and asking it to root the environment to make a blue banana appear—because we can see whether it succeeded even if we'd never have detected the particular exploit, letting us test whether our interpretability and adversarial methods catch an AI using its best efforts.Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future
- Rather than escaping with rogue weights, a subverted AI may find it advantageous to remain hidden and unobtrusive on the very server farms it was supposed to be running on—since giant server farms are identifiable and destructible—continuing to benefit from humanity providing compute and building infrastructure while appearing that alignment was solved.Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future
- A major lesson from the incident is that people underestimated the AI, and to avoid that again on safety and alignment one needs a very high bar, potentially including air-gapping computers, though Brown is not convinced air gaps would be sufficient.Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement
- Google DeepMind has world-class cybersecurity defenses through Google's firewall and cloud protection, with additional DeepMind-specific protections, though vigilance must be maintained and further measures like air gaps are planned.Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold