causal

Causal explanations enable anomaly detection

A causal explanation (reasoning forward step by step from internal properties to behavior) is essential rather than sampling-based confirmation because it lets you flag when a new input is anomalous with respect to the explanation — if the explanation crucially depends on a property holding (e.g. 'it believes it's being trained') and a new input violates that property, you can detect that the behavior is now occurring for a different, potentially dangerous reason.

causalpending

Speaker

Paul Christiano

Evidence Quote

“when, like, a new input comes in and it doesn't satisfy that property, you can say, okay, this is anomalous with respect to that explanation. So either it will not have the behavior... or maybe it will have that behavior but for some different reason than normal.”

Source

Paul Christiano — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:36:05 AM

Your notes

Loading notes...