definition
Constitutional AI uses self-play against a written constitution
Constitutional AI samples two model responses, has the AI itself judge which better follows a human-readable document of principles (a constitution), and feeds that judgment into a preference model — a triangle of AI, preference model, and AI improvement — reducing the need for human RLHF while keeping principles human-interpretable.
definitionpending
Speaker
Dario AmodeiEvidence Quote
“You have this triangle of the AI, the preference model, and the improvement of the AI itself.”
Created: 6/13/2026, 3:36:36 AM
Your notes
Loading notes...