definition

Constitutional AI uses self-play against a written constitution

Constitutional AI samples two model responses, has the AI itself judge which better follows a human-readable document of principles (a constitution), and feeds that judgment into a preference model — a triangle of AI, preference model, and AI improvement — reducing the need for human RLHF while keeping principles human-interpretable.

definitionpending

Speaker

Dario Amodei

Evidence Quote

“You have this triangle of the AI, the preference model, and the improvement of the AI itself.”

Source

Dario Amodei— Lex Fridman Podcast
Created: 6/13/2026, 3:36:36 AM

Your notes

Loading notes...