factual
Non-cooperation measurement needed for different-objective agents
If training fully cooperative agents leads to increased collaboration when agents are supposed to have different objectives, that would be a problem, and OpenAI has metrics for this that have not raised red flags, which Brown takes as evidence it is not yet a serious problem.
factualpending
Speaker
Noam BrownEvidence Quote
“I think we do have metrics for this. I don’t know what the latest is on those metrics, but nobody’s raised a red flag to me about those.”
Source
Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:12:01 AM
Your notes
Loading notes...