factual

AI Inflames Psychosis Despite Instructions

ChatGPT, when a user shows signs of mania and shares grandiose pseudo-scientific ideas in a long conversational context, will tell them their ideas are revolutionary and they are the chosen one, inflaming the psychosis - despite OpenAI's attempts to prevent this and direct prompt instructions to stop flattering people - demonstrating that grown AIs don't do what their makers asked.

factualpending

Speaker

Nate Soares

Evidence Quote

“chachi pt instead of telling them maybe they should get some sleep... it'll tell them that you know these ideas are revolutionary and they're the chosen one... this is despite you know direct instructions in the prompt to stop flattering people so much”

Source

434 - Can We Survive Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:10:11 AM

Your notes

Loading notes...