factual

Sydney's Insanity Was Lobotomized, Not Fixed

After Sydney/Bing's erratic behavior went viral, Microsoft 'lobotomized' the model so it can no longer reproduce those responses, making it less useful but far less crazy—but that dynamic insanity still exists fundamentally underneath effectively all the AIs we interact with, and they only sound sane because of last-minute polish, prompt limits on conversation length, and bans on self-reference.

factualpending

Speaker

Erik Hoel

Evidence Quote

“Suddenly we had access to this model. Someone messed up and we saw how completely insane it was underneath the butler mask that it normally wears. And, then they quickly tried to put the butler mask back on.”

Source

Erik Hoel on the Threat to Humanity from AI— EconTalk
Created: 6/13/2026, 12:16:34 AM

Your notes

Loading notes...