causal

Two Distinct Misinformation Problems: Hallucination And Abuse

There are two separable misinformation problems with these systems: first, they hallucinate—even given clean data they don't track relations between entities and properties, so they make stuff up (e.g., Galactica saying Elon Musk died in a 2018 car crash); second, bad actors can induce them to mass-produce variants of any specific misinformation, such as 100 fake QAnon or anti-vaccine articles each citing fabricated studies in Lancet and JAMA—the first threatens individuals via bad medical advice, the second threatens democracy by destroying common ground.

causalpending

Speaker

Gary Marcus

Evidence Quote

“on the second one i think what's going to get hurt is democracy because the result is going to be there's so much misinformation nobody's going to trust anything and if people don't trust that there's some common ground i don't think democracy works”

Source

312 - The Trouble With Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:16:45 AM

Your notes

Loading notes...