hallucination
When an AI language model generates confident but false or fabricated information.
As defined in cwt_austan-goolsbee
Other definitions
In AI, when a system produces false or fabricated output presented as fact.
Google's Gopi Kallayil on the AI Revolution
Where it comes up · 58
- Robot Plumbers, Robot Armies, and Our Imminent A.I. Future | Interesting Times with Ross Douthat6 claims
- AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the Difference5 claims
- Des Traynor - Real Talk about AI and Software - [Invest Like the Best, EP.340]5 claims
- When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer5 claims
- Aravind Srinivas4 claims
- The future of intelligence | Demis Hassabis (Co-founder and CEO of DeepMind)4 claims
- How ChatGPT changed everything: Thoughts from the frontline of the AI/ML revolution4 claims
- The Shape of AI to Come! Yann LeCun at AI Action Summit 20254 claims
and 50 more
Most important claims · 10 of 111Search all claims for “hallucination” →
- Hallucinations in large language models are not evidence of lack of understanding—humans hallucinate constantly through constructive memory recall: human memory does not retrieve stored facts but reconstructs plausible narratives, making details often false while preserving overall validity, as demonstrated by John Dean's Watergate testimony which had false details but accurately conveyed the White House situation.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Autoregressive token prediction in LLMs produces exponential divergence errors because each generated token carries independent error probability, and if any token falls outside the set of reasonable answers, there is no way to recover afterward, leading to hallucinationsThe Shape of AI to Come! Yann LeCun at AI Action Summit 2025
- Current LLMs operate by autoregressive token prediction where a causal transformer repeatedly takes a window of previous tokens and predicts the next token, and this creates a fundamental problem: each token prediction has some probability of being wrong, and if one is, there is no way to fix it afterwards, leading to exponential divergence and hallucination issues.The Shape of AI to Come! Yann LeCun at AI Action Summit 2025
- Information memorized in model parameters is memory-efficient (roughly one fact per parameter) but squishy, leading to hallucination and confused facts because trillions of tokens are churned together; information in the context window is sharp and clear thanks to the attention mechanism, but each token costs far more memory (kilobytes to a megabyte of keys and values per token across layers), creating a fundamental trade-off.Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI
- Hallucinations in a RAG product arise in distinct ways: (1) the model isn't smart enough to semantically understand the query and paragraphs and pick the relevant info; (2) the index is poor, with stale or insufficiently detailed snippets, or conflicting sources confusing the model; (3) too much detail is thrown at the model so irrelevant content confuses it; and (4) completely irrelevant documents are retrieved, in which case a skillful model should just say it lacks information.Aravind Srinivas
- AI should be embraced as a partner in the educational conversation rather than a place to outsource thinking; Roth adapts by moving exams in-class to prevent cheating while having students converse with an AI about practiced virtues—because the whole point of being a student is learning to think for yourself in the company of others, and outsourcing that forfeits the pleasure and freedom of independent thought.431 - What Is Happening On College Campuses
- Perplexity is built on the academic principle that every sentence written should be backed by a citation; by forcing a chatbot to only say things it can find from multiple sources on the internet, you constrain it to say things that are accurate and reduce hallucination.Aravind Srinivas
- Hallucinations are a fundamental problem with generative AI that will not reach zero in a short period of time; generative AI is stochastic technology that remixes statistical patterns from training data at generation time, so even if training data were perfectly cleaned, hallucinations would persist.AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the Difference
- Models that are better calibrated about whether their answers are correct, and that can tell when they have a good answer, would become much more useful, because hallucination management is the blocker for many enterprise use cases.Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383]
- Current LLMs cannot distinguish between their own knowledge and hallucinations because they lack mental models of the domain; when a problem statement is altered, they produce the same answer despite the change, indicating they are regurgitating memorized patterns rather than reasoning about the problem structure.The Shape of AI to Come! Yann LeCun at AI Action Summit 2025