causal
Four distinct ways hallucinations seep in
Hallucinations in a RAG product arise in distinct ways: (1) the model isn't smart enough to semantically understand the query and paragraphs and pick the relevant info; (2) the index is poor, with stale or insufficiently detailed snippets, or conflicting sources confusing the model; (3) too much detail is thrown at the model so irrelevant content confuses it; and (4) completely irrelevant documents are retrieved, in which case a skillful model should just say it lacks information.
causalpending
Speaker
Aravind SrinivasEvidence Quote
“there are multiple dimensions where you can improve a product like this to reduce hallucinations, where you can improve the retrieval, you can improve the quality of the index, the freshness of the pages”
Created: 6/13/2026, 3:26:05 AM
Your notes
Loading notes...