veracity
The trustworthiness or reliability of a fact, determined by assessing the credibility and verification status of its source(s)
As defined in Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI
Where it comes up · 1
Most important claims · 4 of 4Search all claims for “veracity” →
- Using graph metadata projection, Graffiti can model classifications that span many different episodes and facts derived from them (e.g., an 'EHR tag' inherited by all entities and facts derived from an EHR episode), allowing agents to filter facts by veracity source (e.g., retrieve only facts from verified clinical sources).Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI
- Graffiti customers have struggled with provenance: determining where a fact came from and what the veracity of that fact is.Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI
- For a fact with multiple parents (sources), veracity policies differ based on context: for a penicillin allergy in a prescription scenario, the agent should block the prescription if any parent source is unverified (because missing one unverified source could be lethal), but for a consent-on-file fact, every parent source must be verified (because the entire consent chain must be verified or the consent is invalid).Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI
- Provenance in Graffiti offers multiple benefits: compliance is built in (satisfying regulatory requirements), veracity assessment (determining if a fact is trustworthy based on its sources), debugging (understanding why and how facts were generated), and deletion (determining what can be safely removed).Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI