When a language model generates the sentence 'the UN found that the resulting contaminated water caused many residents to fall ill, highlighting the need for improved water management,' a baseline system may miss the ambiguity about whether the author is stating a verifiable fact (that the UN found the need for improved water management) or adding their own interpretation.

factualpending

Speaker

Dasha Metropolitansky

Evidence Quote

“The baseline prompt ignored the phrase highlighting the need for improved water management. It only extracted claims from the first part of the sentence. However, Claify reasoned, quote, the sentence could be interpreted as the UN found that the contaminated water caused illness and also highlighted the need for improved water management. Or it could be interpreted as the UN only found the contamination and illness and the author is adding the interpretation about the need for improved water management.”

Source

Claimify: Extracting high-quality claims from language model outputs— Microsoft Research
Created: 8/11/2026, 5:26:56 AM

Your notes

Loading notes...