ChatGPT cannot reliably determine what it knows versus doesn't know; when asked about mayors born after 1998 (making them younger than 23 at ChatGPT's 2021 knowledge cutoff), it correctly noted this was implausible, but when asked in different ways or via BingChat, it claimed no knowledge of such mayors despite them existing in Wikidata.
factualpending
Speaker
Knowledge graph expertEvidence Quote
“GPT isn't particularly good with knowing what it knows... ChatGPT correctly points out that that would make them younger than 23 at its cutoff date of 2021... Wikidata has an answer. It tells me about Kristan von Waldenfels who was born in April 2000, Mayor of Lichtenberg in Bavaria, Germany.”
Created: 8/12/2026, 6:34:12 PM
Your notes
Loading notes...