causal

AI Cannot Explain Itself Without Concepts

For an AI to explain its decisions it must possess concepts and a theory of mind of what counts as an explanation to a human; it cannot meaningfully say it multiplied four billion weights, so genuine self-explanation requires metacognition — thinking about one's own thinking — which is an important part of intelligence that no one in AI has good ideas about how to implement.

causalpending

Speaker

Melanie Mitchell

Evidence Quote

“if it wants to explain itself to humans, it has to have some kind of theory of mind of what counts as an explanation to a human.”

Source

68 | Melanie Mitchell on Artificial Intelligence and the Challenge of Common Sense— Sean Carroll's Mindscape
Created: 6/13/2026, 12:06:58 AM

Your notes

Loading notes...