stochastic parrots
A term (from Emily Bender and colleagues) for the view that language models merely parrot surface statistics of language without genuine understanding.
As defined in ms_230
Other definitions
A term from Bender's influential paper describing LLMs as systems that statistically generate word sequences (stochastic = probabilistic, parrots = mimicking without understanding) rather than think or reason.
Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should doA framework for understanding language models as systems that produce statistically likely text sequences based on patterns in training data, without understanding, reasoning, or intentionality; a term from Bender and Hannah's influential 2021 paper.
Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
Where it comes up · 3
- Neri Oxman2 claims
- Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do2 claims
- Sholto Douglas & Trenton Bricken — How LLMs actually think1 claim
Most important claims · 5 of 5Search all claims for “stochastic parrots” →
- Training LLMs on code makes them better at reasoning and language because modeling code implies modeling the difficult reasoning process used to create it, and code is an explicit structure of composed 'if-this-then-that' reasoning that transfers to other reasoning problems—strong evidence that scaling produces genuine deep reasoning rather than surface stochastic parroting.Sholto Douglas & Trenton Bricken — How LLMs actually think
- If AGI becomes indistinguishable from a specific human, that may mark the end of human agency, but the end of human agency to humans could be the beginning of agency to nature — by uploading language models that summarize all human consciousness to nature, a short-lived human (through Yudkowsky's lens) could become a long-lived, sentient, human-like weeping willow.Neri Oxman
- AGI is not merely a 'stochastic parrot' regurgitating; it is a self-recursive system that uses language to create language, presenting a new form of emergence of novelty that exists by virtue of using old things to create new things, even though it has not yet approached consciousness or sentience despite appearing to.Neri Oxman
- Anthropomorphizing LLMs has the function of reducing what it means to be human; when Sam Altman said 'I'm a stochastic parrot and so are you,' he was reducing human capacity to mechanical word prediction, echoing the framing of the 'stochastic parrots' paper.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- Sam Altman's rhetorical move of saying 'I'm a stochastic parrot and so are you' (riffing on Bender's 'stochastic parrots' paper) represents a reduction of humans to mechanical word prediction machines, erasing what it means to be human.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do