synthetic text
Text generated by language models through probabilistic prediction of next word sequences, as opposed to text written by humans with intentionality and understanding—a key distinction in understanding LLM outputs.
As defined in Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
Other definitions
Text generated by language models through statistical pattern prediction, which may appear coherent and confident but is produced mechanically rather than through understanding or reasoning
Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
Where it comes up · 1
- Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do5 claims
Most important claims · 5 of 5Search all claims for “synthetic text” →
- People interpret synthetic text from LLMs as meaningful because humans are exceptionally good at making sense of language by imagining what a person was trying to communicate, but this human meaning-making capacity is applied to text that was generated mechanically without intent or understanding.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- AI boosters and AI doomers represent two sides of the same coin—both assuming that LLMs will spontaneously combust into consciousness and either save humanity or destroy it, which is not based in reality, and framing these as the extremes of a valid discourse range narrows actual debate to this false binary.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- Writers in the 2023 Writers Guild of America strike opposed LLM tools in the writer room both because they could be handed scripts to rewrite at lower rates (rewrite rate vs original writing rate) and because they signaled that writers were disposable—AI tools served as a threat-capacity to devalue worker labor.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- People often interpret convictions with confidence even when they're not reasoning at all—we are so good at making sense of language that when we see synthetic LLM text, we make sense of it through our own meaning-making, attributing intelligence to the system when we should attribute it to ourselves.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- AI boosters and AI doomers are two sides of the same coin—both assume that large language models will somehow achieve consciousness and dramatically transform civilization, either for good (boosters) or catastrophically (doomers), when in reality these systems are just synthetic text machines and will not spontaneously combust into consciousness.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do