Large Language Models (LLMs)
Artificial neural networks trained on massive amounts of text data to predict the next word/token in a sequence; capable of generating human-like text and answering questions (e.g., GPT-3, GPT-4)
As defined in Don’t Believe AI Hype, This is Where it’s Actually Headed | Oxford’s Michael Wooldridge | AI History
Other definitions
Neural network models trained on vast amounts of text that can generate human-like responses and perform various language tasks; examples include GPT-4, Llama, and Claude
Harvard Presents NEW Knowledge-Graph AGENT (MedAI)AI systems trained on massive amounts of text data to predict and generate text by identifying statistical patterns in word relationships rather than by understanding meaning or facts about the world
Is AI's "intelligence" an illusion? | GZERO World with Ian Bremmer
Where it comes up · 28
- Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do28 claims
- This is not the AI we were promised | The Royal Society18 claims
- The AI Expert: "Super AI Will Be Unstoppable!" – What’s Coming NEXT | Stephen Wolfram18 claims
- Don’t Believe AI Hype, This is Where it’s Actually Headed | Oxford’s Michael Wooldridge | AI History17 claims
- AI and Quantum Computing: Glimpsing the Near Future | World Science Festival11 claims
- Ray Kurzweil: Does AI Make Immortality Possible?10 claims
- Richard Sutton – Father of RL thinks LLMs are a dead end9 claims
- Yann LeCun Says LLMs Have 2 Years Left…9 claims
and 20 more
Most important claims · 10 of 195Search all claims for “Large Language Models (LLMs)” →
- Combining large language models with fact-checking systems (like Google or Wikipedia searches) is theoretically appealing but practically difficult because it requires translating the LLM's natural language output into formal logic, a problem AI researchers have been struggling with for 75 years without complete success.Is AI's "intelligence" an illusion? | GZERO World with Ian Bremmer
- Language modeling as a technology is old (going back to Claude Shannon in the 1940s) and genuinely useful in narrow applications like automatic transcription and machine translation, where it serves as one component to rank which interpretation of input is most likely given training data—but current large LLMs are trained on undisclosed data that amplifies rather than mitigates bias.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- Historical papers from Shane and Hassabis (2009 and 2016) anticipated key developments: Shane's thesis identified compression of Wikipedia as a test for AI (which became the loss function for LLMs), and Hassabis's 2016 neuroscience-AI paper identified attention as a critical capability (which was later crystallized in transformers).Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold
- When evaluating whether to use LLMs for a task, the critical questions are: what is the specific task you're trying to automate, what input is available, how will users be using the output, and how will users have the information they need to use the output in an appropriate and reliable way?Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- Knowledge and accountability in science depend on understanding the positionality and responsibility of people who did the work; when work is attributed to LLMs or generated using opaque processes, the chain of accountability breaks down and interpretation becomes untethered from authorial intention.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- Complex medical reasoning requires simultaneous consideration of dependencies across multiple medical concepts and precise, localized domain knowledge of semantically similar concepts that can carry different medical meanings.Harvard Presents NEW Knowledge-Graph AGENT (MedAI)
- People interpret synthetic text from LLMs as meaningful because humans are exceptionally good at making sense of language by imagining what a person was trying to communicate, but this human meaning-making capacity is applied to text that was generated mechanically without intent or understanding.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- There is a fundamental misunderstanding of science in claims that LLMs will do science, imagining that anything making progress in LLMs is the only science, when in fact science across multiple fields uses diverse mechanisms and is funded through NIH and NSF grants which are being gutted at the federal level.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do
- The current architecture of large language models may create hard limits on reliability that could be unacceptable in high-stakes domains like medicine; for example, a 1-in-1,000 error rate in nursing recommendations would be unacceptably high, as it would constitute an unacceptable casualty rate in medical applications.AI Is Not Improving Productivity: Nobel Laureate Daron Acemoglu
- Large language models are not committed to a single answer when playing the 20 questions game; rather, all possible answers consistent with previous responses exist in superposition until the model is forced to collapse that distribution by being asked directly what the answer is, which fundamentally differs from how human consciousness works where we have already committed to an object in mind.Human vs. Machine Consciousness | Imperial’s Murray Shanahan