LLM (Large Language Model)
Advanced neural networks trained on massive amounts of text data to understand and generate human language. Examples include ChatGPT, Claude, and Llama.
As defined in ANLnrnwGXm0
Other definitions
An AI model trained on vast amounts of text data to predict and generate human language. Examples include GPT and other systems that can perform a wide range of language tasks with minimal additional training.
Tom Friedman: AI, China, Globalization and America’s Next Era | Coffee with Ken
Where it comes up · 46
- Why Everyone Is Wrong About AI (Including You) | Benedict Evans18 claims
- Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do17 claims
- Facing Superintelligence (with Ben Goertzel)13 claims
- Vertical AI Agents Could Be 10X Bigger Than SaaS10 claims
- Yann LeCun: Special Lecture on AI and World Models10 claims
- Why Vertical LLM Agents Are The New $1 Billion SaaS Opportunities8 claims
- Peter Thiel on Political Theology | Conversations with Tyler8 claims
- The $1 Trillion Supercycle Hidden in Plain Sight | Joseph Shaposhnik8 claims
and 38 more
Most important claims · 10 of 200Search all claims for “LLM (Large Language Model)” →
- So far, LLMs had been trained using web data which gave them solid understanding of language semantics, syntax, and generation of fluent sentences, but GPT-3's objective was to predict likely sentences with no notion of correctness or factual bias, whereas the human goal in using an LLM is to generate coherent, informative, trustworthy, and reliable outputs.10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT
- The core function of a large language model is to predict the probability of the next token given a sequence of prior tokens, and it performs this prediction iteratively (one token at a time) to generate complete sentences, paragraphs, and answers.Designing LLM Systems PART 1 Foundations Chapter 1 AI Systems Architecture The Real Currency of AI
- LLMs trained with human alignment via techniques like RLHF represent a paradigm shift, with one of the main reasons being their zero-shot and few-shot capabilities, where the baseline of a good LLM is no longer how easy it is to fine-tune on downstream tasks but how good it is at responding to prompts.10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT
- Search has historically been a hack to get people information, and the real aspiration was always an answer engine that could synthesize multiple sources into a coherent response, but the technology didn't exist until LLMs with strong language understanding capabilities made this feasible.Perplexity CEO: Disrupting Google Search with AI
- A 4-year-old child is trained on approximately 16,000 waking hours of sensory data (vision, touch, hearing), which through the optic nerve (2 million fibers, each carrying ~1 byte/second) results in about 10^14 bytes of raw data—the same volume as the largest LLMs trained on all publicly available text on the internet.Yann LeCun: Special Lecture on AI and World Models
- The scale of compute and data has been the main factor enabling the LLM revolution, and this same underlying factor—not the specific algorithm—will be the primary driver enabling AGI to emergeFacing Superintelligence (with Ben Goertzel)
- Reinforcement Learning from Human Feedback (RLHF) is a technique that fine-tunes an LLM's weights using a reward model to maximize the human-generated reward signal while retaining the semantic language understanding of the original model, and while RLHF has many use cases in reinforcement learning (especially in robotics), in the context of LLMs it fine-tunes the model to generate text that maximizes human reward.10 years of NLP history explained in 50 concepts | From Word2Vec, RNNs to GPT
- MySpace demonstrates that early network effect dominance can be fragile and that late entrants can displace leaders if they offer a superior product/experience—MySpace was easy to exit to Facebook, suggesting that even if LLMs develop network effects, subsequent innovations (new modalities like AR/glasses) could displace current leaders.Why Everyone Is Wrong About AI (Including You) | Benedict Evans
- During the pre-ChatGPT, pre-LLM era, CaseText built incremental improvements on legal research workflows that were relatively easy for customers to ignore because lawyers billing by the hour were not motivated to change processes that worked, and did not perceive existential risk from the technologyWhy Vertical LLM Agents Are The New $1 Billion SaaS Opportunities
- Large Language Models like ChatGPT, Gemini, and Claude are built on absolutely enormous, poorly curated and undisclosed training sets, which means we don't really know what's in them and we don't have the ability to reason about the kinds of biases that we would want to mitigate for particular use cases.Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do