retriever
The component of a RAG system responsible for finding and retrieving relevant documents from a knowledge base in response to a query. The original RAG paper used a retriever-generator architecture.
As defined in When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer
Where it comes up · 2
- Designing LLM Systems PART 1 Foundations Chapter 1 AI Systems Architecture The Real Currency of AI2 claims
- When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer1 claim
Most important claims · 3 of 3Search all claims for “retriever” →
- The core function of a large language model is to predict the probability of the next token given a sequence of prior tokens, and it performs this prediction iteratively (one token at a time) to generate complete sentences, paragraphs, and answers.Designing LLM Systems PART 1 Foundations Chapter 1 AI Systems Architecture The Real Currency of AI
- The retriever component searches a database for tokens mathematically similar to those in the user's query (by converting them to vectors) in order to inject relevant factual information into the token budget.Designing LLM Systems PART 1 Foundations Chapter 1 AI Systems Architecture The Real Currency of AI
- The original RAG paper did not discuss using prompt context and questions—this became the de facto approach later—but instead proposed a two-component architecture with a retriever and generator using pre-trained sequence-to-sequence models.When Vectors Break Down: Graph-Based RAG for Dense Enterprise Knowledge - Sam Julien, Writer