causal
LLMs find the needle traditional search can't
LLMs improve retrieval because, unlike traditional search that demands both high precision and recall (where users get annoyed if the right link isn't in the top three or four), an LLM can find the needle in the haystack even if the right document is ranked ninth or tenth — letting you trade off resources between improving the model versus improving retrieval.
causalpending
Speaker
Aravind SrinivasEvidence Quote
“that flexibility allows you to rethink where to put your resources in terms of whether you want to keep making the model better or whether you want to make the retrieval stage better. It’s a trade-off.”
Created: 6/13/2026, 3:26:05 AM
Your notes
Loading notes...