factual
Data wall limits scaling on public internet text
Frontier models such as GPT-4 and Claude 3.5 were trained on nearly all public internet data, creating a data wall where further progress requires new data sources.
factualpending
Speaker
Vlad TenevEvidence Quote
“we basically trained on nearly all the public data that's on the Internet with the latest generation of models being GPT-4 and Claude 3.5”
Source
Vlad Tenev - Navigating Robinhood's Evolution - [Invest Like the Best, EP.384]— Invest Like the BestCreated: 11/11/2026, 1:21:06 PM
Your notes
Loading notes...