factual

Data wall limits scaling on public internet text

Frontier models such as GPT-4 and Claude 3.5 were trained on nearly all public internet data, creating a data wall where further progress requires new data sources.

factualpending

Speaker

Vlad Tenev

Evidence Quote

“we basically trained on nearly all the public data that's on the Internet with the latest generation of models being GPT-4 and Claude 3.5”

Source

Vlad Tenev - Navigating Robinhood's Evolution - [Invest Like the Best, EP.384]— Invest Like the Best
Created: 11/11/2026, 1:21:06 PM

Your notes

Loading notes...