factual
Academic evals disconnected from economic value
The largest disconnect in AI research is that everyone focused on academic evals like GPQA for PhD-level reasoning or IMO for Olympiad math, which were wholly disconnected from the outcomes customers actually care about—automating a medical diagnosis, a legal draft, or a financial analysis—which is why APEX was built to measure economically valuable tasks.
factualpending
Speaker
Brendan FoodyEvidence Quote
“everyone was focused on academic evals, likeGPQAfor PhD-level reasoning orIMO for Olympiad math, which werewhollydisconnected from the outcomes that customers actually care about”
Created: 6/12/2026, 4:53:54 PM
Your notes
Loading notes...