factual

Academic evals disconnected from economic value

The largest disconnect in AI research is that everyone focused on academic evals like GPQA for PhD-level reasoning or IMO for Olympiad math, which were wholly disconnected from the outcomes customers actually care about—automating a medical diagnosis, a legal draft, or a financial analysis—which is why APEX was built to measure economically valuable tasks.

factualpending

Speaker

Brendan Foody

Evidence Quote

“everyone was focused on academic evals, likeGPQAfor PhD-level reasoning orIMO for Olympiad math, which werewhollydisconnected from the outcomes that customers actually care about”

Source

Brendan Foody— Conversations with Tyler
Created: 6/12/2026, 4:53:54 PM

Your notes

Loading notes...