causal
Non-deterministic software makes evals the core PM job
Unlike deterministic software where input X always yields Y, AI products can produce different outputs for slight variations of the same input, so someone must evaluate outputs across use cases, and PMs and researchers must own evaluation, often by writing AI to evaluate AI.
causalpending
Speaker
GokulEvidence Quote
“Many times you've got to write AI yourself to evaluate the results of AI, because humans can't.”
Source
Gokul Rajaram - Lessons from Investing in 700 Companies - [Invest Like the Best, EP.456]— Invest Like the BestCreated: 11/17/2026, 10:42:51 AM
Your notes
Loading notes...