causal

Non-deterministic software makes evals the core PM job

Unlike deterministic software where input X always yields Y, AI products can produce different outputs for slight variations of the same input, so someone must evaluate outputs across use cases, and PMs and researchers must own evaluation, often by writing AI to evaluate AI.

causalpending

Speaker

Gokul

Evidence Quote

“Many times you've got to write AI yourself to evaluate the results of AI, because humans can't.”

Source

Gokul Rajaram - Lessons from Investing in 700 Companies - [Invest Like the Best, EP.456]— Invest Like the Best
Created: 11/17/2026, 10:42:51 AM

Your notes

Loading notes...