For YC vertical AI and SaaS companies, evals can only be obtained by sitting literally side-by-side with people doing the actual knowledge work (like a regional tractor sales manager), understanding their reward function and what outcomes they care about, then codifying those specific outcomes into evals.

causalpending

Speaker

Gary Tan

Evidence Quote

“you can't get the eval unless you sitting literally side by side with people who are doing X Y or Z knowledge work...need to sit next to the tractor sales regional manager”

Source

State-Of-The-Art Prompting For AI Agents— Y Combinator
Created: 8/11/2026, 7:07:30 AM

Your notes

Loading notes...