Auto-research only works for problems with objective metrics that are easy to evaluate; it fails for subjective optimization goals where you can't automatically verify if a solution is good.
factualpending
Speaker
Andre KarpathyEvidence Quote
“if you can't evaluate then you can't auto research it, right?”
Source
Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI— No Priors: AI, Machine Learning, Tech, & StartupsCreated: 8/12/2026, 6:22:17 PM
Your notes
Loading notes...