factual

Verifiers Judge Essays Poorly on Insight

LLM verifiers can discriminate a B essay from an A essay but fail to tell an A essay from one that is actually insightful and readable, and they tend to prefer uninsightful writing, so reward hacking derails writing progress.

factualpending

Speaker

Grant Sanderson

Evidence Quote

“Maybe the ultimate failure there is that even if they’re good at discriminating between a B essay and an A essay, they’re not actually good at discriminating between an A essay and a thing you actually want to read”

Source

Dwarkesh Patel Podcast - Grant Sanderson – AI and the future of math— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:54 AM

Your notes

Loading notes...