forecast

Conjecture Generation Resists Benchmarks, Shown Through Tone Shift

Conjecture-generating ability cannot be cleanly benchmarked the way a solved problem can, so it will show up as a subjective tone shift in how mathematicians describe AI being useful for choosing research directions.

forecastpending

Speaker

Grant Sanderson

Evidence Quote

“I would be surprised if it ever took the form of looking like a benchmark, where we have a score saying it’s passed because we can quantify how good a conjecture is.”

Source

Dwarkesh Patel Podcast - Grant Sanderson – AI and the future of math— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:54 AM

Your notes

Loading notes...