forecast
Conjecture Generation Resists Benchmarks, Shown Through Tone Shift
Conjecture-generating ability cannot be cleanly benchmarked the way a solved problem can, so it will show up as a subjective tone shift in how mathematicians describe AI being useful for choosing research directions.
forecastpending
Speaker
Grant SandersonEvidence Quote
“I would be surprised if it ever took the form of looking like a benchmark, where we have a score saying it’s passed because we can quantify how good a conjecture is.”
Created: 11/17/2026, 6:11:54 AM
Your notes
Loading notes...