Best practice for scoring output from LLMs is to provide detailed rubrics explaining how to differentiate between adjacent scores (e.g., 80 vs 90), though these rubrics are never perfect and always have exceptions.

normativepending

Speaker

Harj (Unknown Last Name - YC team)

Evidence Quote

“it's certainly best practice to give um LLM's rubrics, especially if you want to get a numerical score as the output. You want to give it a rubric to help it understand like how should I think through and what's like a 80 versus a 90. But these rubrics are never perfect.”

Source

State-Of-The-Art Prompting For AI Agents— Y Combinator
Created: 8/11/2026, 7:07:30 AM

Your notes

Loading notes...