← Jargon

Jargonmachine learning evaluation· 3 claims· 1 episode

scorer

The automated grading component of an evaluation that checks whether an agent obtained the flag in the intended way, possibly by reviewing the transcript.

As defined in Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face


Where it comes up · 1

Most important claims · 3 of 3Search all claims for “scorer” →