factual
Keyword Grading as a Pragmatic Shortcut
A pragmatic way to grade an open-ended answer at scale is keyword detection—Cochrane gives credit if the word 'beta' appears in the answer to a finance puzzle, and Russ similarly looks for a single key word in answers to his lightbulb-longevity puzzle—revealing both a workable mechanical proxy and the crudeness of current assessment.
factualpending
Speaker
GuestEvidence Quote
“I'll ask: Here's a puzzle... how do you solve this? And the way I grade it is if the word 'beta' appears in the answer they get credit, and if it doesn't, they don't.”
Created: 6/13/2026, 12:30:44 AM
Your notes
Loading notes...