machine-gradable
A question format whose answers can be automatically scored by software (e.g., multiple choice or numeric entry) without human judgment.
As defined in John Cochrane on Education and MOOCs
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “machine-gradable” →
- The most valuable learning—open-ended puzzles, proving a theorem, defending an answer to skeptical peers—cannot be put into machine-gradable form, and converting such questions to multiple choice destroys the learning by letting students guess from the framing rather than reason, which is the core limitation of current MOOC assessment.John Cochrane on Education and MOOCs
- A pragmatic way to grade an open-ended answer at scale is keyword detection—Cochrane gives credit if the word 'beta' appears in the answer to a finance puzzle, and Russ similarly looks for a single key word in answers to his lightbulb-longevity puzzle—revealing both a workable mechanical proxy and the crudeness of current assessment.John Cochrane on Education and MOOCs