Predictive AI used in criminal justice (bail/pretrial release decisions) has accuracy (AUC) below 70%, which is only marginally better than random guessing at 50%, yet is used to make consequential decisions about freedom despite this poor predictive power.
factualpending
Speaker
Arvin NarayanEvidence Quote
“the best numbers that you can get here are less than 70%. And 50% is random guessing [12:30]”
Source
AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the Difference— MIT Stone Center on Inequality & Shaping WorkCreated: 8/11/2026, 5:35:40 AM
Your notes
Loading notes...