Predictive AI used in criminal justice (bail/pretrial release decisions) has accuracy (AUC) below 70%, which is only marginally better than random guessing at 50%, yet is used to make consequential decisions about freedom despite this poor predictive power.

factualpending

Speaker

Arvin Narayan

Evidence Quote

“the best numbers that you can get here are less than 70%. And 50% is random guessing [12:30]”

Source

AI Snake Oil: What Artificial Intelligence Can Do, What It Can’t, and How to Tell the Difference— MIT Stone Center on Inequality & Shaping Work
Created: 8/11/2026, 5:35:40 AM

Your notes

Loading notes...