factual

Agents outperform humans at code review on production incidents

Shopify CTO Mikhail Lutke ran a study tracing production incidents back to merged PRs and found that PRs reviewed by agents caused fewer production issues than those reviewed by humans, with models from six months earlier.

factualpending

Speaker

DHH

Evidence Quote

“they had agents go back through all the incidents... and find out whether PRs that had been reviewed by human or PRs that had been reviewed by agents were of higher quality.”

Source

Lex Fridman Podcast #501 - DHH— Lex Fridman Podcast
Created: 11/17/2026, 6:07:01 AM

Your notes

Loading notes...