factual

Publication Bias Hides ARC Failures

The big labs tried their hand at ARC but, because they got bad results, did not publish anything—people only publish positive results—creating publication bias that obscures how poorly current techniques perform on the benchmark.

factualpending

Speaker

François Chollet

Evidence Quote

“The big labs also tried their hand on ARC, but because they got bad results they didn't publish anything. People only publish positive results.”

Source

Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:26:16 AM

Your notes

Loading notes...