factual
Publication Bias Hides ARC Failures
The big labs tried their hand at ARC but, because they got bad results, did not publish anything—people only publish positive results—creating publication bias that obscures how poorly current techniques perform on the benchmark.
factualpending
Speaker
François CholletEvidence Quote
“The big labs also tried their hand on ARC, but because they got bad results they didn't publish anything. People only publish positive results.”
Source
Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:16 AM
Your notes
Loading notes...