causal
Llama Imploded From Benchmark-Chasing and Politics
Llama declined because Meta executives, excited by its community popularity, tried to use open source for a bigger splash—building giant Llama 4 models overfit to benchmarks (via preference-trained variants) rather than the small, trustworthy, modifiable models people actually wanted—and it imploded under internal political fighting and misaligned incentives between researchers and management.
causalpending
Speaker
Sebastian RaschkaEvidence Quote
“these models were... the benchmarks suggest that they were better than they were because I think they had specific models trained on preferences so that they performed well on the benchmarks.”
Created: 6/13/2026, 3:24:41 AM
Your notes
Loading notes...