causal

Llama Imploded From Benchmark-Chasing and Politics

Llama declined because Meta executives, excited by its community popularity, tried to use open source for a bigger splash—building giant Llama 4 models overfit to benchmarks (via preference-trained variants) rather than the small, trustworthy, modifiable models people actually wanted—and it imploded under internal political fighting and misaligned incentives between researchers and management.

causalpending

Speaker

Sebastian Raschka

Evidence Quote

“these models were... the benchmarks suggest that they were better than they were because I think they had specific models trained on preferences so that they performed well on the benchmarks.”

Source

Ai Sota #2026— Lex Fridman Podcast
Created: 6/13/2026, 3:24:41 AM

Your notes

Loading notes...