definition
Hand-engineer capabilities then bake into model
Meta's development pattern is to hand-engineer application-specific behaviors (like tool use with Google/Bing) around the base model first—which is brittle and non-general—then progressively bake those capabilities into the model itself to make them general, using each hacked prototype to hone intuition for what to train into the next version.
definitionpending
Speaker
Mark ZuckerbergEvidence Quote
“Our goal for Llama-4 will be to bring more of that into the model.”
Source
Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:27:56 AM
Your notes
Loading notes...