definition

Hand-engineer capabilities then bake into model

Meta's development pattern is to hand-engineer application-specific behaviors (like tool use with Google/Bing) around the base model first—which is brittle and non-general—then progressively bake those capabilities into the model itself to make them general, using each hacked prototype to hone intuition for what to train into the next version.

definitionpending

Speaker

Mark Zuckerberg

Evidence Quote

“Our goal for Llama-4 will be to bring more of that into the model.”

Source

Mark Zuckerberg — Llama 3, $10B models, Caesar Augustus, & 1 GW datacenters— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:27:56 AM

Your notes

Loading notes...