Grok Moe, at 6.6 billion parameters, scores 74.4% on the HumanEval benchmark, compared to 65% for a 175 billion parameter model in September 2022, representing roughly 2.7x parameter efficiency.
factualpending
Speaker
Wes RothEvidence Quote
“on this human ofal grin Moe is at 74.4 so again in let's say September 2022 the best model for this particular Benchmark right clocked in at 65 and it was 175 billion parameters big this new one is at 74 at less than 7 billion parameters”
Created: 8/10/2026, 10:52:56 PM
Your notes
Loading notes...