Grok Moe, at 6.6 billion parameters, scores 74.4% on the HumanEval benchmark, compared to 65% for a 175 billion parameter model in September 2022, representing roughly 2.7x parameter efficiency.

factualpending

Speaker

Wes Roth

Evidence Quote

“on this human ofal grin Moe is at 74.4 so again in let's say September 2022 the best model for this particular Benchmark right clocked in at 65 and it was 175 billion parameters big this new one is at 74 at less than 7 billion parameters”

Source

Microsoft Goes FULL NUCLEAR to Develop AGI...— Wes Roth
Created: 8/10/2026, 10:52:56 PM

Your notes

Loading notes...