GPT-3.5 scored at the 10th percentile on the bar exam (barely passing, equivalent to random guessing by some test-takers), while early access GPT-4 scored at the 90th percentile on a new, non-training-set bar exam, representing a massive leap in legal reasoning capability

factualpending

Speaker

Jake Heiler

Evidence Quote

“when gbd 3.5 came out the study was run um and it showed that gbd 3.5 got a 10 10th percentile on the bar passage...when we got early X gd4 we're like let's run the study again too...the test we ran it did better than 90% of the test takers”

Source

Why Vertical LLM Agents Are The New $1 Billion SaaS Opportunities— Y Combinator
Created: 8/10/2026, 10:57:58 PM

Your notes

Loading notes...