bar exam
A standardized examination that lawyers must pass to be licensed to practice law, testing legal knowledge and reasoning, used by CaseText as a benchmark for LLM legal capabilities
As defined in Why Vertical LLM Agents Are The New $1 Billion SaaS Opportunities
Other definitions
A standardized professional licensing examination that lawyers must pass to be legally permitted to practice law
The Economics of Artificial Intelligence | Tyler Cowen
Where it comes up · 2
- The Economics of Artificial Intelligence | Tyler Cowen2 claims
- Why Vertical LLM Agents Are The New $1 Billion SaaS Opportunities1 claim
Most important claims · 3 of 3Search all claims for “bar exam” →
- GPT and other AI models can pass professional licensing exams like the bar exam for lawyers and medical boards for doctors, outperforming the speaker despite his decades of expertise in his fieldThe Economics of Artificial Intelligence | Tyler Cowen
- GPT and similar AI models are already superior to human experts in knowledge-intensive domains like medicine, law, and economics, where they pass licensing exams that many humans cannot pass.The Economics of Artificial Intelligence | Tyler Cowen
- GPT-3.5 scored at the 10th percentile on the bar exam (barely passing, equivalent to random guessing by some test-takers), while early access GPT-4 scored at the 90th percentile on a new, non-training-set bar exam, representing a massive leap in legal reasoning capabilityWhy Vertical LLM Agents Are The New $1 Billion SaaS Opportunities