← All comparisons

GPT-4 Turbo vs OLMo 2 7B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-4 TurboOLMo 2 7B
Intelligence Index13.79.3
Coding Index21.51.2
Math Index0.7
Output speed (tok/s)25.80.0
Blended price ($/1M)$15.00$0.00
Time to first token (s)1.58s0.00s
aime15.0%
aime 250.7%
artificial analysis coding index21.501.20
artificial analysis intelligence index13.709.30
artificial analysis math index70.0%
gpqa28.8%
hle3.3%5.5%
ifbench24.4%
lcr0.0%
livecodebench29.1%4.1%
math 50073.7%
mmlu pro69.4%28.2%
scicode31.9%3.7%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.