← All comparisons

o3 vs OLMo 2 7B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

o3OLMo 2 7B
Intelligence Index38.49.3
Coding Index38.41.2
Math Index88.30.7
Output speed (tok/s)126.80.0
Blended price ($/1M)$3.50$0.00
Time to first token (s)7.82s0.00s
aime90.3%
aime 2588.3%0.7%
artificial analysis coding index38.401.20
artificial analysis intelligence index38.409.30
artificial analysis math index88.3070.0%
gpqa82.7%28.8%
hle20.0%5.5%
ifbench71.4%24.4%
lcr69.3%0.0%
livecodebench80.8%4.1%
math 50099.2%
mmlu pro85.3%28.2%
scicode41.0%3.7%
tau280.7%0.0%
terminalbench hard37.1%0.0%

Benchmark data from Artificial Analysis.