← All comparisons

o3 vs Olmo 3.1 32B Instruct

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

o3Olmo 3.1 32B Instruct
Intelligence Index38.412.2
Coding Index38.45.6
Math Index88.3—
Output speed (tok/s)126.80.0
Blended price ($/1M)$3.50$0.00
Time to first token (s)7.82s0.00s
aime90.3%—
aime 2588.3%—
artificial analysis coding index38.405.60
artificial analysis intelligence index38.4012.20
artificial analysis math index88.30—
gpqa82.7%53.9%
hle20.0%4.9%
ifbench71.4%39.2%
lcr69.3%0.0%
livecodebench80.8%—
math 50099.2%—
mmlu pro85.3%—
scicode41.0%16.7%
tau280.7%21.3%
terminalbench hard37.1%0.0%

Benchmark data from Artificial Analysis.