← All comparisons

GPT-4o mini vs OLMo 2 32B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-4o miniOLMo 2 32B
Intelligence Index12.610.6
Coding Index2.7
Math Index14.73.3
Output speed (tok/s)69.60.0
Blended price ($/1M)$0.26$0.00
Time to first token (s)0.62s0.00s
aime11.7%
aime 2514.7%3.3%
artificial analysis coding index2.70
artificial analysis intelligence index12.6010.60
artificial analysis math index14.703.30
gpqa42.6%32.8%
hle4.0%3.7%
ifbench31.0%38.1%
lcr0.0%
livecodebench23.4%6.8%
math 50078.9%
mmlu pro64.8%51.1%
scicode22.9%8.0%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.