← All comparisons

Phi-3 Mini Instruct 3.8B vs OLMo 2 32B

Microsoft vs Allen Institute for AI — side-by-side benchmark comparison

Phi-3 Mini Instruct 3.8BOLMo 2 32B
Intelligence Index10.110.6
Coding Index3.02.7
Math Index0.33.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime4.0%
aime 250.3%3.3%
artificial analysis coding index3.002.70
artificial analysis intelligence index10.1010.60
artificial analysis math index30.0%3.30
gpqa31.9%32.8%
hle4.4%3.7%
ifbench23.9%38.1%
lcr2.0%0.0%
livecodebench11.6%6.8%
math 50045.7%
mmlu pro43.5%51.1%
scicode9.0%8.0%
tau20.0%0.0%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.