← All comparisons

Olmo 3.1 32B Think vs Phi-3 Mini Instruct 3.8B

Allen Institute for AI vs Microsoft — side-by-side benchmark comparison

Olmo 3.1 32B ThinkPhi-3 Mini Instruct 3.8B
Intelligence Index13.910.1
Coding Index9.83.0
Math Index77.30.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime4.0%
aime 2577.3%0.3%
artificial analysis coding index9.803.00
artificial analysis intelligence index13.9010.10
artificial analysis math index77.3030.0%
gpqa59.1%31.9%
hle6.0%4.4%
ifbench66.0%23.9%
lcr0.0%2.0%
livecodebench69.5%11.6%
math 50045.7%
mmlu pro76.3%43.5%
scicode29.3%9.0%
tau20.0%0.0%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.