← All comparisons

Phi-4 Multimodal Instruct vs Olmo 3.1 32B Instruct

Microsoft vs Allen Institute for AI — side-by-side benchmark comparison

Phi-4 Multimodal InstructOlmo 3.1 32B Instruct
Intelligence Index10.012.2
Coding Index—5.6
Math Index——
Output speed (tok/s)16.60.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)1.33s0.00s
aime9.3%—
aime 25——
artificial analysis coding index—5.60
artificial analysis intelligence index10.0012.20
artificial analysis math index——
gpqa31.5%53.9%
hle4.4%4.9%
ifbench—39.2%
lcr—0.0%
livecodebench13.1%—
math 50069.3%—
mmlu pro48.5%—
scicode11.0%16.7%
tau2—21.3%
terminalbench hard—0.0%

Benchmark data from Artificial Analysis.