← All comparisons

Olmo 3.1 32B Instruct vs Mistral 7B Instruct

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Olmo 3.1 32B InstructMistral 7B Instruct
Intelligence Index12.27.4
Coding Index5.6—
Math Index——
Output speed (tok/s)0.0113.2
Blended price ($/1M)$0.00$0.21
Time to first token (s)0.00s0.38s
aime—0.0%
aime 25——
artificial analysis coding index5.60—
artificial analysis intelligence index12.207.40
artificial analysis math index——
gpqa53.9%17.7%
hle4.9%4.3%
ifbench39.2%19.9%
lcr0.0%0.0%
livecodebench—4.6%
math 500—12.1%
mmlu pro—24.5%
scicode16.7%2.4%
tau221.3%0.0%
terminalbench hard0.0%—

Benchmark data from Artificial Analysis.