← All comparisons

Devstral Small 2 vs Olmo 3 32B Think

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Devstral Small 2Olmo 3 32B Think
Intelligence Index19.512.1
Coding Index20.710.5
Math Index34.373.7
Output speed (tok/s)75.20.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.73s0.00s
aime——
aime 2534.3%73.7%
artificial analysis coding index20.7010.50
artificial analysis intelligence index19.5012.10
artificial analysis math index34.3073.70
gpqa53.2%61.0%
hle3.4%5.9%
ifbench31.2%49.1%
lcr24.0%0.0%
livecodebench34.8%67.2%
math 500——
mmlu pro67.8%75.9%
scicode28.8%28.6%
tau223.4%0.0%
terminalbench hard16.7%1.5%

Benchmark data from Artificial Analysis.