← All comparisons

Mistral Large 2 (Jul '24) vs OLMo 2 32B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral Large 2 (Jul '24)OLMo 2 32B
Intelligence Index13.010.6
Coding Index2.7
Math Index0.03.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$3.00$0.00
Time to first token (s)0.00s0.00s
aime9.3%
aime 250.0%3.3%
artificial analysis coding index2.70
artificial analysis intelligence index13.0010.60
artificial analysis math index0.0%3.30
gpqa47.2%32.8%
hle3.2%3.7%
ifbench31.6%38.1%
lcr1.7%0.0%
livecodebench26.7%6.8%
math 50071.4%
mmlu pro68.3%51.1%
scicode27.1%8.0%
tau233.0%0.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.