← All comparisons

Mistral Large (Feb '24) vs OLMo 2 32B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral Large (Feb '24)OLMo 2 32B
Intelligence Index9.910.6
Coding Index—2.7
Math Index—3.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$6.00$0.00
Time to first token (s)0.00s0.00s
aime0.0%—
aime 25—3.3%
artificial analysis coding index—2.70
artificial analysis intelligence index9.9010.60
artificial analysis math index—3.30
gpqa35.1%32.8%
hle3.4%3.7%
ifbench—38.1%
lcr—0.0%
livecodebench17.8%6.8%
math 50052.7%—
mmlu pro51.5%51.1%
scicode20.8%8.0%
tau2—0.0%
terminalbench hard—0.0%

Benchmark data from Artificial Analysis.