← All comparisons

Mistral Medium vs OLMo 2 7B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral MediumOLMo 2 7B
Intelligence Index9.09.3
Coding Index—1.2
Math Index—0.7
Output speed (tok/s)67.50.0
Blended price ($/1M)$4.09$0.00
Time to first token (s)0.56s0.00s
aime3.7%—
aime 25—0.7%
artificial analysis coding index—1.20
artificial analysis intelligence index9.009.30
artificial analysis math index—70.0%
gpqa34.9%28.8%
hle3.4%5.5%
ifbench—24.4%
lcr—0.0%
livecodebench9.9%4.1%
math 50040.5%—
mmlu pro49.1%28.2%
scicode11.8%3.7%
tau2—0.0%
terminalbench hard—0.0%

Benchmark data from Artificial Analysis.