← All comparisons

Mistral Medium 3.5 vs OLMo 2 7B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral Medium 3.5OLMo 2 7B
Intelligence Index39.29.3
Coding Index35.41.2
Math Index0.7
Output speed (tok/s)169.90.0
Blended price ($/1M)$3.00$0.00
Time to first token (s)0.52s0.00s
aime
aime 250.7%
artificial analysis coding index35.401.20
artificial analysis intelligence index39.209.30
artificial analysis math index70.0%
gpqa74.8%28.8%
hle12.8%5.5%
ifbench68.8%24.4%
lcr61.0%0.0%
livecodebench4.1%
math 500
mmlu pro28.2%
scicode39.6%3.7%
tau294.2%0.0%
terminalbench hard33.3%0.0%

Benchmark data from Artificial Analysis.