← All comparisons

Mistral Medium 3 vs OLMo 2 7B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral Medium 3OLMo 2 7B
Intelligence Index18.89.3
Coding Index13.61.2
Math Index30.30.7
Output speed (tok/s)36.00.0
Blended price ($/1M)$0.80$0.00
Time to first token (s)0.61s0.00s
aime44.0%
aime 2530.3%0.7%
artificial analysis coding index13.601.20
artificial analysis intelligence index18.809.30
artificial analysis math index30.3070.0%
gpqa57.8%28.8%
hle4.3%5.5%
ifbench39.3%24.4%
lcr28.0%0.0%
livecodebench40.0%4.1%
math 50090.7%
mmlu pro76.0%28.2%
scicode33.1%3.7%
tau224.3%0.0%
terminalbench hard3.8%0.0%

Benchmark data from Artificial Analysis.