← All comparisons

Mistral 7B Instruct vs OLMo 2 7B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Mistral 7B InstructOLMo 2 7B
Intelligence Index7.49.3
Coding Index1.2
Math Index0.7
Output speed (tok/s)113.20.0
Blended price ($/1M)$0.21$0.00
Time to first token (s)0.38s0.00s
aime0.0%
aime 250.7%
artificial analysis coding index1.20
artificial analysis intelligence index7.409.30
artificial analysis math index70.0%
gpqa17.7%28.8%
hle4.3%5.5%
ifbench19.9%24.4%
lcr0.0%0.0%
livecodebench4.6%4.1%
math 50012.1%
mmlu pro24.5%28.2%
scicode2.4%3.7%
tau20.0%0.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.