← All comparisons

Ministral 3 8B vs Olmo 3 7B Instruct

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Ministral 3 8BOlmo 3 7B Instruct
Intelligence Index14.88.1
Coding Index10.03.4
Math Index31.741.3
Output speed (tok/s)100.90.0
Blended price ($/1M)$0.15$0.13
Time to first token (s)0.37s0.00s
aime——
aime 2531.7%41.3%
artificial analysis coding index10.003.40
artificial analysis intelligence index14.808.10
artificial analysis math index31.7041.30
gpqa47.1%40.0%
hle4.3%5.8%
ifbench29.1%32.8%
lcr24.0%0.0%
livecodebench30.3%26.6%
math 500——
mmlu pro64.2%52.2%
scicode20.8%10.3%
tau226.6%12.6%
terminalbench hard4.5%0.0%

Benchmark data from Artificial Analysis.