← All comparisons

Olmo 3 7B Think vs Mistral Medium

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Olmo 3 7B ThinkMistral Medium
Intelligence Index9.49.0
Coding Index7.6—
Math Index70.7—
Output speed (tok/s)0.067.5
Blended price ($/1M)$0.00$4.09
Time to first token (s)0.00s0.56s
aime—3.7%
aime 2570.7%—
artificial analysis coding index7.60—
artificial analysis intelligence index9.409.00
artificial analysis math index70.70—
gpqa51.6%34.9%
hle5.7%3.4%
ifbench41.5%—
lcr0.0%—
livecodebench61.7%9.9%
math 500—40.5%
mmlu pro65.5%49.1%
scicode21.2%11.8%
tau20.0%—
terminalbench hard0.8%—

Benchmark data from Artificial Analysis.