← All comparisons

Olmo 3 7B Think vs Mistral Large (Feb '24)

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Olmo 3 7B ThinkMistral Large (Feb '24)
Intelligence Index9.49.9
Coding Index7.6—
Math Index70.7—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$6.00
Time to first token (s)0.00s0.00s
aime—0.0%
aime 2570.7%—
artificial analysis coding index7.60—
artificial analysis intelligence index9.409.90
artificial analysis math index70.70—
gpqa51.6%35.1%
hle5.7%3.4%
ifbench41.5%—
lcr0.0%—
livecodebench61.7%17.8%
math 500—52.7%
mmlu pro65.5%51.5%
scicode21.2%20.8%
tau20.0%—
terminalbench hard0.8%—

Benchmark data from Artificial Analysis.