← All comparisons

Molmo 7B-D vs Mistral Small (Sep '24)

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Molmo 7B-DMistral Small (Sep '24)
Intelligence Index9.210.2
Coding Index1.2—
Math Index0.0—
Output speed (tok/s)0.0162.4
Blended price ($/1M)$0.00$0.30
Time to first token (s)0.00s0.53s
aime—6.3%
aime 250.0%—
artificial analysis coding index1.20—
artificial analysis intelligence index9.2010.20
artificial analysis math index0.0%—
gpqa24.0%38.1%
hle5.1%4.3%
ifbench19.7%—
lcr0.0%—
livecodebench3.9%14.1%
math 500—56.3%
mmlu pro37.1%52.9%
scicode3.6%15.6%
tau20.0%—
terminalbench hard0.0%—

Benchmark data from Artificial Analysis.