← All comparisons

Molmo 7B-D vs Devstral Small (Jul '25)

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Molmo 7B-DDevstral Small (Jul '25)
Intelligence Index9.215.2
Coding Index1.212.1
Math Index0.029.3
Output speed (tok/s)0.0183.4
Blended price ($/1M)$0.00$0.15
Time to first token (s)0.00s0.40s
aime0.3%
aime 250.0%29.3%
artificial analysis coding index1.2012.10
artificial analysis intelligence index9.2015.20
artificial analysis math index0.0%29.30
gpqa24.0%41.4%
hle5.1%3.7%
ifbench19.7%34.6%
lcr0.0%17.0%
livecodebench3.9%25.4%
math 50063.5%
mmlu pro37.1%62.2%
scicode3.6%24.3%
tau20.0%28.4%
terminalbench hard0.0%6.1%

Benchmark data from Artificial Analysis.