← All comparisons

Devstral 2 vs Molmo 7B-D

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Devstral 2Molmo 7B-D
Intelligence Index22.09.2
Coding Index23.71.2
Math Index36.70.0
Output speed (tok/s)79.90.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.50s0.00s
aime
aime 2536.7%0.0%
artificial analysis coding index23.701.20
artificial analysis intelligence index22.009.20
artificial analysis math index36.700.0%
gpqa59.4%24.0%
hle3.6%5.1%
ifbench38.1%19.7%
lcr30.0%0.0%
livecodebench44.8%3.9%
math 500
mmlu pro76.2%37.1%
scicode33.1%3.6%
tau224.9%0.0%
terminalbench hard18.9%0.0%

Benchmark data from Artificial Analysis.