← All comparisons

Molmo2-8B vs Mistral Medium 3.1

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Molmo2-8BMistral Medium 3.1
Intelligence Index7.321.3
Coding Index4.418.3
Math Index—38.3
Output speed (tok/s)0.064.0
Blended price ($/1M)$0.00$0.80
Time to first token (s)0.00s0.52s
aime——
aime 25—38.3%
artificial analysis coding index4.4018.30
artificial analysis intelligence index7.3021.30
artificial analysis math index—38.30
gpqa42.5%58.8%
hle4.4%4.4%
ifbench26.9%39.8%
lcr0.0%19.7%
livecodebench—40.6%
math 500——
mmlu pro—68.3%
scicode13.3%33.8%
tau20.0%40.6%
terminalbench hard0.0%10.6%

Benchmark data from Artificial Analysis.