← All comparisons

Molmo 7B-D vs Mistral Large (Feb '24)

Allen Institute for AI vs Mistral — side-by-side benchmark comparison

Molmo 7B-DMistral Large (Feb '24)
Intelligence Index9.29.9
Coding Index1.2
Math Index0.0
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$6.00
Time to first token (s)0.00s0.00s
aime0.0%
aime 250.0%
artificial analysis coding index1.20
artificial analysis intelligence index9.209.90
artificial analysis math index0.0%
gpqa24.0%35.1%
hle5.1%3.4%
ifbench19.7%
lcr0.0%
livecodebench3.9%17.8%
math 50052.7%
mmlu pro37.1%51.5%
scicode3.6%20.8%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.