← All comparisons

Molmo 7B-D vs Llama 3.1 Instruct 70B

Allen Institute for AI vs Meta — side-by-side benchmark comparison

Molmo 7B-DLlama 3.1 Instruct 70B
Intelligence Index9.212.5
Coding Index1.210.9
Math Index0.04.0
Output speed (tok/s)0.035.3
Blended price ($/1M)$0.00$0.56
Time to first token (s)0.00s0.54s
aime—17.3%
aime 250.0%4.0%
artificial analysis coding index1.2010.90
artificial analysis intelligence index9.2012.50
artificial analysis math index0.0%4.00
gpqa24.0%40.9%
hle5.1%4.6%
ifbench19.7%34.4%
lcr0.0%6.3%
livecodebench3.9%23.2%
math 500—64.9%
mmlu pro37.1%67.6%
scicode3.6%26.7%
tau20.0%15.2%
terminalbench hard0.0%3.0%

Benchmark data from Artificial Analysis.