← All comparisons

Molmo 7B-D vs DeepSeek R1 (Jan '25)

Allen Institute for AI vs DeepSeek — side-by-side benchmark comparison

Molmo 7B-DDeepSeek R1 (Jan '25)
Intelligence Index9.218.8
Coding Index1.215.9
Math Index0.068.0
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$2.43
Time to first token (s)0.00s0.00s
aime—68.3%
aime 250.0%68.0%
artificial analysis coding index1.2015.90
artificial analysis intelligence index9.2018.80
artificial analysis math index0.0%68.00
gpqa24.0%70.8%
hle5.1%9.3%
ifbench19.7%39.0%
lcr0.0%52.3%
livecodebench3.9%61.7%
math 500—96.6%
mmlu pro37.1%84.4%
scicode3.6%35.7%
tau20.0%11.4%
terminalbench hard0.0%6.1%

Benchmark data from Artificial Analysis.