← All comparisons

Molmo2-8B vs Claude 4 Sonnet (Reasoning)

Allen Institute for AI vs Anthropic — side-by-side benchmark comparison

Molmo2-8BClaude 4 Sonnet (Reasoning)
Intelligence Index7.338.7
Coding Index4.434.1
Math Index74.3
Output speed (tok/s)0.055.5
Blended price ($/1M)$0.00$6.56
Time to first token (s)0.00s8.92s
aime77.3%
aime 2574.3%
artificial analysis coding index4.4034.10
artificial analysis intelligence index7.3038.70
artificial analysis math index74.30
gpqa42.5%77.7%
hle4.4%9.6%
ifbench26.9%54.7%
lcr0.0%64.7%
livecodebench65.5%
math 50099.1%
mmlu pro84.2%
scicode13.3%40.0%
tau20.0%64.6%
terminalbench hard0.0%31.1%

Benchmark data from Artificial Analysis.