← All comparisons

Molmo2-8B vs Claude 2.1

Allen Institute for AI vs Anthropic — side-by-side benchmark comparison

Molmo2-8BClaude 2.1
Intelligence Index7.39.3
Coding Index4.414.0
Math Index——
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—3.3%
aime 25——
artificial analysis coding index4.4014.00
artificial analysis intelligence index7.309.30
artificial analysis math index——
gpqa42.5%31.9%
hle4.4%4.2%
ifbench26.9%—
lcr0.0%—
livecodebench—19.5%
math 500—37.4%
mmlu pro—49.5%
scicode13.3%18.4%
tau20.0%—
terminalbench hard0.0%—

Benchmark data from Artificial Analysis.