← All comparisons

Molmo2-8B vs Qwen3 1.7B (Non-reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Molmo2-8BQwen3 1.7B (Non-reasoning)
Intelligence Index7.36.8
Coding Index4.42.3
Math Index7.3
Output speed (tok/s)0.0137.6
Blended price ($/1M)$0.00$0.19
Time to first token (s)0.00s0.93s
aime9.7%
aime 257.3%
artificial analysis coding index4.402.30
artificial analysis intelligence index7.306.80
artificial analysis math index7.30
gpqa42.5%28.3%
hle4.4%5.2%
ifbench26.9%21.1%
lcr0.0%0.0%
livecodebench12.6%
math 50071.7%
mmlu pro41.1%
scicode13.3%6.9%
tau20.0%21.6%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.