← All comparisons

Gemma 4 31B (Non-reasoning) vs Molmo2-8B

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 4 31B (Non-reasoning)Molmo2-8B
Intelligence Index32.37.3
Coding Index33.94.4
Math Index
Output speed (tok/s)18.00.0
Blended price ($/1M)$0.20$0.00
Time to first token (s)0.60s0.00s
aime
aime 25
artificial analysis coding index33.904.40
artificial analysis intelligence index32.307.30
artificial analysis math index
gpqa76.3%42.5%
hle11.5%4.4%
ifbench53.5%26.9%
lcr36.0%0.0%
livecodebench
math 500
mmlu pro
scicode41.1%13.3%
tau265.5%0.0%
terminalbench hard30.3%0.0%

Benchmark data from Artificial Analysis.