← All comparisons

Gemma 4 31B (Non-reasoning) vs Molmo 7B-D

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 4 31B (Non-reasoning)Molmo 7B-D
Intelligence Index32.39.2
Coding Index33.91.2
Math Index0.0
Output speed (tok/s)18.00.0
Blended price ($/1M)$0.20$0.00
Time to first token (s)0.60s0.00s
aime
aime 250.0%
artificial analysis coding index33.901.20
artificial analysis intelligence index32.309.20
artificial analysis math index0.0%
gpqa76.3%24.0%
hle11.5%5.1%
ifbench53.5%19.7%
lcr36.0%0.0%
livecodebench3.9%
math 500
mmlu pro37.1%
scicode41.1%3.6%
tau265.5%0.0%
terminalbench hard30.3%0.0%

Benchmark data from Artificial Analysis.