← All comparisons

Gemma 4 31B (Reasoning) vs Olmo 3 7B Think

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 4 31B (Reasoning)Olmo 3 7B Think
Intelligence Index39.29.4
Coding Index38.77.6
Math Index—70.7
Output speed (tok/s)35.30.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)1.00s0.00s
aime——
aime 25—70.7%
artificial analysis coding index38.707.60
artificial analysis intelligence index39.209.40
artificial analysis math index—70.70
gpqa85.7%51.6%
hle22.7%5.7%
ifbench75.6%41.5%
lcr62.0%0.0%
livecodebench—61.7%
math 500——
mmlu pro—65.5%
scicode43.4%21.2%
tau259.9%0.0%
terminalbench hard36.4%0.8%

Benchmark data from Artificial Analysis.