← All comparisons

Gemma 4 E4B (Non-reasoning) vs OLMo 2 7B

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 4 E4B (Non-reasoning)OLMo 2 7B
Intelligence Index14.89.3
Coding Index6.41.2
Math Index—0.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 25—0.7%
artificial analysis coding index6.401.20
artificial analysis intelligence index14.809.30
artificial analysis math index—70.0%
gpqa54.9%28.8%
hle4.7%5.5%
ifbench40.5%24.4%
lcr18.0%0.0%
livecodebench—4.1%
math 500——
mmlu pro—28.2%
scicode3.9%3.7%
tau226.0%0.0%
terminalbench hard7.6%0.0%

Benchmark data from Artificial Analysis.