← All comparisons

Gemma 3n E4B Instruct Preview (May '25) vs OLMo 2 7B

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 3n E4B Instruct Preview (May '25)OLMo 2 7B
Intelligence Index10.19.3
Coding Index1.2
Math Index0.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime10.7%
aime 250.7%
artificial analysis coding index1.20
artificial analysis intelligence index10.109.30
artificial analysis math index70.0%
gpqa27.8%28.8%
hle4.9%5.5%
ifbench24.4%
lcr0.0%
livecodebench13.8%4.1%
math 50074.9%
mmlu pro48.3%28.2%
scicode8.6%3.7%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.