← All comparisons

Claude 4.5 Haiku (Reasoning) vs Gemma 3n E4B Instruct Preview (May '25)

Anthropic vs Google — side-by-side benchmark comparison

Claude 4.5 Haiku (Reasoning)Gemma 3n E4B Instruct Preview (May '25)
Intelligence Index37.110.1
Coding Index32.6
Math Index83.7
Output speed (tok/s)142.20.0
Blended price ($/1M)$2.19$0.00
Time to first token (s)10.48s0.00s
aime10.7%
aime 2583.7%
artificial analysis coding index32.60
artificial analysis intelligence index37.1010.10
artificial analysis math index83.70
gpqa67.2%27.8%
hle9.7%4.9%
ifbench54.3%
lcr70.3%
livecodebench61.5%13.8%
math 50074.9%
mmlu pro76.0%48.3%
scicode43.3%8.6%
tau254.7%
terminalbench hard27.3%

Benchmark data from Artificial Analysis.