← All comparisons

Gemma 3 4B Instruct vs Claude 4.1 Opus (Non-reasoning)

Google vs Anthropic — side-by-side benchmark comparison

Gemma 3 4B InstructClaude 4.1 Opus (Non-reasoning)
Intelligence Index6.336.0
Coding Index2.9
Math Index12.7
Output speed (tok/s)0.044.7
Blended price ($/1M)$0.05$32.81
Time to first token (s)0.00s1.63s
aime6.3%
aime 2512.7%
artificial analysis coding index2.90
artificial analysis intelligence index6.3036.00
artificial analysis math index12.70
gpqa29.1%
hle5.2%
ifbench28.3%
lcr5.7%
livecodebench11.2%
math 50076.6%
mmlu pro41.7%
scicode7.3%
tau25.0%
terminalbench hard0.8%

Benchmark data from Artificial Analysis.