← All comparisons

Gemma 3 1B Instruct vs Olmo 3 32B Think

Google vs Allen Institute for AI — side-by-side benchmark comparison

Gemma 3 1B InstructOlmo 3 32B Think
Intelligence Index5.612.1
Coding Index0.210.5
Math Index3.373.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime0.0%—
aime 253.3%73.7%
artificial analysis coding index20.0%10.50
artificial analysis intelligence index5.6012.10
artificial analysis math index3.3073.70
gpqa23.7%61.0%
hle5.2%5.9%
ifbench19.9%49.1%
lcr0.0%0.0%
livecodebench1.7%67.2%
math 50048.4%—
mmlu pro13.5%75.9%
scicode0.7%28.6%
tau210.5%0.0%
terminalbench hard0.0%1.5%

Benchmark data from Artificial Analysis.