← All comparisons

Olmo 3 7B Think vs Gemini 2.0 Pro Experimental (Feb '25)

Allen Institute for AI vs Google — side-by-side benchmark comparison

Olmo 3 7B ThinkGemini 2.0 Pro Experimental (Feb '25)
Intelligence Index9.418.1
Coding Index7.625.5
Math Index70.7—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—36.0%
aime 2570.7%—
artificial analysis coding index7.6025.50
artificial analysis intelligence index9.4018.10
artificial analysis math index70.70—
gpqa51.6%62.2%
hle5.7%6.8%
ifbench41.5%—
lcr0.0%—
livecodebench61.7%34.7%
math 500—92.3%
mmlu pro65.5%80.5%
scicode21.2%31.3%
tau20.0%—
terminalbench hard0.8%—

Benchmark data from Artificial Analysis.