← All comparisons

Olmo 3 7B Think vs Gemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)

Allen Institute for AI vs Google — side-by-side benchmark comparison

Olmo 3 7B ThinkGemini 2.5 Flash-Lite Preview (Sep '25) (Non-reasoning)
Intelligence Index9.419.4
Coding Index7.614.5
Math Index70.746.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.17
Time to first token (s)0.00s0.00s
aime——
aime 2570.7%46.7%
artificial analysis coding index7.6014.50
artificial analysis intelligence index9.4019.40
artificial analysis math index70.7046.70
gpqa51.6%65.1%
hle5.7%4.6%
ifbench41.5%41.8%
lcr0.0%48.0%
livecodebench61.7%64.1%
math 500——
mmlu pro65.5%79.6%
scicode21.2%28.5%
tau20.0%30.4%
terminalbench hard0.8%7.6%

Benchmark data from Artificial Analysis.