← All comparisons

Olmo 3 7B Think vs Qwen2.5 Turbo

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B ThinkQwen2.5 Turbo
Intelligence Index9.412.0
Coding Index7.6—
Math Index70.7—
Output speed (tok/s)0.066.5
Blended price ($/1M)$0.00$0.09
Time to first token (s)0.00s1.16s
aime—12.0%
aime 2570.7%—
artificial analysis coding index7.60—
artificial analysis intelligence index9.4012.00
artificial analysis math index70.70—
gpqa51.6%41.0%
hle5.7%4.2%
ifbench41.5%—
lcr0.0%—
livecodebench61.7%16.3%
math 500—80.5%
mmlu pro65.5%63.3%
scicode21.2%15.3%
tau20.0%—
terminalbench hard0.8%—

Benchmark data from Artificial Analysis.