← All comparisons

OLMo 2 7B vs Qwen3 1.7B (Non-reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 1.7B (Non-reasoning)
Intelligence Index9.36.8
Coding Index1.22.3
Math Index0.77.3
Output speed (tok/s)0.0137.6
Blended price ($/1M)$0.00$0.19
Time to first token (s)0.00s0.93s
aime9.7%
aime 250.7%7.3%
artificial analysis coding index1.202.30
artificial analysis intelligence index9.306.80
artificial analysis math index70.0%7.30
gpqa28.8%28.3%
hle5.5%5.2%
ifbench24.4%21.1%
lcr0.0%0.0%
livecodebench4.1%12.6%
math 50071.7%
mmlu pro28.2%41.1%
scicode3.7%6.9%
tau20.0%21.6%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.