← All comparisons

OLMo 2 7B vs Qwen3 1.7B (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 1.7B (Reasoning)
Intelligence Index9.38.0
Coding Index1.21.4
Math Index0.738.7
Output speed (tok/s)0.0136.4
Blended price ($/1M)$0.00$0.40
Time to first token (s)0.00s0.91s
aime51.0%
aime 250.7%38.7%
artificial analysis coding index1.201.40
artificial analysis intelligence index9.308.00
artificial analysis math index70.0%38.70
gpqa28.8%35.6%
hle5.5%4.8%
ifbench24.4%26.9%
lcr0.0%0.0%
livecodebench4.1%30.8%
math 50089.4%
mmlu pro28.2%57.0%
scicode3.7%4.3%
tau20.0%26.0%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.