← All comparisons

OLMo 2 7B vs Qwen3 8B (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 8B (Reasoning)
Intelligence Index9.313.2
Coding Index1.29.0
Math Index0.719.0
Output speed (tok/s)0.060.7
Blended price ($/1M)$0.00$0.37
Time to first token (s)0.00s1.45s
aime74.7%
aime 250.7%19.0%
artificial analysis coding index1.209.00
artificial analysis intelligence index9.3013.20
artificial analysis math index70.0%19.00
gpqa28.8%58.9%
hle5.5%4.2%
ifbench24.4%33.5%
lcr0.0%0.0%
livecodebench4.1%40.6%
math 50090.4%
mmlu pro28.2%74.3%
scicode3.7%22.6%
tau20.0%27.8%
terminalbench hard0.0%2.3%

Benchmark data from Artificial Analysis.