← All comparisons

OLMo 2 7B vs Qwen3 235B A22B (Non-reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 235B A22B (Non-reasoning)
Intelligence Index9.317.0
Coding Index1.214.0
Math Index0.723.7
Output speed (tok/s)0.060.8
Blended price ($/1M)$0.00$0.79
Time to first token (s)0.00s1.30s
aime32.7%
aime 250.7%23.7%
artificial analysis coding index1.2014.00
artificial analysis intelligence index9.3017.00
artificial analysis math index70.0%23.70
gpqa28.8%61.3%
hle5.5%4.7%
ifbench24.4%36.6%
lcr0.0%0.0%
livecodebench4.1%34.3%
math 50090.2%
mmlu pro28.2%76.2%
scicode3.7%29.9%
tau20.0%27.2%
terminalbench hard0.0%6.1%

Benchmark data from Artificial Analysis.