← All comparisons

OLMo 2 7B vs Qwen3 235B A22B 2507 (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 235B A22B 2507 (Reasoning)
Intelligence Index9.329.5
Coding Index1.223.2
Math Index0.791.0
Output speed (tok/s)0.062.5
Blended price ($/1M)$0.00$0.84
Time to first token (s)0.00s1.21s
aime94.0%
aime 250.7%91.0%
artificial analysis coding index1.2023.20
artificial analysis intelligence index9.3029.50
artificial analysis math index70.0%91.00
gpqa28.8%79.0%
hle5.5%15.0%
ifbench24.4%51.2%
lcr0.0%67.0%
livecodebench4.1%78.8%
math 50098.4%
mmlu pro28.2%84.3%
scicode3.7%42.4%
tau20.0%53.2%
terminalbench hard0.0%13.6%

Benchmark data from Artificial Analysis.