← All comparisons

OLMo 2 7B vs Qwen3 235B A22B 2507 Instruct

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 235B A22B 2507 Instruct
Intelligence Index9.325.0
Coding Index1.222.1
Math Index0.771.7
Output speed (tok/s)0.057.0
Blended price ($/1M)$0.00$0.36
Time to first token (s)0.00s1.34s
aime71.7%
aime 250.7%71.7%
artificial analysis coding index1.2022.10
artificial analysis intelligence index9.3025.00
artificial analysis math index70.0%71.70
gpqa28.8%75.3%
hle5.5%10.6%
ifbench24.4%46.1%
lcr0.0%31.2%
livecodebench4.1%52.4%
math 50098.0%
mmlu pro28.2%82.8%
scicode3.7%36.0%
tau20.0%33.3%
terminalbench hard0.0%15.2%

Benchmark data from Artificial Analysis.