← All comparisons

OLMo 2 7B vs Qwen3 30B A3B 2507 Instruct

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 30B A3B 2507 Instruct
Intelligence Index9.315.0
Coding Index1.214.2
Math Index0.766.3
Output speed (tok/s)0.0102.1
Blended price ($/1M)$0.00$0.21
Time to first token (s)0.00s0.98s
aime72.7%
aime 250.7%66.3%
artificial analysis coding index1.2014.20
artificial analysis intelligence index9.3015.00
artificial analysis math index70.0%66.30
gpqa28.8%65.9%
hle5.5%6.8%
ifbench24.4%33.1%
lcr0.0%22.7%
livecodebench4.1%51.5%
math 50097.5%
mmlu pro28.2%77.7%
scicode3.7%30.4%
tau20.0%10.2%
terminalbench hard0.0%6.1%

Benchmark data from Artificial Analysis.