← All comparisons

OLMo 2 7B vs Qwen3 Coder 480B A35B Instruct

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

OLMo 2 7BQwen3 Coder 480B A35B Instruct
Intelligence Index9.324.8
Coding Index1.224.6
Math Index0.739.3
Output speed (tok/s)0.061.4
Blended price ($/1M)$0.00$0.68
Time to first token (s)0.00s1.64s
aime47.7%
aime 250.7%39.3%
artificial analysis coding index1.2024.60
artificial analysis intelligence index9.3024.80
artificial analysis math index70.0%39.30
gpqa28.8%61.8%
hle5.5%4.4%
ifbench24.4%40.5%
lcr0.0%42.3%
livecodebench4.1%58.5%
math 50094.2%
mmlu pro28.2%78.8%
scicode3.7%35.9%
tau20.0%43.6%
terminalbench hard0.0%18.9%

Benchmark data from Artificial Analysis.