← All comparisons

Qwen3.5 4B (Reasoning) vs OLMo 2 7B

Alibaba vs Allen Institute for AI — side-by-side benchmark comparison

Qwen3.5 4B (Reasoning)OLMo 2 7B
Intelligence Index27.19.3
Coding Index17.51.2
Math Index0.7
Output speed (tok/s)196.20.0
Blended price ($/1M)$0.06$0.00
Time to first token (s)0.21s0.00s
aime
aime 250.7%
artificial analysis coding index17.501.20
artificial analysis intelligence index27.109.30
artificial analysis math index70.0%
gpqa77.1%28.8%
hle7.8%5.5%
ifbench52.0%24.4%
lcr55.7%0.0%
livecodebench4.1%
math 500
mmlu pro28.2%
scicode16.1%3.7%
tau292.1%0.0%
terminalbench hard18.2%0.0%

Benchmark data from Artificial Analysis.