← All comparisons

Olmo 3 7B Think vs Qwen3.5 9B (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B ThinkQwen3.5 9B (Reasoning)
Intelligence Index9.432.4
Coding Index7.625.3
Math Index70.7—
Output speed (tok/s)0.069.4
Blended price ($/1M)$0.00$0.11
Time to first token (s)0.00s1.37s
aime——
aime 2570.7%—
artificial analysis coding index7.6025.30
artificial analysis intelligence index9.4032.40
artificial analysis math index70.70—
gpqa51.6%80.6%
hle5.7%13.3%
ifbench41.5%66.7%
lcr0.0%59.0%
livecodebench61.7%—
math 500——
mmlu pro65.5%—
scicode21.2%27.5%
tau20.0%86.8%
terminalbench hard0.8%24.2%

Benchmark data from Artificial Analysis.