← All comparisons

Olmo 3 7B Think vs Qwen3.6 27B (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B ThinkQwen3.6 27B (Reasoning)
Intelligence Index9.445.8
Coding Index7.636.5
Math Index70.7—
Output speed (tok/s)0.057.4
Blended price ($/1M)$0.00$1.35
Time to first token (s)0.00s1.46s
aime——
aime 2570.7%—
artificial analysis coding index7.6036.50
artificial analysis intelligence index9.4045.80
artificial analysis math index70.70—
gpqa51.6%84.2%
hle5.7%21.6%
ifbench41.5%67.6%
lcr0.0%68.7%
livecodebench61.7%—
math 500——
mmlu pro65.5%—
scicode21.2%39.8%
tau20.0%94.2%
terminalbench hard0.8%34.8%

Benchmark data from Artificial Analysis.