← All comparisons

Olmo 3 7B Think vs Qwen2 Instruct 72B

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B ThinkQwen2 Instruct 72B
Intelligence Index9.411.7
Coding Index7.6—
Math Index70.7—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—14.7%
aime 2570.7%—
artificial analysis coding index7.60—
artificial analysis intelligence index9.4011.70
artificial analysis math index70.70—
gpqa51.6%37.1%
hle5.7%3.7%
ifbench41.5%—
lcr0.0%—
livecodebench61.7%15.9%
math 500—70.1%
mmlu pro65.5%62.2%
scicode21.2%22.9%
tau20.0%—
terminalbench hard0.8%—

Benchmark data from Artificial Analysis.