← All comparisons

Olmo 3 32B Think vs Qwen2.5 Instruct 32B

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 32B ThinkQwen2.5 Instruct 32B
Intelligence Index12.113.2
Coding Index10.5—
Math Index73.7—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—11.0%
aime 2573.7%—
artificial analysis coding index10.50—
artificial analysis intelligence index12.1013.20
artificial analysis math index73.70—
gpqa61.0%46.6%
hle5.9%3.8%
ifbench49.1%—
lcr0.0%—
livecodebench67.2%24.8%
math 500—80.5%
mmlu pro75.9%69.7%
scicode28.6%22.9%
tau20.0%—
terminalbench hard1.5%—

Benchmark data from Artificial Analysis.