← All comparisons

Olmo 3.1 32B Think vs OLMo 2 7B

Allen Institute for AI vs Allen Institute for AI — side-by-side benchmark comparison

Olmo 3.1 32B ThinkOLMo 2 7B
Intelligence Index13.99.3
Coding Index9.81.2
Math Index77.30.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 2577.3%0.7%
artificial analysis coding index9.801.20
artificial analysis intelligence index13.909.30
artificial analysis math index77.3070.0%
gpqa59.1%28.8%
hle6.0%5.5%
ifbench66.0%24.4%
lcr0.0%0.0%
livecodebench69.5%4.1%
math 500——
mmlu pro76.3%28.2%
scicode29.3%3.7%
tau20.0%0.0%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.