← All comparisons

Olmo 3.1 32B Think vs Llama 3.2 Instruct 1B

Allen Institute for AI vs Meta — side-by-side benchmark comparison

Olmo 3.1 32B ThinkLlama 3.2 Instruct 1B
Intelligence Index13.96.3
Coding Index9.80.6
Math Index77.30.0
Output speed (tok/s)0.089.7
Blended price ($/1M)$0.00$0.05
Time to first token (s)0.00s0.59s
aime—0.0%
aime 2577.3%0.0%
artificial analysis coding index9.8060.0%
artificial analysis intelligence index13.906.30
artificial analysis math index77.300.0%
gpqa59.1%19.6%
hle6.0%5.3%
ifbench66.0%22.8%
lcr0.0%5.0%
livecodebench69.5%1.9%
math 500—14.0%
mmlu pro76.3%20.0%
scicode29.3%1.7%
tau20.0%0.0%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.