← All comparisons

Olmo 3.1 32B Think vs Llama 2 Chat 70B

Allen Institute for AI vs Meta — side-by-side benchmark comparison

Olmo 3.1 32B ThinkLlama 2 Chat 70B
Intelligence Index13.98.4
Coding Index9.8—
Math Index77.3—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—0.0%
aime 2577.3%—
artificial analysis coding index9.80—
artificial analysis intelligence index13.908.40
artificial analysis math index77.30—
gpqa59.1%32.7%
hle6.0%5.0%
ifbench66.0%—
lcr0.0%—
livecodebench69.5%9.8%
math 500—32.3%
mmlu pro76.3%40.6%
scicode29.3%—
tau20.0%—
terminalbench hard0.0%—

Benchmark data from Artificial Analysis.