← All comparisons

DeepSeek R1 (Jan '25) vs OLMo 2 32B

DeepSeek vs Allen Institute for AI — side-by-side benchmark comparison

DeepSeek R1 (Jan '25)OLMo 2 32B
Intelligence Index18.810.6
Coding Index15.92.7
Math Index68.03.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$2.43$0.00
Time to first token (s)0.00s0.00s
aime68.3%
aime 2568.0%3.3%
artificial analysis coding index15.902.70
artificial analysis intelligence index18.8010.60
artificial analysis math index68.003.30
gpqa70.8%32.8%
hle9.3%3.7%
ifbench39.0%38.1%
lcr52.3%0.0%
livecodebench61.7%6.8%
math 50096.6%
mmlu pro84.4%51.1%
scicode35.7%8.0%
tau211.4%0.0%
terminalbench hard6.1%0.0%

Benchmark data from Artificial Analysis.