← All comparisons

Olmo 3 7B Think vs DeepSeek R1 (Jan '25)

Allen Institute for AI vs DeepSeek — side-by-side benchmark comparison

Olmo 3 7B ThinkDeepSeek R1 (Jan '25)
Intelligence Index9.418.8
Coding Index7.615.9
Math Index70.768.0
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$2.43
Time to first token (s)0.00s0.00s
aime—68.3%
aime 2570.7%68.0%
artificial analysis coding index7.6015.90
artificial analysis intelligence index9.4018.80
artificial analysis math index70.7068.00
gpqa51.6%70.8%
hle5.7%9.3%
ifbench41.5%39.0%
lcr0.0%52.3%
livecodebench61.7%61.7%
math 500—96.6%
mmlu pro65.5%84.4%
scicode21.2%35.7%
tau20.0%11.4%
terminalbench hard0.8%6.1%

Benchmark data from Artificial Analysis.