← All comparisons

DeepSeek V4 Pro (Reasoning, High Effort) vs OLMo 2 7B

DeepSeek vs Allen Institute for AI — side-by-side benchmark comparison

DeepSeek V4 Pro (Reasoning, High Effort)OLMo 2 7B
Intelligence Index49.89.3
Coding Index43.21.2
Math Index—0.7
Output speed (tok/s)53.50.0
Blended price ($/1M)$0.54$0.00
Time to first token (s)1.17s0.00s
aime——
aime 25—0.7%
artificial analysis coding index43.201.20
artificial analysis intelligence index49.809.30
artificial analysis math index—70.0%
gpqa90.5%28.8%
hle33.5%5.5%
ifbench71.3%24.4%
lcr65.0%0.0%
livecodebench—4.1%
math 500——
mmlu pro—28.2%
scicode46.4%3.7%
tau294.2%0.0%
terminalbench hard41.7%0.0%

Benchmark data from Artificial Analysis.