← All comparisons

Llama Nemotron Super 49B v1.5 (Non-reasoning) vs OLMo 2 7B

NVIDIA vs Allen Institute for AI — side-by-side benchmark comparison

Llama Nemotron Super 49B v1.5 (Non-reasoning)OLMo 2 7B
Intelligence Index14.69.3
Coding Index10.51.2
Math Index8.00.7
Output speed (tok/s)48.90.0
Blended price ($/1M)$0.17$0.00
Time to first token (s)0.28s0.00s
aime13.7%
aime 258.0%0.7%
artificial analysis coding index10.501.20
artificial analysis intelligence index14.609.30
artificial analysis math index8.0070.0%
gpqa48.1%28.8%
hle4.3%5.5%
ifbench32.9%24.4%
lcr22.0%0.0%
livecodebench29.0%4.1%
math 50077.0%
mmlu pro69.2%28.2%
scicode23.8%3.7%
tau225.1%0.0%
terminalbench hard3.8%0.0%

Benchmark data from Artificial Analysis.