← All comparisons

Llama Nemotron Super 49B v1.5 (Reasoning) vs OLMo 2 32B

NVIDIA vs Allen Institute for AI — side-by-side benchmark comparison

Llama Nemotron Super 49B v1.5 (Reasoning)OLMo 2 32B
Intelligence Index18.710.6
Coding Index15.12.7
Math Index76.73.3
Output speed (tok/s)48.10.0
Blended price ($/1M)$0.17$0.00
Time to first token (s)0.30s0.00s
aime86.0%
aime 2576.7%3.3%
artificial analysis coding index15.102.70
artificial analysis intelligence index18.7010.60
artificial analysis math index76.703.30
gpqa74.8%32.8%
hle6.8%3.7%
ifbench37.0%38.1%
lcr34.0%0.0%
livecodebench73.7%6.8%
math 50098.3%
mmlu pro81.4%51.1%
scicode34.8%8.0%
tau228.1%0.0%
terminalbench hard5.3%0.0%

Benchmark data from Artificial Analysis.