← All comparisons

Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning) vs OLMo 2 32B

NVIDIA vs Allen Institute for AI — side-by-side benchmark comparison

Llama 3.1 Nemotron Nano 4B v1.1 (Reasoning)OLMo 2 32B
Intelligence Index14.410.6
Coding Index2.7
Math Index50.03.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime70.7%
aime 2550.0%3.3%
artificial analysis coding index2.70
artificial analysis intelligence index14.4010.60
artificial analysis math index50.003.30
gpqa40.8%32.8%
hle5.1%3.7%
ifbench25.5%38.1%
lcr0.0%0.0%
livecodebench49.3%6.8%
math 50094.7%
mmlu pro55.6%51.1%
scicode10.1%8.0%
tau211.7%0.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.