← All comparisons

Olmo 3.1 32B Think vs Llama 3.3 Nemotron Super 49B v1 (Reasoning)

Allen Institute for AI vs NVIDIA — side-by-side benchmark comparison

Olmo 3.1 32B ThinkLlama 3.3 Nemotron Super 49B v1 (Reasoning)
Intelligence Index13.918.5
Coding Index9.89.4
Math Index77.354.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—58.3%
aime 2577.3%54.7%
artificial analysis coding index9.809.40
artificial analysis intelligence index13.9018.50
artificial analysis math index77.3054.70
gpqa59.1%64.3%
hle6.0%6.5%
ifbench66.0%38.1%
lcr0.0%17.0%
livecodebench69.5%27.7%
math 500—95.9%
mmlu pro76.3%78.5%
scicode29.3%28.2%
tau20.0%26.9%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.