← All comparisons

Claude 4.5 Haiku (Non-reasoning) vs Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)

Anthropic vs NVIDIA — side-by-side benchmark comparison

Claude 4.5 Haiku (Non-reasoning)Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Intelligence Index31.015.0
Coding Index29.613.1
Math Index39.063.7
Output speed (tok/s)105.852.3
Blended price ($/1M)$2.19$0.90
Time to first token (s)0.65s0.76s
aime74.7%
aime 2539.0%63.7%
artificial analysis coding index29.6013.10
artificial analysis intelligence index31.0015.00
artificial analysis math index39.0063.70
gpqa64.6%72.8%
hle4.3%8.1%
ifbench42.0%38.2%
lcr43.7%7.3%
livecodebench51.1%64.1%
math 50095.2%
mmlu pro80.0%82.5%
scicode34.4%34.7%
tau232.5%11.4%
terminalbench hard27.3%2.3%

Benchmark data from Artificial Analysis.