← All comparisons

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning) vs Nova Lite

NVIDIA vs Amazon — side-by-side benchmark comparison

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)Nova Lite
Intelligence Index15.012.7
Coding Index13.15.1
Math Index63.77.0
Output speed (tok/s)52.3201.3
Blended price ($/1M)$0.90$0.10
Time to first token (s)0.76s0.66s
aime74.7%10.7%
aime 2563.7%7.0%
artificial analysis coding index13.105.10
artificial analysis intelligence index15.0012.70
artificial analysis math index63.707.00
gpqa72.8%43.3%
hle8.1%4.6%
ifbench38.2%34.1%
lcr7.3%17.7%
livecodebench64.1%16.7%
math 50095.2%76.5%
mmlu pro82.5%59.0%
scicode34.7%13.9%
tau211.4%17.5%
terminalbench hard2.3%0.8%

Benchmark data from Artificial Analysis.