← All comparisons

Grok-1 vs Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)

xAI vs NVIDIA — side-by-side benchmark comparison

Grok-1Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)
Intelligence Index11.715.0
Coding Index13.1
Math Index63.7
Output speed (tok/s)0.052.3
Blended price ($/1M)$0.00$0.90
Time to first token (s)0.00s0.76s
aime74.7%
aime 2563.7%
artificial analysis coding index13.10
artificial analysis intelligence index11.7015.00
artificial analysis math index63.70
gpqa72.8%
hle8.1%
ifbench38.2%
lcr7.3%
livecodebench64.1%
math 50095.2%
mmlu pro82.5%
scicode34.7%
tau211.4%
terminalbench hard2.3%

Benchmark data from Artificial Analysis.