← All comparisons

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning) vs Tri-21B-Think

NVIDIA vs Trillion Labs — side-by-side benchmark comparison

Llama 3.1 Nemotron Ultra 253B v1 (Reasoning)Tri-21B-Think
Intelligence Index15.018.6
Coding Index13.16.3
Math Index63.7
Output speed (tok/s)52.30.0
Blended price ($/1M)$0.90$0.00
Time to first token (s)0.76s0.00s
aime74.7%
aime 2563.7%
artificial analysis coding index13.106.30
artificial analysis intelligence index15.0018.60
artificial analysis math index63.70
gpqa72.8%60.1%
hle8.1%6.1%
ifbench38.2%54.6%
lcr7.3%11.0%
livecodebench64.1%
math 50095.2%
mmlu pro82.5%
scicode34.7%17.4%
tau211.4%81.0%
terminalbench hard2.3%0.8%

Benchmark data from Artificial Analysis.