← All comparisons

Llama 3.1 Nemotron Instruct 70B vs DeepSeek V3 (Dec '24)

NVIDIA vs DeepSeek — side-by-side benchmark comparison

Llama 3.1 Nemotron Instruct 70BDeepSeek V3 (Dec '24)
Intelligence Index13.416.5
Coding Index10.816.4
Math Index11.026.0
Output speed (tok/s)292.90.0
Blended price ($/1M)$1.20$0.52
Time to first token (s)0.24s0.00s
aime24.7%25.3%
aime 2511.0%26.0%
artificial analysis coding index10.8016.40
artificial analysis intelligence index13.4016.50
artificial analysis math index11.0026.00
gpqa46.5%55.7%
hle4.6%3.6%
ifbench30.7%34.8%
lcr7.0%29.0%
livecodebench16.9%35.9%
math 50073.3%88.7%
mmlu pro69.0%75.2%
scicode23.3%35.4%
tau223.1%22.8%
terminalbench hard4.5%6.8%

Benchmark data from Artificial Analysis.