← All benchmarks

DeepSeek V3 (Dec '24)

DeepSeek · Released 2024-12-26 · Independent benchmark scores from Artificial Analysis

Intelligence Index
14.2
Output speed
0.0
tokens/sec
Blended price
$0.49
per 1M tokens
Time to first token
0.00s

Model metadata

Model ID43fc5506-c5ed-4dee-9b85-962bf7ae3986
Slugdeepseek-v3
Release date2024-12-26
ProviderDeepSeek
Provider slugdeepseek
Output speed0.0 tok/s
Time to first token0.00s
Time to first answer0.00s
Blended price ($/1M)$0.49
Input price ($/1M)$0.36
Output price ($/1M)$0.89

All evaluation scores (17)

aime25.3%
aime 2526.0%
artificial analysis coding index23.00
artificial analysis intelligence index14.20
artificial analysis math index26.00
gpqa55.7%
hle3.6%
ifbench34.8%
lcr29.0%
livecodebench35.9%
math 50088.7%
mmlu pro75.2%
scicode35.4%
tau banking4.7%
tau222.8%
terminalbench hard6.8%
terminalbench v2 116.9%

Source: artificialanalysis.ai/models/deepseek-v3

Benchmark data from Artificial Analysis.