← All comparisons

Claude 3.5 Sonnet (Oct '24) vs DeepSeek-Coder-V2

Anthropic vs DeepSeek — side-by-side benchmark comparison

Claude 3.5 Sonnet (Oct '24)DeepSeek-Coder-V2
Intelligence Index15.910.6
Coding Index30.2—
Math Index——
Output speed (tok/s)0.00.0
Blended price ($/1M)$6.56$0.00
Time to first token (s)0.00s0.00s
aime15.7%—
aime 25——
artificial analysis coding index30.20—
artificial analysis intelligence index15.9010.60
artificial analysis math index——
gpqa59.9%—
hle3.9%—
ifbench——
lcr——
livecodebench38.1%—
math 50077.1%74.3%
mmlu pro77.2%—
scicode36.6%—
tau2——
terminalbench hard——

Benchmark data from Artificial Analysis.