← All benchmarks

Claude 3 Sonnet

Anthropic · Released 2024-03-04 · Independent benchmark scores from Artificial Analysis

Intelligence Index
5.9
Output speed
0.0
tokens/sec
Blended price
$0.00
per 1M tokens
Time to first token
0.00s

Model metadata

Model IDb2e68f0a-8f66-4e4c-9821-2b786cea601b
Slugclaude-3-sonnet
Release date2024-03-04
ProviderAnthropic
Provider sluganthropic
Output speed0.0 tok/s
Time to first token0.00s
Time to first answer0.00s
Blended price ($/1M)$0.00
Input price ($/1M)$0.00
Output price ($/1M)$0.00

All evaluation scores (18)

aime4.7%
aime 25—
artificial analysis coding index—
artificial analysis intelligence index5.90
artificial analysis math index—
gpqa40.0%
hle3.6%
ifbench—
lcr—
livecodebench17.5%
math 50041.4%
mmlu pro57.9%
scicode—
tau banking—
tau2—
terminalbench hard—
terminalbench v2 1—
terminalbench v4 0—

Source: artificialanalysis.ai/models/claude-3-sonnet

Benchmark data from Artificial Analysis.