← All comparisons

GPT-5.4 (Non-reasoning) vs Claude 3.5 Sonnet (June '24)

OpenAI vs Anthropic — side-by-side benchmark comparison

GPT-5.4 (Non-reasoning)Claude 3.5 Sonnet (June '24)
Intelligence Index35.414.2
Coding Index41.026.0
Math Index
Output speed (tok/s)70.90.0
Blended price ($/1M)$5.63$6.56
Time to first token (s)0.60s0.00s
aime9.7%
aime 25
artificial analysis coding index41.0026.00
artificial analysis intelligence index35.4014.20
artificial analysis math index
gpqa74.8%56.0%
hle10.6%3.7%
ifbench48.4%
lcr47.3%
livecodebench
math 50069.5%
mmlu pro75.1%
scicode47.1%31.6%
tau235.1%
terminalbench hard37.9%

Benchmark data from Artificial Analysis.