← All comparisons

gpt-oss-20B (high) vs Claude 3.5 Sonnet (Oct '24)

OpenAI vs Anthropic — side-by-side benchmark comparison

gpt-oss-20B (high)Claude 3.5 Sonnet (Oct '24)
Intelligence Index24.515.9
Coding Index18.530.2
Math Index89.3
Output speed (tok/s)267.00.0
Blended price ($/1M)$0.09$6.56
Time to first token (s)0.42s0.00s
aime15.7%
aime 2589.3%
artificial analysis coding index18.5030.20
artificial analysis intelligence index24.5015.90
artificial analysis math index89.30
gpqa68.8%59.9%
hle9.8%3.9%
ifbench65.1%
lcr30.7%
livecodebench77.7%38.1%
math 50077.1%
mmlu pro74.8%77.2%
scicode34.4%36.6%
tau260.2%
terminalbench hard10.6%

Benchmark data from Artificial Analysis.