← All comparisons

Solar Pro 2 (Non-reasoning) vs Claude 3.5 Sonnet (Oct '24)

Upstage vs Anthropic — side-by-side benchmark comparison

Solar Pro 2 (Non-reasoning)Claude 3.5 Sonnet (Oct '24)
Intelligence Index13.615.9
Coding Index11.330.2
Math Index30.0
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$6.56
Time to first token (s)0.00s0.00s
aime40.7%15.7%
aime 2530.0%
artificial analysis coding index11.3030.20
artificial analysis intelligence index13.6015.90
artificial analysis math index30.00
gpqa56.1%59.9%
hle3.8%3.9%
ifbench33.7%
lcr0.0%
livecodebench42.4%38.1%
math 50088.9%77.1%
mmlu pro75.0%77.2%
scicode24.8%36.6%
tau231.9%
terminalbench hard4.5%

Benchmark data from Artificial Analysis.