← All comparisons

Claude 3.5 Sonnet (Oct '24) vs Solar Mini

Anthropic vs Upstage — side-by-side benchmark comparison

Claude 3.5 Sonnet (Oct '24)Solar Mini
Intelligence Index15.911.9
Coding Index30.2
Math Index
Output speed (tok/s)0.068.0
Blended price ($/1M)$6.56$0.15
Time to first token (s)0.00s0.77s
aime15.7%
aime 25
artificial analysis coding index30.20
artificial analysis intelligence index15.9011.90
artificial analysis math index
gpqa59.9%
hle3.9%
ifbench
lcr
livecodebench38.1%
math 50077.1%33.1%
mmlu pro77.2%
scicode36.6%
tau220.2%
terminalbench hard

Benchmark data from Artificial Analysis.