← All comparisons

Claude 3.5 Sonnet (June '24) vs Kimi K2.5 (Non-reasoning)

Anthropic vs Kimi — side-by-side benchmark comparison

Claude 3.5 Sonnet (June '24)Kimi K2.5 (Non-reasoning)
Intelligence Index14.237.3
Coding Index26.025.8
Math Index
Output speed (tok/s)0.033.5
Blended price ($/1M)$6.56$1.20
Time to first token (s)0.00s1.23s
aime9.7%
aime 25
artificial analysis coding index26.0025.80
artificial analysis intelligence index14.2037.30
artificial analysis math index
gpqa56.0%78.9%
hle3.7%12.3%
ifbench43.7%
lcr59.0%
livecodebench
math 50069.5%
mmlu pro75.1%
scicode31.6%39.6%
tau281.3%
terminalbench hard18.9%

Benchmark data from Artificial Analysis.