← All comparisons

Claude 3.5 Sonnet (June '24) vs Kimi K2 0905

Anthropic vs Kimi — side-by-side benchmark comparison

Claude 3.5 Sonnet (June '24)Kimi K2 0905
Intelligence Index14.230.9
Coding Index26.025.9
Math Index57.3
Output speed (tok/s)0.024.6
Blended price ($/1M)$6.56$1.07
Time to first token (s)0.00s1.44s
aime9.7%
aime 2557.3%
artificial analysis coding index26.0025.90
artificial analysis intelligence index14.2030.90
artificial analysis math index57.30
gpqa56.0%76.7%
hle3.7%6.3%
ifbench41.7%
lcr52.3%
livecodebench61.0%
math 50069.5%
mmlu pro75.1%81.9%
scicode31.6%30.7%
tau273.4%
terminalbench hard23.5%

Benchmark data from Artificial Analysis.