← All comparisons

Claude 3.5 Sonnet (Oct '24) vs MiniMax-M2.5

Anthropic vs MiniMax — side-by-side benchmark comparison

Claude 3.5 Sonnet (Oct '24)MiniMax-M2.5
Intelligence Index15.941.9
Coding Index30.237.4
Math Index
Output speed (tok/s)0.0190.8
Blended price ($/1M)$6.56$0.53
Time to first token (s)0.00s2.38s
aime15.7%
aime 25
artificial analysis coding index30.2037.40
artificial analysis intelligence index15.9041.90
artificial analysis math index
gpqa59.9%84.8%
hle3.9%19.1%
ifbench71.6%
lcr66.0%
livecodebench38.1%
math 50077.1%
mmlu pro77.2%
scicode36.6%42.6%
tau295.3%
terminalbench hard34.8%

Benchmark data from Artificial Analysis.