← All comparisons

Claude 3.5 Sonnet (Oct '24) vs MiniMax-M2.1

Anthropic vs MiniMax — side-by-side benchmark comparison

Claude 3.5 Sonnet (Oct '24)MiniMax-M2.1
Intelligence Index15.939.4
Coding Index30.232.8
Math Index82.7
Output speed (tok/s)0.0188.8
Blended price ($/1M)$6.56$0.53
Time to first token (s)0.00s2.43s
aime15.7%
aime 2582.7%
artificial analysis coding index30.2032.80
artificial analysis intelligence index15.9039.40
artificial analysis math index82.70
gpqa59.9%83.0%
hle3.9%22.2%
ifbench69.9%
lcr59.0%
livecodebench38.1%81.0%
math 50077.1%
mmlu pro77.2%87.5%
scicode36.6%40.7%
tau285.4%
terminalbench hard28.8%

Benchmark data from Artificial Analysis.