← All comparisons

Claude 3.5 Sonnet (June '24) vs MiniMax-M2.1

Anthropic vs MiniMax — side-by-side benchmark comparison

Claude 3.5 Sonnet (June '24)MiniMax-M2.1
Intelligence Index14.239.4
Coding Index26.032.8
Math Index82.7
Output speed (tok/s)0.0188.8
Blended price ($/1M)$6.56$0.53
Time to first token (s)0.00s2.43s
aime9.7%
aime 2582.7%
artificial analysis coding index26.0032.80
artificial analysis intelligence index14.2039.40
artificial analysis math index82.70
gpqa56.0%83.0%
hle3.7%22.2%
ifbench69.9%
lcr59.0%
livecodebench81.0%
math 50069.5%
mmlu pro75.1%87.5%
scicode31.6%40.7%
tau285.4%
terminalbench hard28.8%

Benchmark data from Artificial Analysis.