← All comparisons

Claude 3.5 Sonnet (June '24) vs MiniMax-M2

Anthropic vs MiniMax — side-by-side benchmark comparison

Claude 3.5 Sonnet (June '24)MiniMax-M2
Intelligence Index14.236.1
Coding Index26.029.2
Math Index78.3
Output speed (tok/s)0.0116.0
Blended price ($/1M)$6.56$0.53
Time to first token (s)0.00s0.99s
aime9.7%
aime 2578.3%
artificial analysis coding index26.0029.20
artificial analysis intelligence index14.2036.10
artificial analysis math index78.30
gpqa56.0%77.7%
hle3.7%12.5%
ifbench72.3%
lcr61.0%
livecodebench82.6%
math 50069.5%
mmlu pro75.1%82.0%
scicode31.6%36.1%
tau286.8%
terminalbench hard25.8%

Benchmark data from Artificial Analysis.