← All comparisons

Claude 3.5 Sonnet (June '24) vs MiniMax M1 40k

Anthropic vs MiniMax — side-by-side benchmark comparison

Claude 3.5 Sonnet (June '24)MiniMax M1 40k
Intelligence Index14.220.9
Coding Index26.014.1
Math Index13.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$6.56$0.00
Time to first token (s)0.00s0.00s
aime9.7%81.3%
aime 2513.7%
artificial analysis coding index26.0014.10
artificial analysis intelligence index14.2020.90
artificial analysis math index13.70
gpqa56.0%68.2%
hle3.7%7.5%
ifbench41.2%
lcr51.7%
livecodebench65.7%
math 50069.5%97.2%
mmlu pro75.1%80.8%
scicode31.6%37.8%
tau231.6%
terminalbench hard2.3%

Benchmark data from Artificial Analysis.