← All comparisons

Claude 3.5 Sonnet (Oct '24) vs MiMo-V2-Pro

Anthropic vs Xiaomi — side-by-side benchmark comparison

Claude 3.5 Sonnet (Oct '24)MiMo-V2-Pro
Intelligence Index15.949.2
Coding Index30.241.4
Math Index——
Output speed (tok/s)0.054.5
Blended price ($/1M)$6.56$1.50
Time to first token (s)0.00s1.77s
aime15.7%—
aime 25——
artificial analysis coding index30.2041.40
artificial analysis intelligence index15.9049.20
artificial analysis math index——
gpqa59.9%87.0%
hle3.9%28.3%
ifbench—68.8%
lcr—60.7%
livecodebench38.1%—
math 50077.1%—
mmlu pro77.2%—
scicode36.6%42.5%
tau2—95.0%
terminalbench hard—40.9%

Benchmark data from Artificial Analysis.