← All comparisons

Claude 4.5 Haiku (Reasoning) vs Devstral 2

Anthropic vs Mistral — side-by-side benchmark comparison

Claude 4.5 Haiku (Reasoning)Devstral 2
Intelligence Index37.122.0
Coding Index32.623.7
Math Index83.736.7
Output speed (tok/s)142.279.9
Blended price ($/1M)$2.19$0.00
Time to first token (s)10.48s0.50s
aime
aime 2583.7%36.7%
artificial analysis coding index32.6023.70
artificial analysis intelligence index37.1022.00
artificial analysis math index83.7036.70
gpqa67.2%59.4%
hle9.7%3.6%
ifbench54.3%38.1%
lcr70.3%30.0%
livecodebench61.5%44.8%
math 500
mmlu pro76.0%76.2%
scicode43.3%33.1%
tau254.7%24.9%
terminalbench hard27.3%18.9%

Benchmark data from Artificial Analysis.