← All comparisons

Magistral Medium 1 vs Llama 3.1 Tulu3 405B

Mistral vs Allen Institute for AI — side-by-side benchmark comparison

Magistral Medium 1Llama 3.1 Tulu3 405B
Intelligence Index18.814.1
Coding Index16.0—
Math Index40.3—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime70.0%13.3%
aime 2540.3%—
artificial analysis coding index16.00—
artificial analysis intelligence index18.8014.10
artificial analysis math index40.30—
gpqa67.9%51.6%
hle9.5%3.5%
ifbench25.1%—
lcr0.0%—
livecodebench52.7%29.1%
math 50091.7%77.8%
mmlu pro75.3%71.6%
scicode29.7%30.2%
tau223.1%—
terminalbench hard9.1%—

Benchmark data from Artificial Analysis.