← All comparisons

Motif-2-12.7B-Reasoning vs Llama 3.1 Tulu3 405B

Motif Technologies vs Allen Institute for AI — side-by-side benchmark comparison

Motif-2-12.7B-ReasoningLlama 3.1 Tulu3 405B
Intelligence Index19.114.1
Coding Index11.9—
Math Index80.3—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime—13.3%
aime 2580.3%—
artificial analysis coding index11.90—
artificial analysis intelligence index19.1014.10
artificial analysis math index80.30—
gpqa69.5%51.6%
hle8.2%3.5%
ifbench57.0%—
lcr13.0%—
livecodebench65.1%29.1%
math 500—77.8%
mmlu pro79.6%71.6%
scicode28.2%30.2%
tau246.5%—
terminalbench hard3.8%—

Benchmark data from Artificial Analysis.