← All comparisons

Olmo 3.1 32B Think vs Apriel-v1.5-15B-Thinker

Allen Institute for AI vs ServiceNow — side-by-side benchmark comparison

Olmo 3.1 32B ThinkApriel-v1.5-15B-Thinker
Intelligence Index13.928.3
Coding Index9.818.7
Math Index77.387.5
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 2577.3%87.5%
artificial analysis coding index9.8018.70
artificial analysis intelligence index13.9028.30
artificial analysis math index77.3087.50
gpqa59.1%71.3%
hle6.0%12.0%
ifbench66.0%61.7%
lcr0.0%20.0%
livecodebench69.5%72.8%
math 500——
mmlu pro76.3%77.3%
scicode29.3%34.8%
tau20.0%68.4%
terminalbench hard0.0%10.6%

Benchmark data from Artificial Analysis.