← All comparisons

Olmo 3.1 32B Think vs Apriel-v1.6-15B-Thinker

Allen Institute for AI vs ServiceNow — side-by-side benchmark comparison

Olmo 3.1 32B ThinkApriel-v1.6-15B-Thinker
Intelligence Index13.927.6
Coding Index9.822.0
Math Index77.388.0
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 2577.3%88.0%
artificial analysis coding index9.8022.00
artificial analysis intelligence index13.9027.60
artificial analysis math index77.3088.00
gpqa59.1%73.3%
hle6.0%9.8%
ifbench66.0%69.1%
lcr0.0%50.3%
livecodebench69.5%80.7%
math 500——
mmlu pro76.3%79.0%
scicode29.3%37.3%
tau20.0%69.3%
terminalbench hard0.0%14.4%

Benchmark data from Artificial Analysis.