← All comparisons

Olmo 3.1 32B Instruct vs GPT-4.1 mini

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Olmo 3.1 32B InstructGPT-4.1 mini
Intelligence Index12.222.9
Coding Index5.618.5
Math Index—46.3
Output speed (tok/s)0.095.1
Blended price ($/1M)$0.00$0.70
Time to first token (s)0.00s0.59s
aime—43.0%
aime 25—46.3%
artificial analysis coding index5.6018.50
artificial analysis intelligence index12.2022.90
artificial analysis math index—46.30
gpqa53.9%66.4%
hle4.9%4.6%
ifbench39.2%38.3%
lcr0.0%42.3%
livecodebench—48.3%
math 500—92.5%
mmlu pro—78.1%
scicode16.7%40.4%
tau221.3%52.9%
terminalbench hard0.0%7.6%

Benchmark data from Artificial Analysis.