← All comparisons

Olmo 3 7B Think vs o1-mini

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Olmo 3 7B Thinko1-mini
Intelligence Index9.420.4
Coding Index7.6
Math Index70.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime60.3%
aime 2570.7%
artificial analysis coding index7.60
artificial analysis intelligence index9.4020.40
artificial analysis math index70.70
gpqa51.6%60.3%
hle5.7%4.9%
ifbench41.5%
lcr0.0%
livecodebench61.7%57.6%
math 50094.4%
mmlu pro65.5%74.2%
scicode21.2%32.3%
tau20.0%
terminalbench hard0.8%

Benchmark data from Artificial Analysis.