← All comparisons

Olmo 3 7B Instruct vs GPT-5 mini (medium)

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Olmo 3 7B InstructGPT-5 mini (medium)
Intelligence Index8.138.9
Coding Index3.432.8
Math Index41.385.0
Output speed (tok/s)0.092.4
Blended price ($/1M)$0.13$0.69
Time to first token (s)0.00s16.52s
aime——
aime 2541.3%85.0%
artificial analysis coding index3.4032.80
artificial analysis intelligence index8.1038.90
artificial analysis math index41.3085.00
gpqa40.0%80.3%
hle5.8%14.6%
ifbench32.8%71.2%
lcr0.0%66.0%
livecodebench26.6%69.2%
math 500——
mmlu pro52.2%82.8%
scicode10.3%41.0%
tau212.6%71.1%
terminalbench hard0.0%28.8%

Benchmark data from Artificial Analysis.