← All comparisons

Olmo 3 7B Instruct vs GPT-5 mini (high)

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Olmo 3 7B InstructGPT-5 mini (high)
Intelligence Index8.141.2
Coding Index3.435.3
Math Index41.390.7
Output speed (tok/s)0.096.1
Blended price ($/1M)$0.13$0.69
Time to first token (s)0.00s77.65s
aime
aime 2541.3%90.7%
artificial analysis coding index3.4035.30
artificial analysis intelligence index8.1041.20
artificial analysis math index41.3090.70
gpqa40.0%82.8%
hle5.8%19.7%
ifbench32.8%75.4%
lcr0.0%68.0%
livecodebench26.6%83.8%
math 500
mmlu pro52.2%83.7%
scicode10.3%39.2%
tau212.6%68.4%
terminalbench hard0.0%33.3%

Benchmark data from Artificial Analysis.