← All comparisons

GPT-5.4 mini (medium) vs OLMo 2 7B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-5.4 mini (medium)OLMo 2 7B
Intelligence Index37.79.3
Coding Index37.51.2
Math Index—0.7
Output speed (tok/s)178.70.0
Blended price ($/1M)$1.69$0.00
Time to first token (s)4.02s0.00s
aime——
aime 25—0.7%
artificial analysis coding index37.501.20
artificial analysis intelligence index37.709.30
artificial analysis math index—70.0%
gpqa82.3%28.8%
hle17.1%5.5%
ifbench64.8%24.4%
lcr61.3%0.0%
livecodebench—4.1%
math 500——
mmlu pro—28.2%
scicode44.2%3.7%
tau236.5%0.0%
terminalbench hard34.1%0.0%

Benchmark data from Artificial Analysis.