← All comparisons

GPT-4.1 mini vs OLMo 2 7B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-4.1 miniOLMo 2 7B
Intelligence Index22.99.3
Coding Index18.51.2
Math Index46.30.7
Output speed (tok/s)95.10.0
Blended price ($/1M)$0.70$0.00
Time to first token (s)0.59s0.00s
aime43.0%
aime 2546.3%0.7%
artificial analysis coding index18.501.20
artificial analysis intelligence index22.909.30
artificial analysis math index46.3070.0%
gpqa66.4%28.8%
hle4.6%5.5%
ifbench38.3%24.4%
lcr42.3%0.0%
livecodebench48.3%4.1%
math 50092.5%
mmlu pro78.1%28.2%
scicode40.4%3.7%
tau252.9%0.0%
terminalbench hard7.6%0.0%

Benchmark data from Artificial Analysis.