← All comparisons

GPT-4.1 vs OLMo 2 7B

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-4.1OLMo 2 7B
Intelligence Index26.39.3
Coding Index21.81.2
Math Index34.70.7
Output speed (tok/s)137.80.0
Blended price ($/1M)$3.50$0.00
Time to first token (s)0.58s0.00s
aime43.7%
aime 2534.7%0.7%
artificial analysis coding index21.801.20
artificial analysis intelligence index26.309.30
artificial analysis math index34.7070.0%
gpqa66.6%28.8%
hle4.6%5.5%
ifbench43.0%24.4%
lcr61.0%0.0%
livecodebench45.7%4.1%
math 50091.3%
mmlu pro80.6%28.2%
scicode38.1%3.7%
tau247.1%0.0%
terminalbench hard13.6%0.0%

Benchmark data from Artificial Analysis.