← All comparisons

Olmo 3 7B Think vs Granite 4.0 H Small

Allen Institute for AI vs IBM — side-by-side benchmark comparison

Olmo 3 7B ThinkGranite 4.0 H Small
Intelligence Index9.410.8
Coding Index7.68.5
Math Index70.713.7
Output speed (tok/s)0.0401.2
Blended price ($/1M)$0.00$0.11
Time to first token (s)0.00s8.75s
aime——
aime 2570.7%13.7%
artificial analysis coding index7.608.50
artificial analysis intelligence index9.4010.80
artificial analysis math index70.7013.70
gpqa51.6%41.6%
hle5.7%3.7%
ifbench41.5%31.5%
lcr0.0%9.0%
livecodebench61.7%25.1%
math 500——
mmlu pro65.5%62.4%
scicode21.2%20.9%
tau20.0%17.3%
terminalbench hard0.8%2.3%

Benchmark data from Artificial Analysis.