← All comparisons

Molmo 7B-D vs Granite 3.3 8B (Non-reasoning)

Allen Institute for AI vs IBM — side-by-side benchmark comparison

Molmo 7B-DGranite 3.3 8B (Non-reasoning)
Intelligence Index9.27.0
Coding Index1.23.4
Math Index0.06.7
Output speed (tok/s)0.0453.9
Blended price ($/1M)$0.00$0.09
Time to first token (s)0.00s21.19s
aime—4.7%
aime 250.0%6.7%
artificial analysis coding index1.203.40
artificial analysis intelligence index9.207.00
artificial analysis math index0.0%6.70
gpqa24.0%33.8%
hle5.1%4.2%
ifbench19.7%22.4%
lcr0.0%4.3%
livecodebench3.9%12.7%
math 500—66.5%
mmlu pro37.1%46.8%
scicode3.6%10.1%
tau20.0%10.5%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.