← All comparisons

Molmo2-8B vs GPT-4o mini

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Molmo2-8BGPT-4o mini
Intelligence Index7.312.6
Coding Index4.4
Math Index14.7
Output speed (tok/s)0.069.6
Blended price ($/1M)$0.00$0.26
Time to first token (s)0.00s0.62s
aime11.7%
aime 2514.7%
artificial analysis coding index4.40
artificial analysis intelligence index7.3012.60
artificial analysis math index14.70
gpqa42.5%42.6%
hle4.4%4.0%
ifbench26.9%31.0%
lcr0.0%
livecodebench23.4%
math 50078.9%
mmlu pro64.8%
scicode13.3%22.9%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.