← All comparisons

Molmo2-8B vs GPT-4o (March 2025, chatgpt-4o-latest)

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Molmo2-8BGPT-4o (March 2025, chatgpt-4o-latest)
Intelligence Index7.318.6
Coding Index4.4
Math Index25.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime32.7%
aime 2525.7%
artificial analysis coding index4.40
artificial analysis intelligence index7.3018.60
artificial analysis math index25.70
gpqa42.5%65.5%
hle4.4%5.0%
ifbench26.9%
lcr0.0%
livecodebench42.5%
math 50089.3%
mmlu pro80.3%
scicode13.3%36.6%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.