← All comparisons

Molmo2-8B vs GPT-4

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Molmo2-8BGPT-4
Intelligence Index7.312.8
Coding Index4.413.1
Math Index
Output speed (tok/s)0.035.8
Blended price ($/1M)$0.00$37.50
Time to first token (s)0.00s0.79s
aime
aime 25
artificial analysis coding index4.4013.10
artificial analysis intelligence index7.3012.80
artificial analysis math index
gpqa42.5%
hle4.4%
ifbench26.9%
lcr0.0%
livecodebench
math 500
mmlu pro
scicode13.3%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.