← All comparisons

Molmo 7B-D vs o4-mini (high)

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Molmo 7B-Do4-mini (high)
Intelligence Index9.233.1
Coding Index1.225.6
Math Index0.090.7
Output speed (tok/s)0.0160.5
Blended price ($/1M)$0.00$1.93
Time to first token (s)0.00s23.07s
aime—94.0%
aime 250.0%90.7%
artificial analysis coding index1.2025.60
artificial analysis intelligence index9.2033.10
artificial analysis math index0.0%90.70
gpqa24.0%78.4%
hle5.1%17.5%
ifbench19.7%68.7%
lcr0.0%55.0%
livecodebench3.9%85.9%
math 500—98.9%
mmlu pro37.1%83.2%
scicode3.6%46.5%
tau20.0%55.6%
terminalbench hard0.0%15.2%

Benchmark data from Artificial Analysis.