← All comparisons

Molmo 7B-D vs GPT-3.5 Turbo

Allen Institute for AI vs OpenAI — side-by-side benchmark comparison

Molmo 7B-DGPT-3.5 Turbo
Intelligence Index9.29.0
Coding Index1.210.7
Math Index0.0—
Output speed (tok/s)0.0116.9
Blended price ($/1M)$0.00$0.75
Time to first token (s)0.00s0.56s
aime——
aime 250.0%—
artificial analysis coding index1.2010.70
artificial analysis intelligence index9.209.00
artificial analysis math index0.0%—
gpqa24.0%29.7%
hle5.1%—
ifbench19.7%—
lcr0.0%—
livecodebench3.9%—
math 500—44.1%
mmlu pro37.1%46.2%
scicode3.6%—
tau20.0%—
terminalbench hard0.0%—

Benchmark data from Artificial Analysis.