← All comparisons

Molmo 7B-D vs Olmo 3 7B Think

Allen Institute for AI vs Allen Institute for AI — side-by-side benchmark comparison

Molmo 7B-DOlmo 3 7B Think
Intelligence Index9.29.4
Coding Index1.27.6
Math Index0.070.7
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 250.0%70.7%
artificial analysis coding index1.207.60
artificial analysis intelligence index9.209.40
artificial analysis math index0.0%70.70
gpqa24.0%51.6%
hle5.1%5.7%
ifbench19.7%41.5%
lcr0.0%0.0%
livecodebench3.9%61.7%
math 500——
mmlu pro37.1%65.5%
scicode3.6%21.2%
tau20.0%0.0%
terminalbench hard0.0%0.8%

Benchmark data from Artificial Analysis.