← All comparisons

Molmo 7B-D vs Hermes 4 - Llama-3.1 70B (Reasoning)

Allen Institute for AI vs Nous Research — side-by-side benchmark comparison

Molmo 7B-DHermes 4 - Llama-3.1 70B (Reasoning)
Intelligence Index9.216.0
Coding Index1.214.4
Math Index0.068.7
Output speed (tok/s)0.092.8
Blended price ($/1M)$0.00$0.20
Time to first token (s)0.00s0.64s
aime——
aime 250.0%68.7%
artificial analysis coding index1.2014.40
artificial analysis intelligence index9.2016.00
artificial analysis math index0.0%68.70
gpqa24.0%69.9%
hle5.1%7.9%
ifbench19.7%31.3%
lcr0.0%6.7%
livecodebench3.9%65.3%
math 500——
mmlu pro37.1%81.1%
scicode3.6%34.1%
tau20.0%22.5%
terminalbench hard0.0%4.5%

Benchmark data from Artificial Analysis.