← All comparisons

Molmo2-8B vs Hermes 4 - Llama-3.1 70B (Non-reasoning)

Allen Institute for AI vs Nous Research — side-by-side benchmark comparison

Molmo2-8BHermes 4 - Llama-3.1 70B (Non-reasoning)
Intelligence Index7.312.6
Coding Index4.49.2
Math Index—11.3
Output speed (tok/s)0.094.3
Blended price ($/1M)$0.00$0.20
Time to first token (s)0.00s0.61s
aime——
aime 25—11.3%
artificial analysis coding index4.409.20
artificial analysis intelligence index7.3012.60
artificial analysis math index—11.30
gpqa42.5%49.1%
hle4.4%3.6%
ifbench26.9%29.0%
lcr0.0%2.0%
livecodebench—26.9%
math 500——
mmlu pro—66.4%
scicode13.3%27.7%
tau20.0%21.6%
terminalbench hard0.0%0.0%

Benchmark data from Artificial Analysis.