← All comparisons

Molmo2-8B vs Llama 3.1 Tulu3 405B

Allen Institute for AI vs Allen Institute for AI — side-by-side benchmark comparison

Molmo2-8BLlama 3.1 Tulu3 405B
Intelligence Index7.314.1
Coding Index4.4
Math Index
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime13.3%
aime 25
artificial analysis coding index4.40
artificial analysis intelligence index7.3014.10
artificial analysis math index
gpqa42.5%51.6%
hle4.4%3.5%
ifbench26.9%
lcr0.0%
livecodebench29.1%
math 50077.8%
mmlu pro71.6%
scicode13.3%30.2%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.