← All comparisons

Olmo 3 7B Instruct vs Llama 3.1 Instruct 70B

Allen Institute for AI vs Meta — side-by-side benchmark comparison

Olmo 3 7B InstructLlama 3.1 Instruct 70B
Intelligence Index8.112.5
Coding Index3.410.9
Math Index41.34.0
Output speed (tok/s)0.035.3
Blended price ($/1M)$0.13$0.56
Time to first token (s)0.00s0.54s
aime—17.3%
aime 2541.3%4.0%
artificial analysis coding index3.4010.90
artificial analysis intelligence index8.1012.50
artificial analysis math index41.304.00
gpqa40.0%40.9%
hle5.8%4.6%
ifbench32.8%34.4%
lcr0.0%6.3%
livecodebench26.6%23.2%
math 500—64.9%
mmlu pro52.2%67.6%
scicode10.3%26.7%
tau212.6%15.2%
terminalbench hard0.0%3.0%

Benchmark data from Artificial Analysis.