← All comparisons

Claude 4.5 Haiku (Reasoning) vs Llama 3.1 Instruct 70B

Anthropic vs Meta — side-by-side benchmark comparison

Claude 4.5 Haiku (Reasoning)Llama 3.1 Instruct 70B
Intelligence Index37.112.5
Coding Index32.610.9
Math Index83.74.0
Output speed (tok/s)142.235.3
Blended price ($/1M)$2.19$0.56
Time to first token (s)10.48s0.54s
aime17.3%
aime 2583.7%4.0%
artificial analysis coding index32.6010.90
artificial analysis intelligence index37.1012.50
artificial analysis math index83.704.00
gpqa67.2%40.9%
hle9.7%4.6%
ifbench54.3%34.4%
lcr70.3%6.3%
livecodebench61.5%23.2%
math 50064.9%
mmlu pro76.0%67.6%
scicode43.3%26.7%
tau254.7%15.2%
terminalbench hard27.3%3.0%

Benchmark data from Artificial Analysis.