← All benchmarks

Hermes 3 - Llama-3.1 70B

Nous Research · Released 2024-08-15 · Independent benchmark scores from Artificial Analysis

Intelligence Index
6.0
Output speed
0.0
tokens/sec
Blended price
$0.70
per 1M tokens
Time to first token
0.00s

Model metadata

Model ID1dcea4f7-7e8b-49f8-abe2-5860ff9f349e
Slughermes-3-llama-3-1-70b
Release date2024-08-15
ProviderNous Research
Provider slugnous-research
Output speed0.0 tok/s
Time to first token0.00s
Time to first answer0.00s
Blended price ($/1M)$0.70
Input price ($/1M)$0.70
Output price ($/1M)$0.70

All evaluation scores (18)

aime2.3%
aime 25—
artificial analysis coding index—
artificial analysis intelligence index6.00
artificial analysis math index—
gpqa40.1%
hle4.0%
ifbench—
lcr—
livecodebench18.8%
math 50053.8%
mmlu pro57.1%
scicode—
tau banking—
tau2—
terminalbench hard—
terminalbench v2 1—
terminalbench v4 0—

Source: artificialanalysis.ai/models/hermes-3-llama-3-1-70b

Benchmark data from Artificial Analysis.