← All comparisons

Claude 3 Opus vs OLMo 2 32B

Anthropic vs Allen Institute for AI — side-by-side benchmark comparison

Claude 3 OpusOLMo 2 32B
Intelligence Index18.010.6
Coding Index19.52.7
Math Index3.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$32.81$0.00
Time to first token (s)0.00s0.00s
aime3.3%
aime 253.3%
artificial analysis coding index19.502.70
artificial analysis intelligence index18.0010.60
artificial analysis math index3.30
gpqa48.9%32.8%
hle3.1%3.7%
ifbench38.1%
lcr0.0%
livecodebench27.9%6.8%
math 50064.1%
mmlu pro69.6%51.1%
scicode23.3%8.0%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.