← All comparisons

Claude 3 Sonnet vs OLMo 2 32B

Anthropic vs Allen Institute for AI — side-by-side benchmark comparison

Claude 3 SonnetOLMo 2 32B
Intelligence Index10.310.6
Coding Index2.7
Math Index3.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$6.00$0.00
Time to first token (s)0.00s0.00s
aime4.7%
aime 253.3%
artificial analysis coding index2.70
artificial analysis intelligence index10.3010.60
artificial analysis math index3.30
gpqa40.0%32.8%
hle3.8%3.7%
ifbench38.1%
lcr0.0%
livecodebench17.5%6.8%
math 50041.4%
mmlu pro57.9%51.1%
scicode22.9%8.0%
tau20.0%
terminalbench hard0.0%

Benchmark data from Artificial Analysis.