← All comparisons

Claude 4 Sonnet (Non-reasoning) vs OLMo 2 32B

Anthropic vs Allen Institute for AI — side-by-side benchmark comparison

Claude 4 Sonnet (Non-reasoning)OLMo 2 32B
Intelligence Index33.010.6
Coding Index30.62.7
Math Index38.03.3
Output speed (tok/s)53.90.0
Blended price ($/1M)$6.56$0.00
Time to first token (s)0.82s0.00s
aime40.7%
aime 2538.0%3.3%
artificial analysis coding index30.602.70
artificial analysis intelligence index33.0010.60
artificial analysis math index38.003.30
gpqa68.3%32.8%
hle4.0%3.7%
ifbench45.4%38.1%
lcr44.3%0.0%
livecodebench44.9%6.8%
math 50093.4%
mmlu pro83.7%51.1%
scicode37.3%8.0%
tau252.3%0.0%
terminalbench hard27.3%0.0%

Benchmark data from Artificial Analysis.