← All comparisons

Llama 3.2 Instruct 11B (Vision) vs OLMo 2 32B

Meta vs Allen Institute for AI — side-by-side benchmark comparison

Llama 3.2 Instruct 11B (Vision)OLMo 2 32B
Intelligence Index8.710.6
Coding Index4.22.7
Math Index1.73.3
Output speed (tok/s)77.00.0
Blended price ($/1M)$0.24$0.00
Time to first token (s)0.49s0.00s
aime9.3%
aime 251.7%3.3%
artificial analysis coding index4.202.70
artificial analysis intelligence index8.7010.60
artificial analysis math index1.703.30
gpqa22.1%32.8%
hle5.2%3.7%
ifbench30.4%38.1%
lcr11.7%0.0%
livecodebench11.0%6.8%
math 50051.6%
mmlu pro46.4%51.1%
scicode11.2%8.0%
tau214.6%0.0%
terminalbench hard0.8%0.0%

Benchmark data from Artificial Analysis.