← All comparisons

ERNIE 4.5 300B A47B vs OLMo 2 32B

Baidu vs Allen Institute for AI — side-by-side benchmark comparison

ERNIE 4.5 300B A47BOLMo 2 32B
Intelligence Index15.010.6
Coding Index14.52.7
Math Index41.33.3
Output speed (tok/s)25.70.0
Blended price ($/1M)$0.48$0.00
Time to first token (s)1.68s0.00s
aime49.3%
aime 2541.3%3.3%
artificial analysis coding index14.502.70
artificial analysis intelligence index15.0010.60
artificial analysis math index41.303.30
gpqa81.1%32.8%
hle3.5%3.7%
ifbench39.1%38.1%
lcr2.3%0.0%
livecodebench46.7%6.8%
math 50093.1%
mmlu pro77.6%51.1%
scicode31.5%8.0%
tau20.0%0.0%
terminalbench hard6.1%0.0%

Benchmark data from Artificial Analysis.