← All comparisons

ERNIE 4.5 300B A47B vs OLMo 2 7B

Baidu vs Allen Institute for AI — side-by-side benchmark comparison

ERNIE 4.5 300B A47BOLMo 2 7B
Intelligence Index15.09.3
Coding Index14.51.2
Math Index41.30.7
Output speed (tok/s)25.70.0
Blended price ($/1M)$0.48$0.00
Time to first token (s)1.68s0.00s
aime49.3%
aime 2541.3%0.7%
artificial analysis coding index14.501.20
artificial analysis intelligence index15.009.30
artificial analysis math index41.3070.0%
gpqa81.1%28.8%
hle3.5%5.5%
ifbench39.1%24.4%
lcr2.3%0.0%
livecodebench46.7%4.1%
math 50093.1%
mmlu pro77.6%28.2%
scicode31.5%3.7%
tau20.0%0.0%
terminalbench hard6.1%0.0%

Benchmark data from Artificial Analysis.