← All comparisons

Olmo 3 7B Think vs Nanbeige4.1-3B

Allen Institute for AI vs Nanbeige — side-by-side benchmark comparison

Olmo 3 7B ThinkNanbeige4.1-3B
Intelligence Index9.416.1
Coding Index7.68.9
Math Index70.7—
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.00$0.00
Time to first token (s)0.00s0.00s
aime——
aime 2570.7%—
artificial analysis coding index7.608.90
artificial analysis intelligence index9.4016.10
artificial analysis math index70.70—
gpqa51.6%84.9%
hle5.7%10.0%
ifbench41.5%35.4%
lcr0.0%0.0%
livecodebench61.7%—
math 500——
mmlu pro65.5%—
scicode21.2%26.6%
tau20.0%21.6%
terminalbench hard0.8%0.0%

Benchmark data from Artificial Analysis.