← All comparisons

Olmo 3 7B Instruct vs Qwen3 VL 8B Instruct

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B InstructQwen3 VL 8B Instruct
Intelligence Index8.114.3
Coding Index3.47.3
Math Index41.327.3
Output speed (tok/s)0.0143.8
Blended price ($/1M)$0.13$0.31
Time to first token (s)0.00s0.93s
aime——
aime 2541.3%27.3%
artificial analysis coding index3.407.30
artificial analysis intelligence index8.1014.30
artificial analysis math index41.3027.30
gpqa40.0%42.7%
hle5.8%2.9%
ifbench32.8%32.3%
lcr0.0%15.3%
livecodebench26.6%33.2%
math 500——
mmlu pro52.2%68.6%
scicode10.3%17.4%
tau212.6%29.2%
terminalbench hard0.0%2.3%

Benchmark data from Artificial Analysis.