← All comparisons

Olmo 3 7B Instruct vs Qwen3 VL 235B A22B (Reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B InstructQwen3 VL 235B A22B (Reasoning)
Intelligence Index8.127.6
Coding Index3.420.9
Math Index41.388.3
Output speed (tok/s)0.035.6
Blended price ($/1M)$0.13$2.17
Time to first token (s)0.00s5.14s
aime——
aime 2541.3%88.3%
artificial analysis coding index3.4020.90
artificial analysis intelligence index8.1027.60
artificial analysis math index41.3088.30
gpqa40.0%77.2%
hle5.8%10.1%
ifbench32.8%56.5%
lcr0.0%58.7%
livecodebench26.6%64.6%
math 500——
mmlu pro52.2%83.6%
scicode10.3%39.9%
tau212.6%54.1%
terminalbench hard0.0%11.4%

Benchmark data from Artificial Analysis.