← All comparisons

Olmo 3 7B Instruct vs Qwen3 235B A22B (Non-reasoning)

Allen Institute for AI vs Alibaba — side-by-side benchmark comparison

Olmo 3 7B InstructQwen3 235B A22B (Non-reasoning)
Intelligence Index8.117.0
Coding Index3.414.0
Math Index41.323.7
Output speed (tok/s)0.060.8
Blended price ($/1M)$0.13$0.79
Time to first token (s)0.00s1.30s
aime—32.7%
aime 2541.3%23.7%
artificial analysis coding index3.4014.00
artificial analysis intelligence index8.1017.00
artificial analysis math index41.3023.70
gpqa40.0%61.3%
hle5.8%4.7%
ifbench32.8%36.6%
lcr0.0%0.0%
livecodebench26.6%34.3%
math 500—90.2%
mmlu pro52.2%76.2%
scicode10.3%29.9%
tau212.6%27.2%
terminalbench hard0.0%6.1%

Benchmark data from Artificial Analysis.