← All comparisons

Step 3.5 Flash vs OLMo 2 32B

StepFun vs Allen Institute for AI — side-by-side benchmark comparison

Step 3.5 FlashOLMo 2 32B
Intelligence Index37.810.6
Coding Index31.62.7
Math Index3.3
Output speed (tok/s)167.40.0
Blended price ($/1M)$0.15$0.00
Time to first token (s)0.91s0.00s
aime
aime 253.3%
artificial analysis coding index31.602.70
artificial analysis intelligence index37.8010.60
artificial analysis math index3.30
gpqa83.1%32.8%
hle19.1%3.7%
ifbench64.6%38.1%
lcr43.0%0.0%
livecodebench6.8%
math 500
mmlu pro51.1%
scicode40.4%8.0%
tau294.4%0.0%
terminalbench hard27.3%0.0%

Benchmark data from Artificial Analysis.