← All comparisons

GPT-4 Turbo vs Olmo 3 32B Think

OpenAI vs Allen Institute for AI — side-by-side benchmark comparison

GPT-4 TurboOlmo 3 32B Think
Intelligence Index13.712.1
Coding Index21.510.5
Math Index—73.7
Output speed (tok/s)25.80.0
Blended price ($/1M)$15.00$0.00
Time to first token (s)1.58s0.00s
aime15.0%—
aime 25—73.7%
artificial analysis coding index21.5010.50
artificial analysis intelligence index13.7012.10
artificial analysis math index—73.70
gpqa—61.0%
hle3.3%5.9%
ifbench—49.1%
lcr—0.0%
livecodebench29.1%67.2%
math 50073.7%—
mmlu pro69.4%75.9%
scicode31.9%28.6%
tau2—0.0%
terminalbench hard—1.5%

Benchmark data from Artificial Analysis.