← All comparisons

Olmo 3 7B Instruct vs Grok Code Fast 1

Allen Institute for AI vs xAI — side-by-side benchmark comparison

Olmo 3 7B InstructGrok Code Fast 1
Intelligence Index8.128.7
Coding Index3.423.7
Math Index41.343.3
Output speed (tok/s)0.00.0
Blended price ($/1M)$0.13$0.00
Time to first token (s)0.00s0.00s
aime——
aime 2541.3%43.3%
artificial analysis coding index3.4023.70
artificial analysis intelligence index8.1028.70
artificial analysis math index41.3043.30
gpqa40.0%72.7%
hle5.8%7.5%
ifbench32.8%41.4%
lcr0.0%48.3%
livecodebench26.6%65.7%
math 500——
mmlu pro52.2%79.3%
scicode10.3%36.2%
tau212.6%75.7%
terminalbench hard0.0%17.4%

Benchmark data from Artificial Analysis.