← All comparisons

Olmo 3 7B Think vs Grok 3 mini Reasoning (high)

Allen Institute for AI vs xAI — side-by-side benchmark comparison

Olmo 3 7B ThinkGrok 3 mini Reasoning (high)
Intelligence Index9.432.1
Coding Index7.625.2
Math Index70.784.7
Output speed (tok/s)0.056.8
Blended price ($/1M)$0.00$0.35
Time to first token (s)0.00s0.42s
aime—93.3%
aime 2570.7%84.7%
artificial analysis coding index7.6025.20
artificial analysis intelligence index9.4032.10
artificial analysis math index70.7084.70
gpqa51.6%79.1%
hle5.7%11.1%
ifbench41.5%45.9%
lcr0.0%50.3%
livecodebench61.7%69.6%
math 500—99.2%
mmlu pro65.5%82.8%
scicode21.2%40.6%
tau20.0%90.4%
terminalbench hard0.8%17.4%

Benchmark data from Artificial Analysis.