Xentir Grok 4 vs o3
Grok 4 · xAI, released 2025-07-09
o3 · OpenAI, released 2025-04-16
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-09-09 · Methodology · Data Sources
o3 leads on more of the 6 benchmarks where both are measured — Grok 4 on 2, o3 on 3, tied on 1. The remaining 3 of 9 tracked benchmarks cannot be compared: 3 have a result for only one of the two models, 0 for neither. Nothing on this page is estimated to fill those in.
Head-to-head
Measured on 6 of 9 tracked benchmarks for both models — Grok 4 leads on 2, o3 leads on 3, tied on 1.
| Benchmark | Grok 4 | o3 | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 146.4 | 146.9 | o3 |
| SWE-bench Verified | Not measured | 0.623 (medium) | Comparison unavailable — Grok 4 has no published result |
| GPQA Diamond | 0.870 | 0.818 (high) | Grok 4 |
| MATH Level 5 | Not measured | 0.978 (high) | Comparison unavailable — Grok 4 has no published result |
| OTIS Mock AIME 2024-2025 | 0.840 | 0.844 (medium) | o3 |
| FrontierMath | 0.197 | 0.187 (high) | Grok 4 |
| FrontierMath Tier 4 | 0.021 | 0.021 (high) | Tied |
| SimpleQA Verified | Not measured | 0.494 (high) | Comparison unavailable — Grok 4 has no published result |
| Chess Puzzles | 0.280 | 0.380 (medium) | o3 |
What remains uncertain
- Grok 4 has no published result on MATH Level 5, SWE-bench Verified, SimpleQA Verified.
A missing result means Xentir has not found one published by the source it cites, not that the model performs badly. See Data Sources.
Reference price
| Per 1M tokens | Grok 4 | o3 |
|---|---|---|
| Output | — | $8.00 |
List price as published by the vendor. Xentir does not verify negotiated or enterprise rates, and price is not a measure of capability — see Data Sources.