Gemini 2.5 Pro Preview (May 2025) · Google DeepMind, released 2025-05-06
o1 · OpenAI, released 2024-12-17
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources
Measured on 3 of 9 tracked benchmarks for both models — Gemini 2.5 Pro Preview (May 2025) leads on 2, o1 leads on 1.
| Benchmark | Gemini 2.5 Pro Preview (May 2025) | o1 | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 142.9 | 142.7 | Gemini 2.5 Pro Preview (May 2025) |
| SWE-bench Verified | Not measured | Not measured | Not measured on both |
| GPQA Diamond | 0.667 | 0.768 (high) | o1 |
| MATH Level 5 | 0.959 | 0.947 (high) | Gemini 2.5 Pro Preview (May 2025) |
| OTIS Mock AIME 2024-2025 | Not measured | 0.733 (medium) | Not measured on both |
| FrontierMath | Not measured | 0.093 (high) | Not measured on both |
| FrontierMath Tier 4 | Not measured | Not measured | Not measured on both |
| SimpleQA Verified | Not measured | Not measured | Not measured on both |
| Chess Puzzles | Not measured | Not measured | Not measured on both |
Gemini 2.5 Pro Preview (May 2025) → · o1 → · the full AI Model Rankings table