Gemini 1.5 Flash (002) · Google DeepMind, released 2024-09-24
Llama 4 Scout OPEN WEIGHTS · Meta AI, released 2025-04-05
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources
Measured on 5 of 9 tracked benchmarks for both models — Gemini 1.5 Flash (002) leads on 1, Llama 4 Scout leads on 3, tied on 1.
| Benchmark | Gemini 1.5 Flash (002) | Llama 4 Scout | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 130.4 | 130.5 | Llama 4 Scout |
| SWE-bench Verified | Not measured | Not measured | Not measured on both |
| GPQA Diamond | 0.473 | 0.518 | Llama 4 Scout |
| MATH Level 5 | 0.619 | 0.623 | Llama 4 Scout |
| OTIS Mock AIME 2024-2025 | 0.163 | 0.078 | Gemini 1.5 Flash (002) |
| FrontierMath | 0.000 | 0.000 | Tied |
| FrontierMath Tier 4 | Not measured | Not measured | Not measured on both |
| SimpleQA Verified | Not measured | Not measured | Not measured on both |
| Chess Puzzles | Not measured | Not measured | Not measured on both |
Gemini 1.5 Flash (002) → · Llama 4 Scout → · the full AI Model Rankings table