Claude 3.5 Sonnet (Oct 2024) · Anthropic, released 2024-10-22
Qwen2.5-Max (Qwen 2025 01 25) · Alibaba, released 2025-01-25
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources
Measured on 5 of 9 tracked benchmarks for both models — Claude 3.5 Sonnet (Oct 2024) leads on 2, Qwen2.5-Max (Qwen 2025 01 25) leads on 3.
| Benchmark | Claude 3.5 Sonnet (Oct 2024) | Qwen2.5-Max (Qwen 2025 01 25) | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 134.3 | 133.4 | Claude 3.5 Sonnet (Oct 2024) |
| SWE-bench Verified | Not measured | Not measured | Not measured on both |
| GPQA Diamond | 0.553 | 0.561 | Qwen2.5-Max (Qwen 2025 01 25) |
| MATH Level 5 | 0.569 | 0.672 | Qwen2.5-Max (Qwen 2025 01 25) |
| OTIS Mock AIME 2024-2025 | 0.085 | 0.161 | Qwen2.5-Max (Qwen 2025 01 25) |
| FrontierMath | 0.021 | 0.010 | Claude 3.5 Sonnet (Oct 2024) |
| FrontierMath Tier 4 | 0.000 | Not measured | Not measured on both |
| SimpleQA Verified | Not measured | Not measured | Not measured on both |
| Chess Puzzles | Not measured | Not measured | Not measured on both |
Claude 3.5 Sonnet (Oct 2024) → · Qwen2.5-Max (Qwen 2025 01 25) → · the full AI Model Rankings table