Xentir Claude 3.5 Sonnet vs GPT-4o (Nov 2024)
Claude 3.5 Sonnet · Anthropic, released 2024-06-20
GPT-4o (Nov 2024) · OpenAI, released 2024-11-20
“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-09-09 · Methodology · Data Sources
Claude 3.5 Sonnet leads on more of the 5 benchmarks where both are measured — Claude 3.5 Sonnet on 5. The remaining 4 of 9 tracked benchmarks cannot be compared: 2 have a result for only one of the two models, 2 for neither. Nothing on this page is estimated to fill those in.
Head-to-head
Measured on 5 of 9 tracked benchmarks for both models — Claude 3.5 Sonnet leads on 5.
| Benchmark | Claude 3.5 Sonnet | GPT-4o (Nov 2024) | Leads |
|---|---|---|---|
| Epoch Capabilities Index (ECI) | 130.0 | 128.8 | Claude 3.5 Sonnet |
| SWE-bench Verified | Not measured | 0.310 | Comparison unavailable — Claude 3.5 Sonnet has no published result |
| GPQA Diamond | 0.540 | 0.479 | Claude 3.5 Sonnet |
| MATH Level 5 | 0.517 | 0.498 | Claude 3.5 Sonnet |
| OTIS Mock AIME 2024-2025 | 0.065 | 0.062 | Claude 3.5 Sonnet |
| FrontierMath | 0.010 | 0.003 | Claude 3.5 Sonnet |
| FrontierMath Tier 4 | 0.000 | Not measured | Comparison unavailable — GPT-4o (Nov 2024) has no published result |
| SimpleQA Verified | Not measured | Not measured | Not measured on both |
| Chess Puzzles | Not measured | Not measured | Not measured on both |
What remains uncertain
- Claude 3.5 Sonnet has no published result on SWE-bench Verified.
- GPT-4o (Nov 2024) has no published result on FrontierMath Tier 4.
- 2 tracked benchmarks have no published result for either model.
A missing result means Xentir has not found one published by the source it cites, not that the model performs badly. See Data Sources.
Full profiles
Claude 3.5 Sonnet → · GPT-4o (Nov 2024) → · the full AI Model Rankings table