Xentir Media Source-backed AI & tech
LIVE INTELLIGENCE · part of the Xentir AI Index

Claude 3.5 Sonnet (Oct 2024) vs Qwen2.5-Max (Qwen 2025 01 25)

Claude 3.5 Sonnet (Oct 2024) · Anthropic, released 2024-10-22
Qwen2.5-Max (Qwen 2025 01 25) · Alibaba, released 2025-01-25

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources

Head-to-head

Measured on 5 of 9 tracked benchmarks for both models — Claude 3.5 Sonnet (Oct 2024) leads on 2, Qwen2.5-Max (Qwen 2025 01 25) leads on 3.

BenchmarkClaude 3.5 Sonnet (Oct 2024) Qwen2.5-Max (Qwen 2025 01 25)Leads
Epoch Capabilities Index (ECI)134.3133.4Claude 3.5 Sonnet (Oct 2024)
SWE-bench VerifiedNot measuredNot measuredNot measured on both
GPQA Diamond0.5530.561Qwen2.5-Max (Qwen 2025 01 25)
MATH Level 50.5690.672Qwen2.5-Max (Qwen 2025 01 25)
OTIS Mock AIME 2024-20250.0850.161Qwen2.5-Max (Qwen 2025 01 25)
FrontierMath0.0210.010Claude 3.5 Sonnet (Oct 2024)
FrontierMath Tier 40.000Not measuredNot measured on both
SimpleQA VerifiedNot measuredNot measuredNot measured on both
Chess PuzzlesNot measuredNot measuredNot measured on both
Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

Full profiles

Claude 3.5 Sonnet (Oct 2024) → · Qwen2.5-Max (Qwen 2025 01 25) → · the full AI Model Rankings table