LIVE INTELLIGENCE · part of the Xentir AI Index

Claude 3.7 Sonnet vs o3-mini

Name: Claude 3.7 Sonnet vs o3-mini — benchmark results
Creator: Epoch AI
License: https://creativecommons.org/licenses/by/4.0/

Claude 3.7 Sonnet · Anthropic, released 2025-02-24
o3-mini · OpenAI, released 2025-01-31

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-09-09 · Methodology · Data Sources

o3-mini leads on more of the 5 benchmarks where both are measured — Claude 3.7 Sonnet on 2, o3-mini on 3. The remaining 4 of 9 tracked benchmarks cannot be compared: 4 have a result for only one of the two models, 0 for neither. Nothing on this page is estimated to fill those in.

Head-to-head

Measured on 5 of 9 tracked benchmarks for both models — Claude 3.7 Sonnet leads on 2, o3-mini leads on 3.

Benchmark	Claude 3.7 Sonnet	o3-mini	Leads
Epoch Capabilities Index (ECI)	141.2	140.4	Claude 3.7 Sonnet
SWE-bench Verified	0.610	Not measured	Comparison unavailable — o3-mini has no published result
GPQA Diamond	0.785 (64k)	0.770 (high)	Claude 3.7 Sonnet
MATH Level 5	0.912 (64k)	0.965 (high)	o3-mini
OTIS Mock AIME 2024-2025	0.578 (64k)	0.769 (high)	o3-mini
FrontierMath	0.041 (16k)	0.124 (high)	o3-mini
FrontierMath Tier 4	Not measured	0.042 (high)	Comparison unavailable — Claude 3.7 Sonnet has no published result
SimpleQA Verified	Not measured	0.153 (high)	Comparison unavailable — Claude 3.7 Sonnet has no published result
Chess Puzzles	Not measured	0.170 (high)	Comparison unavailable — Claude 3.7 Sonnet has no published result

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

What remains uncertain

Claude 3.7 Sonnet has no published result on Chess Puzzles, FrontierMath Tier 4, SimpleQA Verified.
o3-mini has no published result on SWE-bench Verified.

A missing result means Xentir has not found one published by the source it cites, not that the model performs badly. See Data Sources.

Reference price

Per 1M tokens	Claude 3.7 Sonnet	o3-mini
Output	—	$4.40

List price as published by the vendor. Xentir does not verify negotiated or enterprise rates, and price is not a measure of capability — see Data Sources.

Full profiles

Claude 3.7 Sonnet → · o3-mini → · the full AI Model Rankings table