LIVE INTELLIGENCE · part of the Xentir AI Index

DeepSeek-R1 (May 2025) vs Gemma 4 31B IT

DeepSeek-R1 (May 2025) OPEN WEIGHTS · DeepSeek, released 2025-05-28
Gemma 4 31B IT OPEN WEIGHTS · Google DeepMind, released 2026-04-02

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources

Head-to-head

Measured on 2 of 9 tracked benchmarks for both models — DeepSeek-R1 (May 2025) leads on 2.

Benchmark	DeepSeek-R1 (May 2025)	Gemma 4 31B IT	Leads
Epoch Capabilities Index (ECI)	142.0	141.9	DeepSeek-R1 (May 2025)
SWE-bench Verified	Not measured	Not measured	Not measured on both
GPQA Diamond	0.763	Not measured	Not measured on both
MATH Level 5	0.966	Not measured	Not measured on both
OTIS Mock AIME 2024-2025	0.664	Not measured	Not measured on both
FrontierMath	Not measured	Not measured	Not measured on both
FrontierMath Tier 4	Not measured	Not measured	Not measured on both
SimpleQA Verified	0.274	0.096	DeepSeek-R1 (May 2025)
Chess Puzzles	Not measured	Not measured	Not measured on both

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

Full profiles

DeepSeek-R1 (May 2025) → · Gemma 4 31B IT → · the full AI Model Rankings table