LIVE INTELLIGENCE · part of the Xentir AI Index

Gemma 2 27B vs GPT-4 (Jun 2023)

Gemma 2 27B OPEN WEIGHTS · Google DeepMind, released 2024-06-24
GPT-4 (Jun 2023) · OpenAI, released 2023-06-13

“Epoch AI, 'AI Benchmarking Hub'. Published online at epoch.ai. Retrieved from 'https://epoch.ai/benchmarks' [online resource].” · epoch.ai/benchmarks · Licensed CC BY 4.0 · data last verified 2026-07-26 · Methodology · Data Sources

Head-to-head

Measured on 4 of 9 tracked benchmarks for both models — Gemma 2 27B leads on 4.

Benchmark	Gemma 2 27B	GPT-4 (Jun 2023)	Leads
Epoch Capabilities Index (ECI)	122.5	121.9	Gemma 2 27B
SWE-bench Verified	Not measured	Not measured	Not measured on both
GPQA Diamond	0.365	0.307	Gemma 2 27B
MATH Level 5	0.279	0.230	Gemma 2 27B
OTIS Mock AIME 2024-2025	0.014	0.011	Gemma 2 27B
FrontierMath	Not measured	Not measured	Not measured on both
FrontierMath Tier 4	Not measured	Not measured	Not measured on both
SimpleQA Verified	Not measured	Not measured	Not measured on both
Chess Puzzles	Not measured	Not measured	Not measured on both

Benchmark results measure specific tasks and should not be treated as a universal measure of model quality. A model with no row here for a benchmark has not been measured on it — that is left blank, never estimated.

Full profiles

Gemma 2 27B → · GPT-4 (Jun 2023) → · the full AI Model Rankings table